Jul 07 08:06:18 devstack cinder-volume[75973]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 07 08:06:18 devstack cinder-volume[75973]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 08:06:18 devstack cinder-volume[75973]: we strongly recommend against using it for new projects. Jul 07 08:06:18 devstack cinder-volume[75973]: If you are already using Eventlet, we recommend migrating to a different Jul 07 08:06:18 devstack cinder-volume[75973]: framework. For more detail see Jul 07 08:06:18 devstack cinder-volume[75973]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 08:06:18 devstack cinder-volume[75973]: import eventlet # noqa Jul 07 08:06:21 devstack cinder-volume[75973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75973) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 08:06:21 devstack cinder-volume[75973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75973) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 08:06:21 devstack cinder-volume[75973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75973) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 08:06:22 devstack cinder-volume[75973]: INFO dbcounter [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] Registered counter for database cinder Jul 07 08:06:22 devstack cinder-volume[75973]: DEBUG oslo_db.sqlalchemy.engines [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75973) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 08:06:22 devstack cinder-volume[75973]: DEBUG dbcounter [-] [75973] Writer thread running {{(pid=75973) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 08:06:22 devstack cinder-volume[75973]: INFO cinder.rpc [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 07 08:06:22 devstack cinder-volume[75973]: INFO cinder.rpc [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 07 08:06:22 devstack cinder-volume[75973]: DEBUG oslo_db.sqlalchemy.engines [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75973) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 08:06:22 devstack cinder-volume[75973]: INFO cinder.volume.manager [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] Determined volume DB was empty at startup. Jul 07 08:06:22 devstack cinder-volume[75973]: DEBUG cinder.volume.manager [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75973) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 07 08:06:22 devstack cinder-volume[75973]: INFO cinder.volume.manager [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 07 08:06:22 devstack cinder-volume[75973]: WARNING stevedore.named [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 07 08:06:22 devstack cinder-volume[75973]: WARNING castellan.key_manager [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 08:06:22 devstack cinder-volume[75973]: WARNING cinder.keymgr.conf_key_mgr [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 08:06:22 devstack cinder-volume[75973]: DEBUG cinder.volume.drivers.lvm [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75973) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 07 08:06:22 devstack cinder-volume[75973]: DEBUG oslo_concurrency.processutils [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75973) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_concurrency.processutils [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] CMD "cinder-rtstool verify" returned: 0 in 0.423s {{(pid=75973) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_db.sqlalchemy.engines [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75973) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 08:06:23 devstack cinder-volume[75973]: INFO cinder.rpc [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 07 08:06:23 devstack cinder-volume[75973]: INFO cinder.rpc [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 07 08:06:23 devstack cinder-volume[75973]: WARNING stevedore.named [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 07 08:06:23 devstack cinder-volume[75973]: WARNING castellan.key_manager [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 08:06:23 devstack cinder-volume[75973]: INFO cinder.volume.manager [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_db.sqlalchemy.engines [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75973) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 08:06:23 devstack cinder-volume[75973]: INFO oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] Starting 1 workers Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] Started child 76134 {{(pid=75973) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] Full set of CONF: {{(pid=75973) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] ******************************************************************************** {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] Configuration options gathered from: {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] ================================================================================ {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] allow_availability_zone_fallback = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[76134]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] allow_compression_on_image_upload = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] allowed_direct_url_schemes = [] {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] api_rate_limit = True {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] auth_strategy = keystone {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] az_cache_duration = 3600 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_availability_zone = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_host = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_name = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_stats_polling_interval = 60 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backup_api_class = cinder.backup.api.API {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backup_name_template = backup-%s {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backup_use_same_host = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backup_use_temp_snapshot = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] chap_password = **** {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] chap_username = {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] cinder_internal_tenant_project_id = c7452aec47ae4951978a86ec4cb6433a {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] cinder_internal_tenant_user_id = 418637987e2940508a39ddc4a48c01ef {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] cloned_volume_same_az = True {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] cluster = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] compression_format = gzip {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] compute_api_class = cinder.compute.nova.API {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] config_dir = [] {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] config_source = [] {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] control_exchange = openstack {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] debug = True {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] default_availability_zone = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] default_group_type = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] default_volume_type = lvmdriver-1 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] disk_geometry = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[76134]: INFO cinder.volume.manager [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] driver_client_cert = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] driver_client_cert_key = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] driver_data_namespace = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] driver_ssl_cert_path = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] driver_ssl_cert_verify = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] driver_use_ssl = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] enable_force_upload = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] enable_new_services = True {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] enable_unsupported_driver = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] enforce_multipath_for_image_xfer = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] filter_function = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] glance_api_insecure = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] glance_api_servers = ['http://192.168.122.148/image'] {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] glance_api_ssl_compression = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] glance_ca_certificates_file = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] glance_catalog_info = image:glance:publicURL {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] glance_certfile = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] glance_keyfile = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] glance_num_retries = 3 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] glance_request_timeout = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] goodness_function = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] graceful_shutdown_timeout = 5 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:23 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] group_api_class = cinder.group.api.API {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] host = devstack {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] image_compress_on_upload = True {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] image_conversion_address_space_limit = 1 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] image_conversion_cpu_limit = 60 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] image_conversion_disable = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] image_upload_use_cinder_backend = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] image_upload_use_internal_tenant = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] image_volume_cache_enabled = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] image_volume_cache_max_count = 0 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] image_volume_cache_max_size_gb = 0 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] init_host_max_objects_retrieval = 0 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] instance_format = [instance: %(uuid)s] {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] iscsi_target_flags = {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] iscsi_write_cache = on {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] iser_helper = tgtadm {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] iser_ip_address = 192.168.122.148 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] iser_port = 3260 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] log_color = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] log_config_append = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:23 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] log_dir = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] log_file = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] log_options = True {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] log_rotate_interval = 1 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] log_rotate_interval_type = days {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] log_rotation_type = none {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] max_age = 0 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] max_logfile_count = 30 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] max_logfile_size_mb = 200 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] max_over_subscription_ratio = 20.0 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] message_reap_interval = 86400 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] message_ttl = 2592000 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] migration_create_volume_timeout_secs = 300 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] monkey_patch = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] monkey_patch_modules = [] {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] my_ip = 192.168.122.148 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] no_snapshot_gb_quota = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] num_iser_scan_tries = 3 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] num_shell_tries = 3 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] num_volume_device_scan_tries = 3 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] nvmeof_conn_info_version = 1 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:23 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] nvmet_ns_id = 10 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] nvmet_port_id = 1 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] osapi_max_limit = 1000 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] osapi_volume_ext_list = [] {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] osapi_volume_listen_port = 8776 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] osapi_volume_use_ssl = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] osapi_volume_workers = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] per_volume_size_limit = -1 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] periodic_fuzzy_delay = 60 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] periodic_interval = 60 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] public_endpoint = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] publish_errors = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] quota_backup_gigabytes = 1000 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] quota_backups = 10 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] quota_gigabytes = 1000 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] quota_groups = 10 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] quota_snapshots = 10 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] quota_volumes = 10 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] rate_limit_burst = 0 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] rate_limit_except_level = CRITICAL {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] rate_limit_interval = 0 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] reinit_driver_count = 3 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] replication_device = **** {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] report_discard_supported = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] report_interval = 120 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] reservation_clean_interval = 86400 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] reservation_expire = 86400 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] reserved_image_namespaces = [] {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] reserved_percentage = 0 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] rpc_response_timeout = 120 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] run_external_periodic_tasks = True {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] scst_target_driver = iscsi {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] scst_target_iqn_name = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack sudo[76138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] service_down_time = 720 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] shell_completion = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] snapshot_name_template = snapshot-%s {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] snapshot_same_host = True {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] split_loggers = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] state_path = /opt/stack/data/cinder {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] storage_availability_zone = nova {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack sudo[76138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] storage_protocol = iSCSI {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] syslog_log_facility = LOG_USER {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] target_helper = lioadm {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] target_ip_address = 192.168.122.148 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] target_port = 3260 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] target_protocol = iscsi {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] target_secondary_ip_addresses = [] {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] trace_flags = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] transport_url = **** {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] until_refresh = 0 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] use_chap_auth = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] use_default_quota_class = True {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] use_journal = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] use_json = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] use_multipath_for_image_xfer = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] use_stderr = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] use_syslog = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] verify_glance_signatures = enabled {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] volume_api_class = cinder.volume.api.API {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] volume_backend_name = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] volume_clear = zero {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] volume_clear_ionice = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] volume_clear_size = 0 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] volume_copy_bps_limit = 0 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] volume_dd_blocksize = 1M {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] volume_name_template = volume-%s {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] volume_service_inithost_offload = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] volume_usage_audit_period = month {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] zoning_mode = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_concurrency.disable_process_locking = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] keystone_authtoken.auth_section = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] keystone_authtoken.auth_type = password {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] keystone_authtoken.auth_version = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] keystone_authtoken.cache = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] keystone_authtoken.certfile = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] keystone_authtoken.include_service_catalog = True {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] keystone_authtoken.insecure = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] keystone_authtoken.interface = public {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] keystone_authtoken.keyfile = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] keystone_authtoken.memcache_password = {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] keystone_authtoken.memcache_username = {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] keystone_authtoken.region_name = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] keystone_authtoken.service_type = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.148/identity {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] cache.backend = dogpile.cache.null {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] cache.backend_argument = **** {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] cache.backend_expiration_time = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] cache.config_prefix = cache.oslo {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] cache.debug_cache_backend = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] cache.enable_retry_client = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] cache.enable_socket_keepalive = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] cache.enabled = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] cache.expiration_time = 600 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] cache.hashclient_retry_attempts = 2 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] cache.memcache_dead_retry = 300 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] cache.memcache_pool_maxsize = 10 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] cache.memcache_sasl_enabled = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] cache.password = **** {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] cache.proxies = [] {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] cache.redis_db = 0 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] cache.redis_server = localhost:6379 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] cache.retry_attempts = 2 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] cache.retry_delay = 0.0 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] cache.socket_keepalive_count = 1 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] cache.socket_keepalive_idle = 1 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] cache.socket_keepalive_interval = 1 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] cache.socket_timeout = 1.0 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] cache.tls_allowed_ciphers = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] cache.tls_cafile = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] cache.tls_certfile = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] cache.tls_enabled = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] cache.tls_keyfile = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] cache.username = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] coordination.backend_url = **** {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] database.asyncio_connection = **** {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] database.asyncio_slave_connection = **** {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] database.backend = sqlalchemy {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] database.connection = **** {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] database.connection_debug = 0 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] database.connection_parameters = {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] database.connection_recycle_time = 3600 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] database.connection_trace = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] database.db_inc_retry_interval = True {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] database.db_max_retries = 20 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] database.db_max_retry_interval = 10 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] database.db_retry_interval = 1 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] database.max_overflow = 50 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] database.max_pool_size = 5 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] database.max_retries = 10 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] database.mysql_wsrep_sync_wait = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] database.pool_timeout = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] database.retry_interval = 10 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] database.slave_connection = **** {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] database.sqlite_synchronous = True {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] database.synchronous_reader = True {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] database.use_db_reconnect = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] profiler.connection_string = messaging:// {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] profiler.enabled = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] profiler.es_doc_type = notification {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] profiler.es_scroll_size = 10000 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] profiler.es_scroll_time = 2m {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] profiler.filter_error_trace = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] profiler.hmac_keys = **** {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] profiler.sentinel_service_name = mymaster {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] profiler.socket_timeout = 0.1 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] profiler.trace_requests = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] profiler.trace_sqlalchemy = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] profiler_jaeger.process_tags = {} {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] profiler_jaeger.service_name_prefix = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] profiler_otlp.service_name_prefix = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_policy.enforce_new_defaults = True {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_policy.enforce_scope = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_policy.policy_default_rule = default {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_policy.policy_file = policy.yaml {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] privsep_osbrick.group = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] privsep_osbrick.helper_command = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] privsep_osbrick.user = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] cinder_sys_admin.group = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] cinder_sys_admin.helper_command = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] cinder_sys_admin.user = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] service_user.auth_section = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] service_user.auth_type = password {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] service_user.cafile = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] service_user.certfile = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] service_user.collect_timing = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] service_user.insecure = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] service_user.keyfile = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] service_user.send_service_user_token = True {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] service_user.split_loggers = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] service_user.timeout = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] glance.auth_section = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] glance.auth_type = password {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] glance.certfile = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] glance.collect_timing = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] glance.insecure = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] glance.keyfile = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] glance.region_name = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] glance.split_loggers = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] glance.timeout = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.backend_availability_zone = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.chap_password = **** {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.chap_username = {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.disk_geometry = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.driver_client_cert = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.driver_client_cert_key = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.driver_data_namespace = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.driver_use_ssl = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.extra_capabilities = {} {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.filter_function = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.goodness_function = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.iscsi_target_flags = {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.iscsi_write_cache = on {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.iser_helper = tgtadm {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.iser_ip_address = 192.168.122.148 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.iser_port = 3260 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.lvm_share_target = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.lvm_type = auto {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.num_shell_tries = 3 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.replication_device = **** {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.report_discard_supported = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.reserved_percentage = 0 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.target_helper = tgtadm {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.target_ip_address = 192.168.122.148 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.target_port = 3260 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.target_protocol = iscsi {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.trace_flags = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.unique_fqdn_network = True {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.use_chap_auth = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.volume_backend_name = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.volume_clear = zero {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.volume_clear_ionice = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.volume_clear_size = 0 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_reports.file_event_handler = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_reports.log_dir = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.backend_host = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.chap_password = **** {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.chap_username = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.disk_geometry = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.driver_client_cert = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.extra_capabilities = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.filter_function = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.goodness_function = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.iser_helper = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.iser_ip_address = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.iser_port = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.lvm_share_target = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.lvm_type = auto {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.num_shell_tries = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.replication_device = **** {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.report_discard_supported = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.reserved_percentage = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.scst_target_driver = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.storage_protocol = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.target_helper = lioadm {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.target_ip_address = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.target_port = 3260 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.trace_flags = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.use_chap_auth = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.volume_clear = zero {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.volume_clear_size = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] lvmdriver-1.volumes_dir = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_messaging_rabbit.ssl = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_messaging_notifications.driver = [] {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_messaging_notifications.retry = -1 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] key_manager.fixed_key = **** {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] barbican.barbican_api_version = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] barbican.barbican_endpoint = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] barbican.barbican_endpoint_type = public {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] barbican.barbican_region_name = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] barbican.cafile = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] barbican.certfile = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] barbican.collect_timing = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] barbican.insecure = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] barbican.keyfile = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] barbican.number_of_retries = 60 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] barbican.retry_delay = 1 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] barbican.send_service_user_token = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] barbican.split_loggers = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] barbican.timeout = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] barbican.verify_ssl = True {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] barbican.verify_ssl_path = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] barbican_service_user.auth_section = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] barbican_service_user.auth_type = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] barbican_service_user.cafile = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] barbican_service_user.certfile = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] barbican_service_user.collect_timing = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] barbican_service_user.insecure = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] barbican_service_user.keyfile = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] barbican_service_user.split_loggers = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] barbican_service_user.timeout = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] vault.approle_role_id = **** {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] vault.approle_secret_id = **** {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] vault.kv_mountpoint = secret {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] vault.kv_path = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] vault.kv_version = 2 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] vault.namespace = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] vault.root_token_id = **** {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] vault.ssl_ca_crt_file = None {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] vault.timeout = 60.0 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] vault.use_ssl = False {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:23 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] ******************************************************************************** {{(pid=75973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 07 08:06:24 devstack sudo[76138]: pam_unix(sudo:session): session closed for user root Jul 07 08:06:24 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.708s {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:24 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:24 devstack sudo[76146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 08:06:24 devstack sudo[76146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:06:24 devstack sudo[76146]: pam_unix(sudo:session): session closed for user root Jul 07 08:06:25 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.654s {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:25 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:06:25 devstack cinder-volume[76134]: INFO cinder.brick.local_dev.lvm [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 07 08:06:25 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:25 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:25 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:25 devstack sudo[76420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 08:06:25 devstack sudo[76420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:06:25 devstack sudo[76420]: pam_unix(sudo:session): session closed for user root Jul 07 08:06:25 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.665s {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:25 devstack cinder-volume[76134]: DEBUG cinder.brick.local_dev.lvm [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76134) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 07 08:06:25 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:25 devstack sudo[76629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 08:06:25 devstack sudo[76629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:06:27 devstack sudo[76629]: pam_unix(sudo:session): session closed for user root Jul 07 08:06:27 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.362s {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:27 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:27 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:27 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:27 devstack sudo[76887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 08:06:27 devstack sudo[76887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:06:27 devstack sudo[76887]: pam_unix(sudo:session): session closed for user root Jul 07 08:06:27 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.715s {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:27 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:27 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:27 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:27 devstack sudo[76917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 07 08:06:27 devstack sudo[76917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:06:28 devstack sudo[76917]: pam_unix(sudo:session): session closed for user root Jul 07 08:06:28 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.709s {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:28 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:28 devstack sudo[76921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 08:06:28 devstack sudo[76921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:06:29 devstack sudo[76921]: pam_unix(sudo:session): session closed for user root Jul 07 08:06:29 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.844s {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:29 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:29 devstack sudo[76932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 08:06:29 devstack sudo[76932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:06:30 devstack sudo[76932]: pam_unix(sudo:session): session closed for user root Jul 07 08:06:30 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.834s {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:30 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:30 devstack sudo[76938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 08:06:30 devstack sudo[76938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:06:30 devstack sudo[76938]: pam_unix(sudo:session): session closed for user root Jul 07 08:06:30 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.689s {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:30 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:30 devstack sudo[76948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 08:06:30 devstack sudo[76948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:06:31 devstack sudo[76948]: pam_unix(sudo:session): session closed for user root Jul 07 08:06:31 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.633s {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:31 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:31 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:31 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:31 devstack sudo[76952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 08:06:31 devstack sudo[76952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:06:32 devstack sudo[76952]: pam_unix(sudo:session): session closed for user root Jul 07 08:06:32 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.648s {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:32 devstack cinder-volume[76134]: INFO cinder.volume.drivers.lvm [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 07 08:06:32 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:32 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:32 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:32 devstack sudo[76961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 08:06:32 devstack sudo[76961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:06:32 devstack sudo[76961]: pam_unix(sudo:session): session closed for user root Jul 07 08:06:32 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.736s {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:32 devstack cinder-volume[76134]: DEBUG cinder.volume.drivers.lvm [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] Updating volume stats {{(pid=76134) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 08:06:32 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:32 devstack sudo[77077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 08:06:32 devstack sudo[77077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:06:33 devstack cinder-volume[75973]: DEBUG dbcounter [-] [75973] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75973) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:06:33 devstack sudo[77077]: pam_unix(sudo:session): session closed for user root Jul 07 08:06:33 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.629s {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:33 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:33 devstack sudo[77219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 08:06:33 devstack sudo[77219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:06:34 devstack sudo[77219]: pam_unix(sudo:session): session closed for user root Jul 07 08:06:34 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.654s {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:34 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:34 devstack sudo[77222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 08:06:34 devstack sudo[77222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:06:34 devstack sudo[77222]: pam_unix(sudo:session): session closed for user root Jul 07 08:06:34 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.609s {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:34 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:34 devstack sudo[77226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 08:06:34 devstack sudo[77226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:06:35 devstack sudo[77226]: pam_unix(sudo:session): session closed for user root Jul 07 08:06:35 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.637s {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:35 devstack cinder-volume[76134]: INFO cinder.volume.driver [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] Driver hasn't implemented _init_vendor_properties() Jul 07 08:06:35 devstack cinder-volume[76134]: DEBUG cinder.volume.driver [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76134) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 07 08:06:35 devstack cinder-volume[76134]: DEBUG oslo_db.sqlalchemy.engines [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76134) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 08:06:35 devstack cinder-volume[76134]: DEBUG dbcounter [-] [76134] Writer thread running {{(pid=76134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 08:06:35 devstack cinder-volume[76134]: DEBUG cinder.db.api [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] Building query based on filter {{(pid=76134) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 07 08:06:35 devstack cinder-volume[76134]: DEBUG cinder.image.image_utils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76134) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 07 08:06:35 devstack cinder-volume[76134]: INFO cinder.keymgr.migration [None req-6c39702d-cfb6-406d-957e-ff9f76ad3d53 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 07 08:06:35 devstack cinder-volume[76134]: DEBUG cinder.volume.drivers.lvm [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] Updating volume stats {{(pid=76134) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 08:06:35 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:35 devstack sudo[77230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 08:06:35 devstack sudo[77230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:06:36 devstack sudo[77230]: pam_unix(sudo:session): session closed for user root Jul 07 08:06:36 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.664s {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:36 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:36 devstack sudo[77234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 08:06:36 devstack sudo[77234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:06:36 devstack sudo[77234]: pam_unix(sudo:session): session closed for user root Jul 07 08:06:36 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.662s {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:36 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:36 devstack sudo[77240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 08:06:36 devstack sudo[77240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:06:37 devstack sudo[77240]: pam_unix(sudo:session): session closed for user root Jul 07 08:06:37 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.665s {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:37 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:37 devstack sudo[77244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 08:06:37 devstack sudo[77244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:06:38 devstack sudo[77244]: pam_unix(sudo:session): session closed for user root Jul 07 08:06:38 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.656s {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:38 devstack cinder-volume[76134]: DEBUG cinder.manager [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] Notifying Schedulers of capabilities ... {{(pid=76134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:06:38 devstack cinder-volume[76134]: INFO cinder.volume.manager [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] Driver initialization completed successfully. Jul 07 08:06:38 devstack cinder-volume[76134]: INFO cinder.manager [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] Initiating service 2 cleanup Jul 07 08:06:38 devstack cinder-volume[76134]: INFO cinder.manager [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] Service 2 cleanup completed. Jul 07 08:06:38 devstack cinder-volume[76134]: DEBUG cinder.service [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] Creating RPC server for service cinder-volume {{(pid=76134) start /opt/stack/cinder/cinder/service.py:231}} Jul 07 08:06:38 devstack cinder-volume[76134]: DEBUG cinder.service [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76134) start /opt/stack/cinder/cinder/service.py:237}} Jul 07 08:06:38 devstack cinder-volume[76134]: INFO cinder.volume.manager [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 07 08:06:38 devstack cinder-volume[76134]: DEBUG cinder.volume.drivers.lvm [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] Updating volume stats {{(pid=76134) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 08:06:38 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:38 devstack sudo[77248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 08:06:38 devstack sudo[77248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:06:39 devstack sudo[77248]: pam_unix(sudo:session): session closed for user root Jul 07 08:06:39 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.727s {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:39 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:39 devstack sudo[77251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 08:06:39 devstack sudo[77251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:06:39 devstack sudo[77251]: pam_unix(sudo:session): session closed for user root Jul 07 08:06:39 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.705s {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:39 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:39 devstack sudo[77308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 08:06:39 devstack sudo[77308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:06:40 devstack sudo[77308]: pam_unix(sudo:session): session closed for user root Jul 07 08:06:40 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.622s {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:40 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:40 devstack sudo[77315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 08:06:40 devstack sudo[77315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:06:41 devstack sudo[77315]: pam_unix(sudo:session): session closed for user root Jul 07 08:06:41 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.614s {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:41 devstack cinder-volume[76134]: INFO cinder.volume.manager [None req-51bc4836-661e-4198-b114-93bfe0d267ef None None] Driver post RPC initialization completed successfully. Jul 07 08:06:51 devstack cinder-volume[76134]: DEBUG dbcounter [-] [76134] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:06:51 devstack cinder-volume[76134]: DEBUG dbcounter [-] [76134] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:07:03 devstack cinder-volume[76134]: DEBUG oslo_service.periodic_task [None req-cfdc9cd0-d0b5-46ca-8167-000a7a342037 None None] Running periodic task VolumeManager._thread_info {{(pid=76134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:07:03 devstack cinder-volume[76134]: DEBUG cinder.volume.manager [None req-cfdc9cd0-d0b5-46ca-8167-000a7a342037 None None] thread count: 6 {{(pid=76134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 08:07:03 devstack cinder-volume[76134]: DEBUG cinder.volume.manager [None req-cfdc9cd0-d0b5-46ca-8167-000a7a342037 None None] thread info: [<_MainThread(MainThread, started 139233564315776)>, , , , , ] {{(pid=76134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 08:08:03 devstack cinder-volume[76134]: DEBUG oslo_service.periodic_task [None req-cfdc9cd0-d0b5-46ca-8167-000a7a342037 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:08:03 devstack cinder-volume[76134]: DEBUG cinder.volume.drivers.lvm [None req-cfdc9cd0-d0b5-46ca-8167-000a7a342037 None None] Updating volume stats {{(pid=76134) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 08:08:03 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-cfdc9cd0-d0b5-46ca-8167-000a7a342037 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:08:03 devstack sudo[79641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 08:08:03 devstack sudo[79641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:08:03 devstack sudo[79641]: pam_unix(sudo:session): session closed for user root Jul 07 08:08:03 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-cfdc9cd0-d0b5-46ca-8167-000a7a342037 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.701s {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:08:03 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-cfdc9cd0-d0b5-46ca-8167-000a7a342037 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:08:03 devstack sudo[79645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 08:08:03 devstack sudo[79645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:08:04 devstack sudo[79645]: pam_unix(sudo:session): session closed for user root Jul 07 08:08:04 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-cfdc9cd0-d0b5-46ca-8167-000a7a342037 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.653s {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:08:04 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-cfdc9cd0-d0b5-46ca-8167-000a7a342037 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:08:04 devstack sudo[79651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 08:08:04 devstack sudo[79651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:08:05 devstack sudo[79651]: pam_unix(sudo:session): session closed for user root Jul 07 08:08:05 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-cfdc9cd0-d0b5-46ca-8167-000a7a342037 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.626s {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:08:05 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-cfdc9cd0-d0b5-46ca-8167-000a7a342037 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:08:05 devstack sudo[79654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 08:08:05 devstack sudo[79654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:08:05 devstack sudo[79654]: pam_unix(sudo:session): session closed for user root Jul 07 08:08:05 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-cfdc9cd0-d0b5-46ca-8167-000a7a342037 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.649s {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:08:05 devstack cinder-volume[76134]: DEBUG cinder.manager [None req-cfdc9cd0-d0b5-46ca-8167-000a7a342037 None None] Notifying Schedulers of capabilities ... {{(pid=76134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:08:05 devstack cinder-volume[76134]: DEBUG oslo_service.periodic_task [None req-cfdc9cd0-d0b5-46ca-8167-000a7a342037 None None] Running periodic task VolumeManager._thread_info {{(pid=76134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:08:05 devstack cinder-volume[76134]: DEBUG cinder.volume.manager [None req-cfdc9cd0-d0b5-46ca-8167-000a7a342037 None None] thread count: 6 {{(pid=76134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 08:08:05 devstack cinder-volume[76134]: DEBUG cinder.volume.manager [None req-cfdc9cd0-d0b5-46ca-8167-000a7a342037 None None] thread info: [<_MainThread(MainThread, started 139233564315776)>, , , , , ] {{(pid=76134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 08:08:51 devstack cinder-volume[76134]: DEBUG dbcounter [-] [76134] Writing DB stats cinder:SELECT=1 {{(pid=76134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:08:51 devstack cinder-volume[76134]: DEBUG dbcounter [-] [76134] Writing DB stats cinder:UPDATE=1 {{(pid=76134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:09:03 devstack cinder-volume[76134]: DEBUG oslo_service.periodic_task [None req-cfdc9cd0-d0b5-46ca-8167-000a7a342037 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:09:03 devstack cinder-volume[76134]: DEBUG cinder.volume.drivers.lvm [None req-cfdc9cd0-d0b5-46ca-8167-000a7a342037 None None] Updating volume stats {{(pid=76134) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 08:09:03 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-cfdc9cd0-d0b5-46ca-8167-000a7a342037 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:09:03 devstack sudo[83260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 08:09:03 devstack sudo[83260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:09:03 devstack sudo[83260]: pam_unix(sudo:session): session closed for user root Jul 07 08:09:03 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-cfdc9cd0-d0b5-46ca-8167-000a7a342037 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.660s {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:09:03 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-cfdc9cd0-d0b5-46ca-8167-000a7a342037 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:09:03 devstack sudo[83313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 08:09:03 devstack sudo[83313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:09:04 devstack sudo[83313]: pam_unix(sudo:session): session closed for user root Jul 07 08:09:04 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-cfdc9cd0-d0b5-46ca-8167-000a7a342037 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.618s {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:09:04 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-cfdc9cd0-d0b5-46ca-8167-000a7a342037 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:09:04 devstack sudo[83316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 08:09:04 devstack sudo[83316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:09:05 devstack sudo[83316]: pam_unix(sudo:session): session closed for user root Jul 07 08:09:05 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-cfdc9cd0-d0b5-46ca-8167-000a7a342037 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.621s {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:09:05 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-cfdc9cd0-d0b5-46ca-8167-000a7a342037 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:09:05 devstack sudo[83347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 08:09:05 devstack sudo[83347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:09:05 devstack sudo[83347]: pam_unix(sudo:session): session closed for user root Jul 07 08:09:05 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-cfdc9cd0-d0b5-46ca-8167-000a7a342037 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.631s {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:09:05 devstack cinder-volume[76134]: DEBUG cinder.manager [None req-cfdc9cd0-d0b5-46ca-8167-000a7a342037 None None] Notifying Schedulers of capabilities ... {{(pid=76134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:09:05 devstack cinder-volume[76134]: DEBUG oslo_service.periodic_task [None req-cfdc9cd0-d0b5-46ca-8167-000a7a342037 None None] Running periodic task VolumeManager._thread_info {{(pid=76134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:09:05 devstack cinder-volume[76134]: DEBUG cinder.volume.manager [None req-cfdc9cd0-d0b5-46ca-8167-000a7a342037 None None] thread count: 6 {{(pid=76134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 08:09:05 devstack cinder-volume[76134]: DEBUG cinder.volume.manager [None req-cfdc9cd0-d0b5-46ca-8167-000a7a342037 None None] thread info: [<_MainThread(MainThread, started 139233564315776)>, , , , , ] {{(pid=76134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 08:10:03 devstack cinder-volume[76134]: DEBUG oslo_service.periodic_task [None req-cfdc9cd0-d0b5-46ca-8167-000a7a342037 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:10:03 devstack cinder-volume[76134]: DEBUG cinder.volume.drivers.lvm [None req-cfdc9cd0-d0b5-46ca-8167-000a7a342037 None None] Updating volume stats {{(pid=76134) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 08:10:03 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-cfdc9cd0-d0b5-46ca-8167-000a7a342037 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:10:03 devstack sudo[84969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 08:10:03 devstack sudo[84969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:10:03 devstack sudo[84969]: pam_unix(sudo:session): session closed for user root Jul 07 08:10:03 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-cfdc9cd0-d0b5-46ca-8167-000a7a342037 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.621s {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:10:03 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-cfdc9cd0-d0b5-46ca-8167-000a7a342037 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:10:03 devstack sudo[84992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 08:10:03 devstack sudo[84992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:10:04 devstack sudo[84992]: pam_unix(sudo:session): session closed for user root Jul 07 08:10:04 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-cfdc9cd0-d0b5-46ca-8167-000a7a342037 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.639s {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:10:04 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-cfdc9cd0-d0b5-46ca-8167-000a7a342037 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:10:04 devstack sudo[84996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 08:10:04 devstack sudo[84996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:10:05 devstack sudo[84996]: pam_unix(sudo:session): session closed for user root Jul 07 08:10:05 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-cfdc9cd0-d0b5-46ca-8167-000a7a342037 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.616s {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:10:05 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-cfdc9cd0-d0b5-46ca-8167-000a7a342037 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:10:05 devstack sudo[85001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 08:10:05 devstack sudo[85001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:10:05 devstack sudo[85001]: pam_unix(sudo:session): session closed for user root Jul 07 08:10:05 devstack cinder-volume[76134]: DEBUG oslo_concurrency.processutils [None req-cfdc9cd0-d0b5-46ca-8167-000a7a342037 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.620s {{(pid=76134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:10:05 devstack cinder-volume[76134]: DEBUG cinder.manager [None req-cfdc9cd0-d0b5-46ca-8167-000a7a342037 None None] Notifying Schedulers of capabilities ... {{(pid=76134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:10:05 devstack cinder-volume[76134]: DEBUG oslo_service.periodic_task [None req-cfdc9cd0-d0b5-46ca-8167-000a7a342037 None None] Running periodic task VolumeManager._thread_info {{(pid=76134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:10:05 devstack cinder-volume[76134]: DEBUG cinder.volume.manager [None req-cfdc9cd0-d0b5-46ca-8167-000a7a342037 None None] thread count: 6 {{(pid=76134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 08:10:05 devstack cinder-volume[76134]: DEBUG cinder.volume.manager [None req-cfdc9cd0-d0b5-46ca-8167-000a7a342037 None None] thread info: [<_MainThread(MainThread, started 139233564315776)>, , , , , ] {{(pid=76134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 08:10:51 devstack cinder-volume[76134]: DEBUG dbcounter [-] [76134] Writing DB stats cinder:SELECT=1 {{(pid=76134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:10:51 devstack cinder-volume[76134]: DEBUG dbcounter [-] [76134] Writing DB stats cinder:UPDATE=1 {{(pid=76134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:10:56 devstack cinder-volume[75973]: INFO oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] Caught SIGTERM, stopping children Jul 07 08:10:56 devstack cinder-volume[75973]: DEBUG oslo_concurrency.lockutils [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] Acquiring lock "singleton_lock" {{(pid=75973) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 08:10:56 devstack cinder-volume[75973]: DEBUG oslo_concurrency.lockutils [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] Acquired lock "singleton_lock" {{(pid=75973) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 08:10:56 devstack cinder-volume[75973]: DEBUG oslo_concurrency.lockutils [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] Releasing lock "singleton_lock" {{(pid=75973) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 08:10:56 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] Stop services. {{(pid=75973) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 07 08:10:56 devstack cinder-volume[75973]: DEBUG oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] Killing children. {{(pid=75973) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 07 08:10:56 devstack cinder-volume[75973]: INFO oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] Waiting on 1 children to exit Jul 07 08:10:58 devstack cinder-volume[76134]: DEBUG oslo_concurrency.lockutils [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] Acquiring lock "singleton_lock" {{(pid=76134) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 08:10:58 devstack cinder-volume[76134]: DEBUG oslo_concurrency.lockutils [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] Acquired lock "singleton_lock" {{(pid=76134) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 08:10:58 devstack cinder-volume[76134]: DEBUG oslo_concurrency.lockutils [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] Releasing lock "singleton_lock" {{(pid=76134) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 08:10:58 devstack cinder-volume[76134]: WARNING amqp [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 07 08:10:58 devstack cinder-volume[76134]: WARNING amqp [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 07 08:10:58 devstack cinder-volume[75973]: INFO oslo_service.backend._eventlet.service [None req-24463aea-80b8-4fab-94be-979c8b3ba182 None None] Child 76134 exited with status 0 Jul 07 08:10:58 devstack cinder-volume[86215]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 07 08:10:58 devstack cinder-volume[86215]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 08:10:58 devstack cinder-volume[86215]: we strongly recommend against using it for new projects. Jul 07 08:10:58 devstack cinder-volume[86215]: If you are already using Eventlet, we recommend migrating to a different Jul 07 08:10:58 devstack cinder-volume[86215]: framework. For more detail see Jul 07 08:10:58 devstack cinder-volume[86215]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 08:10:58 devstack cinder-volume[86215]: import eventlet # noqa Jul 07 08:11:00 devstack cinder-volume[86215]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86215) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 08:11:00 devstack cinder-volume[86215]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86215) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 08:11:00 devstack cinder-volume[86215]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86215) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 08:11:01 devstack cinder-volume[86215]: INFO dbcounter [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] Registered counter for database cinder Jul 07 08:11:01 devstack cinder-volume[86215]: DEBUG oslo_db.sqlalchemy.engines [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86215) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 08:11:01 devstack cinder-volume[86215]: DEBUG dbcounter [-] [86215] Writer thread running {{(pid=86215) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 08:11:01 devstack cinder-volume[86215]: INFO cinder.rpc [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 07 08:11:01 devstack cinder-volume[86215]: INFO cinder.rpc [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_db.sqlalchemy.engines [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86215) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 08:11:02 devstack cinder-volume[86215]: INFO cinder.volume.manager [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] Determined volume DB was empty at startup. Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG cinder.volume.manager [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86215) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 07 08:11:02 devstack cinder-volume[86215]: INFO cinder.volume.manager [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 07 08:11:02 devstack cinder-volume[86215]: WARNING stevedore.named [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 07 08:11:02 devstack cinder-volume[86215]: WARNING castellan.key_manager [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 08:11:02 devstack cinder-volume[86215]: WARNING cinder.keymgr.conf_key_mgr [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 08:11:02 devstack cinder-volume[86215]: INFO cinder.volume.manager [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_db.sqlalchemy.engines [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86215) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 08:11:02 devstack cinder-volume[86215]: INFO oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] Starting 1 workers Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] Started child 86432 {{(pid=86215) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] Full set of CONF: {{(pid=86215) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] ******************************************************************************** {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] Configuration options gathered from: {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] ================================================================================ {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 07 08:11:02 devstack cinder-volume[86432]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] allow_availability_zone_fallback = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] allow_compression_on_image_upload = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] allowed_direct_url_schemes = [] {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] api_rate_limit = True {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] auth_strategy = keystone {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_availability_zone = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_host = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_name = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_stats_polling_interval = 60 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backup_api_class = cinder.backup.api.API {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backup_name_template = backup-%s {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backup_use_same_host = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backup_use_temp_snapshot = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] chap_password = **** {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] chap_username = {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] cinder_internal_tenant_project_id = c7452aec47ae4951978a86ec4cb6433a {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] cinder_internal_tenant_user_id = 418637987e2940508a39ddc4a48c01ef {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] cluster = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] compression_format = gzip {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] compute_api_class = cinder.compute.nova.API {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] config_dir = [] {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] config_source = [] {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] control_exchange = openstack {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] debug = True {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] default_availability_zone = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] default_group_type = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] default_volume_type = QuobyteHD {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] disk_geometry = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] driver_client_cert = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] driver_client_cert_key = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] driver_data_namespace = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] driver_ssl_cert_path = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] driver_ssl_cert_verify = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] driver_use_ssl = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] enable_new_services = True {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] enable_unsupported_driver = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] enabled_backends = ['QuobyteHD'] {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] enforce_multipath_for_image_xfer = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] filter_function = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] glance_api_insecure = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] glance_api_servers = ['http://192.168.122.148/image'] {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] glance_api_ssl_compression = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] glance_ca_certificates_file = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] glance_catalog_info = image:glance:publicURL {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] glance_certfile = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] glance_keyfile = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] glance_num_retries = 3 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] glance_request_timeout = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] goodness_function = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] graceful_shutdown_timeout = 5 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] group_api_class = cinder.group.api.API {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] host = devstack {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] image_compress_on_upload = True {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] image_conversion_address_space_limit = 1 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] image_conversion_cpu_limit = 60 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] image_conversion_disable = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] image_upload_use_cinder_backend = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] image_upload_use_internal_tenant = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86432]: INFO cinder.volume.manager [None req-31a2fe1b-25b2-4547-ada2-03e922e136e3 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] image_volume_cache_enabled = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] image_volume_cache_max_count = 0 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] image_volume_cache_max_size_gb = 0 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] init_host_max_objects_retrieval = 0 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] instance_format = [instance: %(uuid)s] {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] iscsi_target_flags = {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] iscsi_write_cache = on {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] iser_helper = tgtadm {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] iser_ip_address = 192.168.122.148 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] iser_port = 3260 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] log_color = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] log_config_append = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] log_dir = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] log_file = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] log_options = True {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] log_rotate_interval = 1 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] log_rotate_interval_type = days {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] log_rotation_type = none {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86432]: DEBUG cinder.volume.drivers.remotefs [None req-31a2fe1b-25b2-4547-ada2-03e922e136e3 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86432) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] max_age = 0 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] max_logfile_count = 30 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] max_logfile_size_mb = 200 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] max_over_subscription_ratio = 20.0 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] message_reap_interval = 86400 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] message_ttl = 2592000 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] migration_create_volume_timeout_secs = 300 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] monkey_patch = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] monkey_patch_modules = [] {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] my_ip = 192.168.122.148 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] no_snapshot_gb_quota = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] num_iser_scan_tries = 3 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] num_shell_tries = 3 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] num_volume_device_scan_tries = 3 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] nvmeof_conn_info_version = 1 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] nvmet_ns_id = 10 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] nvmet_port_id = 1 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] osapi_max_limit = 1000 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] osapi_volume_ext_list = [] {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] osapi_volume_listen_port = 8776 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] osapi_volume_use_ssl = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] osapi_volume_workers = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] per_volume_size_limit = -1 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] periodic_fuzzy_delay = 60 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] periodic_interval = 60 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] public_endpoint = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] publish_errors = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] quota_backup_gigabytes = 1000 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] quota_backups = 10 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] quota_gigabytes = 1000 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] quota_groups = 10 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] quota_snapshots = 10 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] quota_volumes = 10 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] rate_limit_burst = 0 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] rate_limit_except_level = CRITICAL {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] rate_limit_interval = 0 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] reinit_driver_count = 3 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] replication_device = **** {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] report_discard_supported = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] report_interval = 120 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] reservation_clean_interval = 86400 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] reservation_expire = 86400 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] reserved_image_namespaces = [] {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] reserved_percentage = 0 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] rpc_response_timeout = 120 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] run_external_periodic_tasks = True {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] scst_target_driver = iscsi {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] scst_target_iqn_name = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] service_down_time = 720 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] shell_completion = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] snapshot_name_template = snapshot-%s {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] split_loggers = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] state_path = /opt/stack/data/cinder {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] storage_availability_zone = nova {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] storage_protocol = iSCSI {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] syslog_log_facility = LOG_USER {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] target_helper = lioadm {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] target_ip_address = 192.168.122.148 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] target_port = 3260 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] target_protocol = iscsi {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] target_secondary_ip_addresses = [] {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] trace_flags = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] transport_url = **** {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] until_refresh = 0 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] use_chap_auth = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] use_default_quota_class = True {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] use_journal = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] use_json = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] use_multipath_for_image_xfer = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] use_stderr = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] use_syslog = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] verify_glance_signatures = enabled {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] volume_api_class = cinder.volume.api.API {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] volume_backend_name = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] volume_clear = zero {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] volume_clear_ionice = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] volume_clear_size = 0 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] volume_copy_bps_limit = 0 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] volume_dd_blocksize = 1M {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] volume_name_template = volume-%s {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] volume_service_inithost_offload = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] volume_usage_audit_period = month {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] zoning_mode = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_concurrency.disable_process_locking = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] keystone_authtoken.auth_section = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] keystone_authtoken.auth_type = password {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] keystone_authtoken.auth_version = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] keystone_authtoken.cache = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] keystone_authtoken.certfile = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] keystone_authtoken.include_service_catalog = True {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] keystone_authtoken.insecure = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] keystone_authtoken.interface = public {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] keystone_authtoken.keyfile = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] keystone_authtoken.memcache_password = {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] keystone_authtoken.memcache_username = {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] keystone_authtoken.region_name = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] keystone_authtoken.service_type = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.148/identity {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] cache.backend = dogpile.cache.null {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] cache.backend_argument = **** {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] cache.backend_expiration_time = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] cache.config_prefix = cache.oslo {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] cache.debug_cache_backend = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] cache.enable_retry_client = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] cache.enable_socket_keepalive = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] cache.enabled = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] cache.expiration_time = 600 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] cache.hashclient_retry_attempts = 2 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] cache.memcache_dead_retry = 300 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] cache.memcache_pool_maxsize = 10 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] cache.memcache_sasl_enabled = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] cache.password = **** {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] cache.proxies = [] {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] cache.redis_db = 0 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] cache.redis_server = localhost:6379 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] cache.retry_attempts = 2 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] cache.retry_delay = 0.0 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] cache.socket_keepalive_count = 1 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] cache.socket_keepalive_idle = 1 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] cache.socket_keepalive_interval = 1 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] cache.socket_timeout = 1.0 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] cache.tls_allowed_ciphers = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] cache.tls_cafile = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] cache.tls_certfile = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] cache.tls_enabled = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] cache.tls_keyfile = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] cache.username = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] coordination.backend_url = **** {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] database.asyncio_connection = **** {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] database.asyncio_slave_connection = **** {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] database.backend = sqlalchemy {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] database.connection = **** {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] database.connection_debug = 0 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] database.connection_parameters = {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] database.connection_recycle_time = 3600 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] database.connection_trace = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] database.db_inc_retry_interval = True {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] database.db_max_retries = 20 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] database.db_max_retry_interval = 10 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] database.db_retry_interval = 1 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86432]: DEBUG cinder.volume.drivers.quobyte [None req-31a2fe1b-25b2-4547-ada2-03e922e136e3 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86432) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 07 08:11:02 devstack cinder-volume[86432]: WARNING cinder.volume.drivers.quobyte [None req-31a2fe1b-25b2-4547-ada2-03e922e136e3 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 07 08:11:02 devstack cinder-volume[86432]: WARNING cinder.volume.drivers.quobyte [None req-31a2fe1b-25b2-4547-ada2-03e922e136e3 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 07 08:11:02 devstack cinder-volume[86432]: DEBUG oslo_concurrency.processutils [None req-31a2fe1b-25b2-4547-ada2-03e922e136e3 None None] Running cmd (subprocess): mount.quobyte {{(pid=86432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] database.max_overflow = 50 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] database.max_pool_size = 5 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] database.max_retries = 10 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] database.mysql_wsrep_sync_wait = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] database.pool_timeout = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] database.retry_interval = 10 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] database.slave_connection = **** {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] database.sqlite_synchronous = True {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] database.synchronous_reader = True {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] database.use_db_reconnect = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] profiler.connection_string = messaging:// {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] profiler.enabled = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] profiler.es_doc_type = notification {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] profiler.es_scroll_size = 10000 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] profiler.es_scroll_time = 2m {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] profiler.filter_error_trace = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] profiler.hmac_keys = **** {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] profiler.sentinel_service_name = mymaster {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] profiler.socket_timeout = 0.1 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] profiler.trace_requests = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] profiler.trace_sqlalchemy = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] profiler_jaeger.process_tags = {} {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] profiler_jaeger.service_name_prefix = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] profiler_otlp.service_name_prefix = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_policy.enforce_new_defaults = True {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_policy.enforce_scope = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_policy.policy_default_rule = default {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_policy.policy_file = policy.yaml {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] privsep_osbrick.group = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] privsep_osbrick.helper_command = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] privsep_osbrick.user = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] cinder_sys_admin.group = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] cinder_sys_admin.helper_command = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] cinder_sys_admin.user = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] service_user.auth_section = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] service_user.auth_type = password {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] service_user.cafile = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] service_user.certfile = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] service_user.collect_timing = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] service_user.insecure = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] service_user.keyfile = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] service_user.send_service_user_token = True {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] service_user.split_loggers = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] service_user.timeout = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] glance.auth_section = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] glance.auth_type = password {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] glance.certfile = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] glance.collect_timing = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] glance.insecure = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] glance.keyfile = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] glance.region_name = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] glance.split_loggers = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] glance.timeout = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.backend_availability_zone = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.chap_password = **** {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.chap_username = {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.disk_geometry = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.driver_client_cert = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.driver_client_cert_key = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.driver_data_namespace = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.driver_use_ssl = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.extra_capabilities = {} {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.filter_function = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.goodness_function = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.iscsi_target_flags = {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.iscsi_write_cache = on {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.iser_helper = tgtadm {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.iser_ip_address = 192.168.122.148 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.iser_port = 3260 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack quobyte-client[86437]: Reading configuration file: /etc/quobyte/client.cfg Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack quobyte-client[86437]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.nas_host = {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.nas_login = admin {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.nas_mount_options = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.nas_password = **** {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.nas_private_key = {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86432]: DEBUG oslo_concurrency.processutils [None req-31a2fe1b-25b2-4547-ada2-03e922e136e3 None None] CMD "mount.quobyte" returned: 1 in 0.072s {{(pid=86432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:11:02 devstack cinder-volume[86432]: DEBUG oslo_concurrency.lockutils [None req-31a2fe1b-25b2-4547-ada2-03e922e136e3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:11:02 devstack cinder-volume[86432]: DEBUG oslo_concurrency.lockutils [None req-31a2fe1b-25b2-4547-ada2-03e922e136e3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:11:02 devstack cinder-volume[86432]: DEBUG cinder.volume.drivers.quobyte [None req-31a2fe1b-25b2-4547-ada2-03e922e136e3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=86432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86432]: INFO cinder.volume.drivers.quobyte [None req-31a2fe1b-25b2-4547-ada2-03e922e136e3 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b ... Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.nas_share_path = {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86432]: DEBUG oslo_concurrency.processutils [None req-31a2fe1b-25b2-4547-ada2-03e922e136e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 -c /etc/quobyte/client-cinder.cfg {{(pid=86432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.num_shell_tries = 3 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.quobyte_volume_url = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.replication_device = **** {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.report_discard_supported = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.reserved_percentage = 0 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.target_helper = tgtadm {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.target_ip_address = 192.168.122.148 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.target_port = 3260 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.target_protocol = iscsi {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.trace_flags = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.unique_fqdn_network = True {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.use_chap_auth = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack sudo[86438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 -c /etc/quobyte/client-cinder.cfg Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.volume_backend_name = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.volume_clear = zero {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.volume_clear_ionice = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.volume_clear_size = 0 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack sudo[86438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_reports.file_event_handler = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_reports.log_dir = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.backend_availability_zone = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.backend_host = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.chap_password = **** {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.chap_username = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.chiscsi_conf = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.disk_geometry = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.driver_client_cert = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.driver_data_namespace = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.driver_use_ssl = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.extra_capabilities = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.filter_function = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.goodness_function = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.iser_helper = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.iser_ip_address = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.iser_port = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.iser_target_prefix = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.nas_host = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.nas_login = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.nas_mount_options = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.nas_password = **** {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.nas_private_key = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.nas_share_path = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.nas_ssh_port = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.num_shell_tries = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.nvmet_port_id = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.replication_device = **** {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.report_discard_supported = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.reserved_percentage = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.scst_target_driver = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.storage_protocol = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.target_helper = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.target_ip_address = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.target_port = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.target_prefix = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.target_protocol = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.trace_flags = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.use_chap_auth = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.volume_clear = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.volume_clear_size = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] QuobyteHD.volumes_dir = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_messaging_rabbit.ssl = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_messaging_notifications.driver = [] {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_messaging_notifications.retry = -1 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] key_manager.fixed_key = **** {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] barbican.barbican_api_version = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] barbican.barbican_endpoint = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] barbican.barbican_endpoint_type = public {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] barbican.barbican_region_name = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] barbican.cafile = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] barbican.certfile = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] barbican.collect_timing = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] barbican.insecure = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] barbican.keyfile = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] barbican.number_of_retries = 60 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] barbican.retry_delay = 1 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] barbican.send_service_user_token = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] barbican.split_loggers = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] barbican.timeout = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] barbican.verify_ssl = True {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] barbican.verify_ssl_path = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] barbican_service_user.auth_section = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] barbican_service_user.auth_type = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] barbican_service_user.cafile = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] barbican_service_user.certfile = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] barbican_service_user.collect_timing = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] barbican_service_user.insecure = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] barbican_service_user.keyfile = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] barbican_service_user.split_loggers = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] barbican_service_user.timeout = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] vault.approle_role_id = **** {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] vault.approle_secret_id = **** {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] vault.kv_mountpoint = secret {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] vault.kv_path = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] vault.kv_version = 2 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] vault.namespace = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] vault.root_token_id = **** {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] vault.ssl_ca_crt_file = None {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] vault.timeout = 60.0 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] vault.use_ssl = False {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:02 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] ******************************************************************************** {{(pid=86215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 07 08:11:03 devstack sudo[86438]: pam_unix(sudo:session): session closed for user root Jul 07 08:11:03 devstack cinder-volume[86432]: DEBUG oslo_concurrency.processutils [None req-31a2fe1b-25b2-4547-ada2-03e922e136e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.770s {{(pid=86432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:11:03 devstack cinder-volume[86432]: INFO cinder.volume.drivers.quobyte [None req-31a2fe1b-25b2-4547-ada2-03e922e136e3 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b succeeded Jul 07 08:11:03 devstack cinder-volume[86432]: DEBUG cinder.volume.drivers.quobyte [None req-31a2fe1b-25b2-4547-ada2-03e922e136e3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=86432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:11:03 devstack cinder-volume[86432]: DEBUG oslo_concurrency.lockutils [None req-31a2fe1b-25b2-4547-ada2-03e922e136e3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.782s {{(pid=86432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:11:03 devstack cinder-volume[86432]: DEBUG oslo_concurrency.processutils [None req-31a2fe1b-25b2-4547-ada2-03e922e136e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=86432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:11:03 devstack sudo[86507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:11:03 devstack sudo[86507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:11:04 devstack sudo[86507]: pam_unix(sudo:session): session closed for user root Jul 07 08:11:04 devstack cinder-volume[86432]: DEBUG oslo_concurrency.processutils [None req-31a2fe1b-25b2-4547-ada2-03e922e136e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.600s {{(pid=86432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:11:04 devstack cinder-volume[86432]: INFO cinder.volume.driver [None req-31a2fe1b-25b2-4547-ada2-03e922e136e3 None None] Driver hasn't implemented _init_vendor_properties() Jul 07 08:11:04 devstack cinder-volume[86432]: DEBUG cinder.volume.driver [None req-31a2fe1b-25b2-4547-ada2-03e922e136e3 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.75777053833, 'free_capacity_gb': 1775.75777053833, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86432) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 07 08:11:04 devstack cinder-volume[86432]: DEBUG oslo_db.sqlalchemy.engines [None req-31a2fe1b-25b2-4547-ada2-03e922e136e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86432) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 08:11:04 devstack cinder-volume[86432]: DEBUG dbcounter [-] [86432] Writer thread running {{(pid=86432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 08:11:04 devstack cinder-volume[86432]: DEBUG cinder.db.api [None req-31a2fe1b-25b2-4547-ada2-03e922e136e3 None None] Building query based on filter {{(pid=86432) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 07 08:11:04 devstack cinder-volume[86432]: DEBUG cinder.image.image_utils [None req-31a2fe1b-25b2-4547-ada2-03e922e136e3 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86432) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 07 08:11:04 devstack cinder-volume[86432]: INFO cinder.keymgr.migration [None req-fef6b38d-0c3a-4637-93dc-630f2d05fc51 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 07 08:11:04 devstack cinder-volume[86432]: DEBUG oslo_concurrency.lockutils [None req-31a2fe1b-25b2-4547-ada2-03e922e136e3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:11:04 devstack cinder-volume[86432]: DEBUG oslo_concurrency.lockutils [None req-31a2fe1b-25b2-4547-ada2-03e922e136e3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:11:04 devstack cinder-volume[86432]: DEBUG cinder.volume.drivers.quobyte [None req-31a2fe1b-25b2-4547-ada2-03e922e136e3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=86432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:11:04 devstack cinder-volume[86432]: DEBUG cinder.volume.drivers.quobyte [None req-31a2fe1b-25b2-4547-ada2-03e922e136e3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=86432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:11:04 devstack cinder-volume[86432]: DEBUG oslo_concurrency.lockutils [None req-31a2fe1b-25b2-4547-ada2-03e922e136e3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:11:04 devstack cinder-volume[86432]: DEBUG oslo_concurrency.processutils [None req-31a2fe1b-25b2-4547-ada2-03e922e136e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=86432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:11:04 devstack sudo[86510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:11:04 devstack sudo[86510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:11:04 devstack sudo[86510]: pam_unix(sudo:session): session closed for user root Jul 07 08:11:04 devstack cinder-volume[86432]: DEBUG oslo_concurrency.processutils [None req-31a2fe1b-25b2-4547-ada2-03e922e136e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.635s {{(pid=86432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:11:04 devstack cinder-volume[86432]: DEBUG cinder.manager [None req-31a2fe1b-25b2-4547-ada2-03e922e136e3 None None] Notifying Schedulers of capabilities ... {{(pid=86432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:11:04 devstack cinder-volume[86432]: INFO cinder.volume.manager [None req-31a2fe1b-25b2-4547-ada2-03e922e136e3 None None] Driver initialization completed successfully. Jul 07 08:11:04 devstack cinder-volume[86432]: INFO cinder.manager [None req-31a2fe1b-25b2-4547-ada2-03e922e136e3 None None] Initiating service 3 cleanup Jul 07 08:11:04 devstack cinder-volume[86432]: INFO cinder.manager [None req-31a2fe1b-25b2-4547-ada2-03e922e136e3 None None] Service 3 cleanup completed. Jul 07 08:11:04 devstack cinder-volume[86432]: DEBUG cinder.service [None req-31a2fe1b-25b2-4547-ada2-03e922e136e3 None None] Creating RPC server for service cinder-volume {{(pid=86432) start /opt/stack/cinder/cinder/service.py:231}} Jul 07 08:11:04 devstack cinder-volume[86432]: DEBUG cinder.service [None req-31a2fe1b-25b2-4547-ada2-03e922e136e3 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86432) start /opt/stack/cinder/cinder/service.py:237}} Jul 07 08:11:04 devstack cinder-volume[86432]: INFO cinder.volume.manager [None req-31a2fe1b-25b2-4547-ada2-03e922e136e3 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 07 08:11:04 devstack cinder-volume[86432]: DEBUG oslo_concurrency.lockutils [None req-31a2fe1b-25b2-4547-ada2-03e922e136e3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:11:04 devstack cinder-volume[86432]: DEBUG oslo_concurrency.lockutils [None req-31a2fe1b-25b2-4547-ada2-03e922e136e3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:11:04 devstack cinder-volume[86432]: DEBUG cinder.volume.drivers.quobyte [None req-31a2fe1b-25b2-4547-ada2-03e922e136e3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=86432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:11:04 devstack cinder-volume[86432]: DEBUG cinder.volume.drivers.quobyte [None req-31a2fe1b-25b2-4547-ada2-03e922e136e3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=86432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:11:04 devstack cinder-volume[86432]: DEBUG oslo_concurrency.lockutils [None req-31a2fe1b-25b2-4547-ada2-03e922e136e3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:11:04 devstack cinder-volume[86432]: DEBUG oslo_concurrency.processutils [None req-31a2fe1b-25b2-4547-ada2-03e922e136e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=86432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:11:05 devstack sudo[86517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:11:05 devstack sudo[86517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:11:05 devstack sudo[86517]: pam_unix(sudo:session): session closed for user root Jul 07 08:11:05 devstack cinder-volume[86432]: DEBUG oslo_concurrency.processutils [None req-31a2fe1b-25b2-4547-ada2-03e922e136e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.703s {{(pid=86432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:11:05 devstack cinder-volume[86432]: INFO cinder.volume.manager [None req-31a2fe1b-25b2-4547-ada2-03e922e136e3 None None] Driver post RPC initialization completed successfully. Jul 07 08:11:09 devstack cinder-volume[86432]: DEBUG oslo_concurrency.lockutils [None req-ea62454f-033b-4dbb-853b-87954528aa88 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:11:09 devstack cinder-volume[86432]: DEBUG oslo_concurrency.lockutils [None req-ea62454f-033b-4dbb-853b-87954528aa88 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:11:09 devstack cinder-volume[86432]: DEBUG cinder.volume.drivers.quobyte [None req-ea62454f-033b-4dbb-853b-87954528aa88 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=86432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:11:09 devstack cinder-volume[86432]: DEBUG cinder.volume.drivers.quobyte [None req-ea62454f-033b-4dbb-853b-87954528aa88 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=86432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:11:09 devstack cinder-volume[86432]: DEBUG oslo_concurrency.lockutils [None req-ea62454f-033b-4dbb-853b-87954528aa88 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:11:09 devstack cinder-volume[86432]: DEBUG oslo_concurrency.processutils [None req-ea62454f-033b-4dbb-853b-87954528aa88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=86432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:11:09 devstack sudo[86656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:11:09 devstack sudo[86656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:11:10 devstack sudo[86656]: pam_unix(sudo:session): session closed for user root Jul 07 08:11:10 devstack cinder-volume[86432]: DEBUG oslo_concurrency.processutils [None req-ea62454f-033b-4dbb-853b-87954528aa88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.602s {{(pid=86432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:11:10 devstack cinder-volume[86432]: DEBUG cinder.manager [None req-ea62454f-033b-4dbb-853b-87954528aa88 None None] Notifying Schedulers of capabilities ... {{(pid=86432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:11:12 devstack cinder-volume[86215]: INFO oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] Caught SIGTERM, stopping children Jul 07 08:11:12 devstack cinder-volume[86215]: DEBUG oslo_concurrency.lockutils [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] Acquiring lock "singleton_lock" {{(pid=86215) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 08:11:12 devstack cinder-volume[86215]: DEBUG oslo_concurrency.lockutils [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] Acquired lock "singleton_lock" {{(pid=86215) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 08:11:12 devstack cinder-volume[86215]: DEBUG oslo_concurrency.lockutils [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] Releasing lock "singleton_lock" {{(pid=86215) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 08:11:12 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] Stop services. {{(pid=86215) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 07 08:11:12 devstack cinder-volume[86215]: DEBUG oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] Killing children. {{(pid=86215) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 07 08:11:12 devstack cinder-volume[86215]: INFO oslo_service.backend._eventlet.service [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] Waiting on 1 children to exit Jul 07 08:11:14 devstack cinder-volume[86432]: DEBUG dbcounter [-] [86432] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:11:15 devstack cinder-volume[86432]: DEBUG dbcounter [-] [86432] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=86432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:11:17 devstack cinder-volume[86432]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jul 07 08:11:17 devstack cinder-volume[86863]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 07 08:11:17 devstack cinder-volume[86863]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 08:11:17 devstack cinder-volume[86863]: we strongly recommend against using it for new projects. Jul 07 08:11:17 devstack cinder-volume[86863]: If you are already using Eventlet, we recommend migrating to a different Jul 07 08:11:17 devstack cinder-volume[86863]: framework. For more detail see Jul 07 08:11:17 devstack cinder-volume[86863]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 08:11:17 devstack cinder-volume[86863]: import eventlet # noqa Jul 07 08:11:18 devstack cinder-volume[86432]: DEBUG oslo_concurrency.lockutils [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] Acquiring lock "singleton_lock" {{(pid=86432) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 08:11:18 devstack cinder-volume[86432]: DEBUG oslo_concurrency.lockutils [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] Acquired lock "singleton_lock" {{(pid=86432) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 08:11:18 devstack cinder-volume[86432]: DEBUG oslo_concurrency.lockutils [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] Releasing lock "singleton_lock" {{(pid=86432) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 08:11:18 devstack cinder-volume[86432]: WARNING amqp [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 07 08:11:18 devstack cinder-volume[86432]: WARNING amqp [None req-fbe80713-5713-4341-b22b-062d0f254787 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 07 08:11:20 devstack cinder-volume[86863]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86863) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 08:11:20 devstack cinder-volume[86863]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86863) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 08:11:20 devstack cinder-volume[86863]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86863) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 08:11:20 devstack cinder-volume[86863]: INFO dbcounter [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] Registered counter for database cinder Jul 07 08:11:20 devstack cinder-volume[86863]: DEBUG oslo_db.sqlalchemy.engines [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86863) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG dbcounter [-] [86863] Writer thread running {{(pid=86863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 08:11:21 devstack cinder-volume[86863]: INFO cinder.rpc [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 07 08:11:21 devstack cinder-volume[86863]: INFO cinder.rpc [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_db.sqlalchemy.engines [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86863) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 08:11:21 devstack cinder-volume[86863]: INFO cinder.volume.manager [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] Determined volume DB was empty at startup. Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG cinder.volume.manager [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86863) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 07 08:11:21 devstack cinder-volume[86863]: WARNING stevedore.named [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 07 08:11:21 devstack cinder-volume[86863]: WARNING castellan.key_manager [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 08:11:21 devstack cinder-volume[86863]: WARNING cinder.keymgr.conf_key_mgr [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 08:11:21 devstack cinder-volume[86863]: INFO cinder.volume.manager [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_db.sqlalchemy.engines [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86863) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 08:11:21 devstack cinder-volume[86863]: INFO oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] Starting 1 workers Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] Started child 87199 {{(pid=86863) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] Full set of CONF: {{(pid=86863) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] ******************************************************************************** {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] Configuration options gathered from: {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] ================================================================================ {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] allow_availability_zone_fallback = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] allow_compression_on_image_upload = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] allowed_direct_url_schemes = [] {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] api_rate_limit = True {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] auth_strategy = keystone {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_availability_zone = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_host = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[87199]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_name = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_stats_polling_interval = 60 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backup_api_class = cinder.backup.api.API {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backup_name_template = backup-%s {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backup_use_same_host = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backup_use_temp_snapshot = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] chap_password = **** {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] chap_username = {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] cinder_internal_tenant_project_id = c7452aec47ae4951978a86ec4cb6433a {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] cinder_internal_tenant_user_id = 418637987e2940508a39ddc4a48c01ef {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] cluster = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] compression_format = gzip {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] compute_api_class = cinder.compute.nova.API {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] config_dir = [] {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] config_source = [] {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] control_exchange = openstack {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] debug = True {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] default_availability_zone = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] default_group_type = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] default_volume_type = QuobyteHD {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] disk_geometry = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] driver_client_cert = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] driver_client_cert_key = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] driver_data_namespace = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] driver_ssl_cert_path = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] driver_ssl_cert_verify = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] driver_use_ssl = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] enable_new_services = True {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] enable_unsupported_driver = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] enabled_backends = ['QuobyteHD'] {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] enforce_multipath_for_image_xfer = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] filter_function = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] glance_api_insecure = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] glance_api_servers = ['http://192.168.122.148/image'] {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] glance_api_ssl_compression = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] glance_ca_certificates_file = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] glance_catalog_info = image:glance:publicURL {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] glance_certfile = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] glance_keyfile = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] glance_num_retries = 3 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] glance_request_timeout = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] goodness_function = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] graceful_shutdown_timeout = 5 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] group_api_class = cinder.group.api.API {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] host = devstack {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] image_compress_on_upload = True {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] image_conversion_address_space_limit = 1 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] image_conversion_cpu_limit = 60 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] image_conversion_disable = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] image_upload_use_cinder_backend = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] image_upload_use_internal_tenant = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] image_volume_cache_enabled = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] image_volume_cache_max_count = 0 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] image_volume_cache_max_size_gb = 0 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] init_host_max_objects_retrieval = 0 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] instance_format = [instance: %(uuid)s] {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] iscsi_target_flags = {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] iscsi_write_cache = on {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] iser_helper = tgtadm {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] iser_ip_address = 192.168.122.148 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] iser_port = 3260 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] log_color = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] log_config_append = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] log_dir = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] log_file = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] log_options = True {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] log_rotate_interval = 1 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] log_rotate_interval_type = days {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] log_rotation_type = none {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] max_age = 0 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] max_logfile_count = 30 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] max_logfile_size_mb = 200 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] max_over_subscription_ratio = 20.0 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] message_reap_interval = 86400 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] message_ttl = 2592000 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] migration_create_volume_timeout_secs = 300 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] monkey_patch = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] monkey_patch_modules = [] {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] my_ip = 192.168.122.148 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] no_snapshot_gb_quota = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] num_iser_scan_tries = 3 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-6d72e599-2469-4928-8834-f39c6d5dfc15 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] num_shell_tries = 3 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-6d72e599-2469-4928-8834-f39c6d5dfc15 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87199) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] num_volume_device_scan_tries = 3 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] nvmeof_conn_info_version = 1 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] nvmet_ns_id = 10 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] nvmet_port_id = 1 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] osapi_max_limit = 1000 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] osapi_volume_ext_list = [] {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] osapi_volume_listen = 0.0.0.0 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] osapi_volume_listen_port = 8776 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] osapi_volume_use_ssl = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] osapi_volume_workers = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] per_volume_size_limit = -1 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] periodic_fuzzy_delay = 60 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] periodic_interval = 60 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] project_id_regex = [0-9a-f\-]+ {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] public_endpoint = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] publish_errors = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] quota_backup_gigabytes = 1000 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] quota_backups = 10 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] quota_gigabytes = 1000 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] quota_groups = 10 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] quota_snapshots = 10 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] quota_volumes = 10 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] rate_limit_burst = 0 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] rate_limit_except_level = CRITICAL {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] rate_limit_interval = 0 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] reinit_driver_count = 3 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] replication_device = **** {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] report_discard_supported = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] report_interval = 120 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] reservation_clean_interval = 86400 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] reservation_expire = 86400 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] reserved_image_namespaces = [] {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] reserved_percentage = 0 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] rpc_response_timeout = 120 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] run_external_periodic_tasks = True {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] scst_target_driver = iscsi {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] scst_target_iqn_name = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] service_down_time = 720 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] shell_completion = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] snapshot_name_template = snapshot-%s {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] split_loggers = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] state_path = /opt/stack/data/cinder {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] storage_availability_zone = nova {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] storage_protocol = iSCSI {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] syslog_log_facility = LOG_USER {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] target_helper = lioadm {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] target_ip_address = 192.168.122.148 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] target_port = 3260 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] target_protocol = iscsi {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] target_secondary_ip_addresses = [] {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] trace_flags = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] transfer_api_class = cinder.transfer.api.API {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] transport_url = **** {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] until_refresh = 0 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] use_chap_auth = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] use_default_quota_class = True {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] use_journal = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] use_json = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] use_multipath_for_image_xfer = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] use_stderr = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] use_syslog = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] verify_glance_signatures = enabled {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] volume_api_class = cinder.volume.api.API {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] volume_backend_name = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] volume_clear = zero {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] volume_clear_ionice = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] volume_clear_size = 0 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] volume_copy_bps_limit = 0 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] volume_dd_blocksize = 1M {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] volume_name_template = volume-%s {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] volume_service_inithost_offload = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] volume_usage_audit_period = month {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] zoning_mode = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_concurrency.disable_process_locking = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] keystone_authtoken.auth_section = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] keystone_authtoken.auth_type = password {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] keystone_authtoken.auth_version = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] keystone_authtoken.cache = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] keystone_authtoken.certfile = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] keystone_authtoken.delay_auth_decision = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] keystone_authtoken.http_connect_timeout = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] keystone_authtoken.include_service_catalog = True {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] keystone_authtoken.insecure = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] keystone_authtoken.interface = public {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] keystone_authtoken.keyfile = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] keystone_authtoken.memcache_password = {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] keystone_authtoken.memcache_username = {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] keystone_authtoken.region_name = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] keystone_authtoken.service_token_roles_required = True {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] keystone_authtoken.service_type = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] keystone_authtoken.token_cache_time = 300 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.148/identity {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] cache.backend = dogpile.cache.null {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] cache.backend_argument = **** {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] cache.backend_expiration_time = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] cache.config_prefix = cache.oslo {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] cache.debug_cache_backend = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] cache.enable_retry_client = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] cache.enable_socket_keepalive = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] cache.enabled = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] cache.expiration_time = 600 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] cache.hashclient_retry_attempts = 2 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] cache.memcache_dead_retry = 300 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] cache.memcache_pool_maxsize = 10 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] cache.memcache_sasl_enabled = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] cache.password = **** {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] cache.proxies = [] {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] cache.redis_db = 0 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] cache.redis_sentinel_service_name = mymaster {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] cache.redis_server = localhost:6379 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] cache.retry_attempts = 2 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] cache.retry_delay = 0.0 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] cache.socket_keepalive_count = 1 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] cache.socket_keepalive_idle = 1 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] cache.socket_keepalive_interval = 1 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] cache.socket_timeout = 1.0 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] cache.tls_allowed_ciphers = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] cache.tls_cafile = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] cache.tls_certfile = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] cache.tls_enabled = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] cache.tls_keyfile = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] cache.username = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] coordination.backend_url = **** {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] database.asyncio_connection = **** {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] database.asyncio_slave_connection = **** {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] database.backend = sqlalchemy {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] database.connection = **** {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] database.connection_debug = 0 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] database.connection_parameters = {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] database.connection_recycle_time = 3600 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] database.connection_trace = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] database.db_inc_retry_interval = True {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] database.db_max_retries = 20 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] database.db_max_retry_interval = 10 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] database.db_retry_interval = 1 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] database.max_overflow = 50 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] database.max_pool_size = 5 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] database.max_retries = 10 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] database.mysql_wsrep_sync_wait = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] database.pool_timeout = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] database.retry_interval = 10 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] database.slave_connection = **** {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] database.sqlite_synchronous = True {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] database.synchronous_reader = True {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] database.use_db_reconnect = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] profiler.connection_string = messaging:// {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] profiler.enabled = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] profiler.es_doc_type = notification {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] profiler.es_scroll_size = 10000 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] profiler.es_scroll_time = 2m {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] profiler.filter_error_trace = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6d72e599-2469-4928-8834-f39c6d5dfc15 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87199) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 07 08:11:21 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.quobyte [None req-6d72e599-2469-4928-8834-f39c6d5dfc15 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 07 08:11:21 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.quobyte [None req-6d72e599-2469-4928-8834-f39c6d5dfc15 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] profiler.hmac_keys = **** {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] profiler.sentinel_service_name = mymaster {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] profiler.socket_timeout = 0.1 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] profiler.trace_requests = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6d72e599-2469-4928-8834-f39c6d5dfc15 None None] Running cmd (subprocess): mount.quobyte {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] profiler.trace_sqlalchemy = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] profiler_jaeger.process_tags = {} {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] profiler_jaeger.service_name_prefix = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] profiler_otlp.service_name_prefix = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_policy.enforce_new_defaults = True {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_policy.enforce_scope = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_policy.policy_default_rule = default {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_policy.policy_file = policy.yaml {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_policy.remote_timeout = 60.0 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] privsep_osbrick.group = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] privsep_osbrick.helper_command = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] privsep_osbrick.user = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] cinder_sys_admin.group = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] cinder_sys_admin.helper_command = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] cinder_sys_admin.user = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] service_user.auth_section = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] service_user.auth_type = password {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] service_user.cafile = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] service_user.certfile = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] service_user.collect_timing = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] service_user.insecure = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] service_user.keyfile = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] service_user.send_service_user_token = True {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] service_user.split_loggers = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] service_user.timeout = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] glance.auth_section = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] glance.auth_type = password {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] glance.certfile = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] glance.collect_timing = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] glance.insecure = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] glance.keyfile = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] glance.region_name = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] glance.split_loggers = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] glance.timeout = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.backend_availability_zone = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.chap_password = **** {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.chap_username = {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.disk_geometry = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.driver_client_cert = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.driver_client_cert_key = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.driver_data_namespace = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.driver_use_ssl = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.enable_unsupported_driver = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.extra_capabilities = {} {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.filter_function = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.goodness_function = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.iscsi_target_flags = {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.iscsi_write_cache = on {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.iser_helper = tgtadm {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.iser_ip_address = 192.168.122.148 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.iser_port = 3260 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.nas_host = {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.nas_login = admin {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.nas_mount_options = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.nas_password = **** {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.nas_private_key = {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.nas_share_path = {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.nas_ssh_port = 22 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.num_shell_tries = 3 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.nvmet_port_id = 1 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.quobyte_client_cfg = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.quobyte_volume_url = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.replication_device = **** {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.report_discard_supported = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.reserved_percentage = 0 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.scst_target_driver = iscsi {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.scst_target_iqn_name = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.storage_protocol = iSCSI {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.target_helper = tgtadm {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.target_ip_address = 192.168.122.148 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.target_port = 3260 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.target_protocol = iscsi {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.trace_flags = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.unique_fqdn_network = True {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.use_chap_auth = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.volume_backend_name = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.volume_clear = zero {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.volume_clear_ionice = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.volume_clear_size = 0 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_reports.file_event_handler = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_reports.log_dir = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.backend_availability_zone = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.backend_host = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.chap_password = **** {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.chap_username = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.chiscsi_conf = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.disk_geometry = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.driver_client_cert = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.driver_client_cert_key = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.driver_data_namespace = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.driver_use_ssl = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.extra_capabilities = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.filter_function = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.goodness_function = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.iscsi_target_flags = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.iscsi_write_cache = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.iser_helper = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.iser_ip_address = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.iser_port = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.iser_target_prefix = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.nas_host = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.nas_login = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.nas_mount_options = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.nas_password = **** {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.nas_private_key = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.nas_share_path = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack quobyte-client[87203]: Reading configuration file: /etc/quobyte/client.cfg Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.nas_ssh_port = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack quobyte-client[87203]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.num_shell_tries = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.nvmet_ns_id = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.nvmet_port_id = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6d72e599-2469-4928-8834-f39c6d5dfc15 None None] CMD "mount.quobyte" returned: 1 in 0.064s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6d72e599-2469-4928-8834-f39c6d5dfc15 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.replication_device = **** {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.report_discard_supported = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6d72e599-2469-4928-8834-f39c6d5dfc15 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.reserved_percentage = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6d72e599-2469-4928-8834-f39c6d5dfc15 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.scst_target_driver = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.storage_protocol = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.target_helper = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.target_ip_address = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.target_port = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.target_prefix = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.target_protocol = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.trace_flags = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.unique_fqdn_network = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.use_chap_auth = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.volume_clear = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.volume_clear_ionice = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.volume_clear_size = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6d72e599-2469-4928-8834-f39c6d5dfc15 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6d72e599-2469-4928-8834-f39c6d5dfc15 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6d72e599-2469-4928-8834-f39c6d5dfc15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] QuobyteHD.volumes_dir = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_messaging_rabbit.ssl = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_messaging_rabbit.ssl_version = {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_messaging_notifications.driver = [] {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_messaging_notifications.retry = -1 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] oslo_messaging_notifications.transport_url = **** {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] key_manager.fixed_key = **** {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] barbican.barbican_api_version = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] barbican.barbican_endpoint = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] barbican.barbican_endpoint_type = public {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] barbican.barbican_region_name = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] barbican.cafile = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] barbican.certfile = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] barbican.collect_timing = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] barbican.insecure = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] barbican.keyfile = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] barbican.number_of_retries = 60 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] barbican.retry_delay = 1 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] barbican.send_service_user_token = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] barbican.split_loggers = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] barbican.timeout = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] barbican.verify_ssl = True {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] barbican.verify_ssl_path = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] barbican_service_user.auth_section = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] barbican_service_user.auth_type = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] barbican_service_user.cafile = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] barbican_service_user.certfile = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] barbican_service_user.collect_timing = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] barbican_service_user.insecure = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] barbican_service_user.keyfile = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] barbican_service_user.split_loggers = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] barbican_service_user.timeout = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] vault.approle_role_id = **** {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] vault.approle_secret_id = **** {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] vault.kv_mountpoint = secret {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack sudo[87204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] vault.kv_path = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] vault.kv_version = 2 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] vault.namespace = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack sudo[87204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] vault.root_token_id = **** {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] vault.ssl_ca_crt_file = None {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] vault.timeout = 60.0 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] vault.use_ssl = False {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:21 devstack cinder-volume[86863]: DEBUG oslo_service.backend._eventlet.service [None req-315a79b9-0188-4dc0-b15e-dfd8231be39b None None] ******************************************************************************** {{(pid=86863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 07 08:11:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6d72e599-2469-4928-8834-f39c6d5dfc15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.729s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:11:22 devstack cinder-volume[87199]: INFO cinder.volume.driver [None req-6d72e599-2469-4928-8834-f39c6d5dfc15 None None] Driver hasn't implemented _init_vendor_properties() Jul 07 08:11:22 devstack cinder-volume[87199]: DEBUG cinder.volume.driver [None req-6d72e599-2469-4928-8834-f39c6d5dfc15 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.75777053833, 'free_capacity_gb': 1775.75777053833, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87199) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 07 08:11:22 devstack sudo[87204]: pam_unix(sudo:session): session closed for user root Jul 07 08:11:22 devstack cinder-volume[87199]: DEBUG oslo_db.sqlalchemy.engines [None req-6d72e599-2469-4928-8834-f39c6d5dfc15 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87199) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 08:11:22 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writer thread running {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 08:11:22 devstack cinder-volume[87199]: DEBUG cinder.db.api [None req-6d72e599-2469-4928-8834-f39c6d5dfc15 None None] Building query based on filter {{(pid=87199) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 07 08:11:22 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-6d72e599-2469-4928-8834-f39c6d5dfc15 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87199) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 07 08:11:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6d72e599-2469-4928-8834-f39c6d5dfc15 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:11:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6d72e599-2469-4928-8834-f39c6d5dfc15 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:11:22 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6d72e599-2469-4928-8834-f39c6d5dfc15 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:11:22 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6d72e599-2469-4928-8834-f39c6d5dfc15 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:11:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6d72e599-2469-4928-8834-f39c6d5dfc15 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:11:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6d72e599-2469-4928-8834-f39c6d5dfc15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:11:22 devstack cinder-volume[87199]: INFO cinder.keymgr.migration [None req-8145a511-838c-4962-9548-63dd0bb8fd26 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 07 08:11:22 devstack sudo[87212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:11:22 devstack sudo[87212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:11:23 devstack sudo[87212]: pam_unix(sudo:session): session closed for user root Jul 07 08:11:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6d72e599-2469-4928-8834-f39c6d5dfc15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.631s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:11:23 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-6d72e599-2469-4928-8834-f39c6d5dfc15 None None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:11:23 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-6d72e599-2469-4928-8834-f39c6d5dfc15 None None] Driver initialization completed successfully. Jul 07 08:11:23 devstack cinder-volume[87199]: INFO cinder.manager [None req-6d72e599-2469-4928-8834-f39c6d5dfc15 None None] Initiating service 3 cleanup Jul 07 08:11:23 devstack cinder-volume[87199]: INFO cinder.manager [None req-6d72e599-2469-4928-8834-f39c6d5dfc15 None None] Service 3 cleanup completed. Jul 07 08:11:23 devstack cinder-volume[87199]: DEBUG cinder.service [None req-6d72e599-2469-4928-8834-f39c6d5dfc15 None None] Creating RPC server for service cinder-volume {{(pid=87199) start /opt/stack/cinder/cinder/service.py:231}} Jul 07 08:11:23 devstack cinder-volume[87199]: DEBUG cinder.service [None req-6d72e599-2469-4928-8834-f39c6d5dfc15 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87199) start /opt/stack/cinder/cinder/service.py:237}} Jul 07 08:11:23 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-6d72e599-2469-4928-8834-f39c6d5dfc15 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 07 08:11:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6d72e599-2469-4928-8834-f39c6d5dfc15 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:11:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6d72e599-2469-4928-8834-f39c6d5dfc15 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:11:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6d72e599-2469-4928-8834-f39c6d5dfc15 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:11:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6d72e599-2469-4928-8834-f39c6d5dfc15 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:11:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6d72e599-2469-4928-8834-f39c6d5dfc15 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:11:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6d72e599-2469-4928-8834-f39c6d5dfc15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:11:23 devstack sudo[87218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:11:23 devstack sudo[87218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:11:23 devstack sudo[87218]: pam_unix(sudo:session): session closed for user root Jul 07 08:11:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6d72e599-2469-4928-8834-f39c6d5dfc15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.618s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:11:23 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-6d72e599-2469-4928-8834-f39c6d5dfc15 None None] Driver post RPC initialization completed successfully. Jul 07 08:11:31 devstack cinder-volume[86863]: DEBUG dbcounter [-] [86863] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:11:33 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=1 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:11:33 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:12:05 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running periodic task VolumeManager._thread_info {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:12:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] thread count: 6 {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 08:12:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] thread info: [<_MainThread(MainThread, started 133056092332160)>, , , , , ] {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 08:12:54 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-c63765de-3e2d-485a-9b76-9bcdd28b5932 tempest-VolumesAdminNegativeTest-100810025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:12:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c63765de-3e2d-485a-9b76-9bcdd28b5932 tempest-VolumesAdminNegativeTest-100810025 None] Flow 'volume_create_manager' (0500dca8-f159-4901-8a65-8a2ca6779344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:12:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c63765de-3e2d-485a-9b76-9bcdd28b5932 tempest-VolumesAdminNegativeTest-100810025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76c7c788-02fc-4c46-934b-0232e38297ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:12:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c63765de-3e2d-485a-9b76-9bcdd28b5932 tempest-VolumesAdminNegativeTest-100810025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76c7c788-02fc-4c46-934b-0232e38297ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:12:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1548475159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=210ead72-ab53-4be0-9402-820ffdc6db06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='246fa747acd84392b581f9c510bb3979',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:12:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:12:54Z,use_quota=True,user_id='a20dbda9e64349a2bf6a8d0b6e6c3565',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:12:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c63765de-3e2d-485a-9b76-9bcdd28b5932 tempest-VolumesAdminNegativeTest-100810025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd73587e-5e37-4dbb-b53d-f5fe69a5e113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:12:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c63765de-3e2d-485a-9b76-9bcdd28b5932 tempest-VolumesAdminNegativeTest-100810025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd73587e-5e37-4dbb-b53d-f5fe69a5e113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:12:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c63765de-3e2d-485a-9b76-9bcdd28b5932 tempest-VolumesAdminNegativeTest-100810025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f87c4d0a-fe52-4d8a-b5d5-fb05589e9089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:12:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c63765de-3e2d-485a-9b76-9bcdd28b5932 tempest-VolumesAdminNegativeTest-100810025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f87c4d0a-fe52-4d8a-b5d5-fb05589e9089) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '210ead72-ab53-4be0-9402-820ffdc6db06', 'volume_name': 'volume-210ead72-ab53-4be0-9402-820ffdc6db06', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:12:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c63765de-3e2d-485a-9b76-9bcdd28b5932 tempest-VolumesAdminNegativeTest-100810025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6690972-188d-4b17-a336-a0bf2d06a4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:12:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c63765de-3e2d-485a-9b76-9bcdd28b5932 tempest-VolumesAdminNegativeTest-100810025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6690972-188d-4b17-a336-a0bf2d06a4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:12:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c63765de-3e2d-485a-9b76-9bcdd28b5932 tempest-VolumesAdminNegativeTest-100810025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b86fd64-b798-45f6-9f3e-0094ec250022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:12:54 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-c63765de-3e2d-485a-9b76-9bcdd28b5932 tempest-VolumesAdminNegativeTest-100810025 None] Volume 210ead72-ab53-4be0-9402-820ffdc6db06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-210ead72-ab53-4be0-9402-820ffdc6db06', 'volume_size': 1} Jul 07 08:12:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c63765de-3e2d-485a-9b76-9bcdd28b5932 tempest-VolumesAdminNegativeTest-100810025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:12:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c63765de-3e2d-485a-9b76-9bcdd28b5932 tempest-VolumesAdminNegativeTest-100810025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:12:54 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c63765de-3e2d-485a-9b76-9bcdd28b5932 tempest-VolumesAdminNegativeTest-100810025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:12:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1548475159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=210ead72-ab53-4be0-9402-820ffdc6db06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='246fa747acd84392b581f9c510bb3979',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:12:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:12:54Z,use_quota=True,user_id='a20dbda9e64349a2bf6a8d0b6e6c3565',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:12:54 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-c63765de-3e2d-485a-9b76-9bcdd28b5932 tempest-VolumesAdminNegativeTest-100810025 None] Creating volume 210ead72-ab53-4be0-9402-820ffdc6db06 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:12:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c63765de-3e2d-485a-9b76-9bcdd28b5932 tempest-VolumesAdminNegativeTest-100810025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:12:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c63765de-3e2d-485a-9b76-9bcdd28b5932 tempest-VolumesAdminNegativeTest-100810025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:12:54 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c63765de-3e2d-485a-9b76-9bcdd28b5932 tempest-VolumesAdminNegativeTest-100810025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:12:54 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c63765de-3e2d-485a-9b76-9bcdd28b5932 tempest-VolumesAdminNegativeTest-100810025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:12:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c63765de-3e2d-485a-9b76-9bcdd28b5932 tempest-VolumesAdminNegativeTest-100810025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:12:54 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c63765de-3e2d-485a-9b76-9bcdd28b5932 tempest-VolumesAdminNegativeTest-100810025 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:12:54 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-c63765de-3e2d-485a-9b76-9bcdd28b5932 tempest-VolumesAdminNegativeTest-100810025 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:12:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c63765de-3e2d-485a-9b76-9bcdd28b5932 tempest-VolumesAdminNegativeTest-100810025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-210ead72-ab53-4be0-9402-820ffdc6db06 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:12:54 devstack sudo[87876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-210ead72-ab53-4be0-9402-820ffdc6db06 1073741824 Jul 07 08:12:54 devstack sudo[87876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:12:55 devstack sudo[87876]: pam_unix(sudo:session): session closed for user root Jul 07 08:12:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c63765de-3e2d-485a-9b76-9bcdd28b5932 tempest-VolumesAdminNegativeTest-100810025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-210ead72-ab53-4be0-9402-820ffdc6db06 1073741824" returned: 0 in 1.133s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:12:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c63765de-3e2d-485a-9b76-9bcdd28b5932 tempest-VolumesAdminNegativeTest-100810025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-210ead72-ab53-4be0-9402-820ffdc6db06 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:12:55 devstack sudo[88195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-210ead72-ab53-4be0-9402-820ffdc6db06 Jul 07 08:12:55 devstack sudo[88195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:12:56 devstack sudo[88195]: pam_unix(sudo:session): session closed for user root Jul 07 08:12:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c63765de-3e2d-485a-9b76-9bcdd28b5932 tempest-VolumesAdminNegativeTest-100810025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-210ead72-ab53-4be0-9402-820ffdc6db06" returned: 0 in 0.781s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:12:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c63765de-3e2d-485a-9b76-9bcdd28b5932 tempest-VolumesAdminNegativeTest-100810025 None] <== create_volume: return (1996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:12:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c63765de-3e2d-485a-9b76-9bcdd28b5932 tempest-VolumesAdminNegativeTest-100810025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:12:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c63765de-3e2d-485a-9b76-9bcdd28b5932 tempest-VolumesAdminNegativeTest-100810025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b86fd64-b798-45f6-9f3e-0094ec250022) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-210ead72-ab53-4be0-9402-820ffdc6db06', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:12:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c63765de-3e2d-485a-9b76-9bcdd28b5932 tempest-VolumesAdminNegativeTest-100810025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ada4a8a5-c9c1-435a-b324-cbacf7253d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:12:56 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-c63765de-3e2d-485a-9b76-9bcdd28b5932 tempest-VolumesAdminNegativeTest-100810025 None] Volume volume-210ead72-ab53-4be0-9402-820ffdc6db06 (210ead72-ab53-4be0-9402-820ffdc6db06): created successfully Jul 07 08:12:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c63765de-3e2d-485a-9b76-9bcdd28b5932 tempest-VolumesAdminNegativeTest-100810025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ada4a8a5-c9c1-435a-b324-cbacf7253d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:12:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c63765de-3e2d-485a-9b76-9bcdd28b5932 tempest-VolumesAdminNegativeTest-100810025 None] Flow 'volume_create_manager' (0500dca8-f159-4901-8a65-8a2ca6779344) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:12:56 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-c63765de-3e2d-485a-9b76-9bcdd28b5932 tempest-VolumesAdminNegativeTest-100810025 None] Created volume successfully. Jul 07 08:12:57 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-68c9dd77-9f8a-4325-b12d-a972d93bbd19 tempest-VolumesAdminNegativeTest-100810025 None] Acquiring lock "cinder-210ead72-ab53-4be0-9402-820ffdc6db06-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:12:57 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-68c9dd77-9f8a-4325-b12d-a972d93bbd19 tempest-VolumesAdminNegativeTest-100810025 None] Lock "cinder-210ead72-ab53-4be0-9402-820ffdc6db06-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:12:58 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-68c9dd77-9f8a-4325-b12d-a972d93bbd19 tempest-VolumesAdminNegativeTest-100810025 None] Acquiring lock "cinder-quobyte-210ead72-ab53-4be0-9402-820ffdc6db06" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:12:58 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-68c9dd77-9f8a-4325-b12d-a972d93bbd19 tempest-VolumesAdminNegativeTest-100810025 None] Lock "cinder-quobyte-210ead72-ab53-4be0-9402-820ffdc6db06" acquired by "delete_volume" :: waited 0.019s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:12:58 devstack cinder-volume[87199]: INFO oslo.privsep.daemon [None req-68c9dd77-9f8a-4325-b12d-a972d93bbd19 tempest-VolumesAdminNegativeTest-100810025 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpfpl0vrlg/privsep.sock'] Jul 07 08:12:58 devstack sudo[88199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpfpl0vrlg/privsep.sock Jul 07 08:12:58 devstack sudo[88199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:12:58 devstack cinder-volume[87199]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 07 08:12:58 devstack cinder-volume[87199]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 08:12:58 devstack cinder-volume[87199]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 07 08:12:58 devstack cinder-volume[87199]: WARNING oslo.privsep.daemon [-] privsep log: Jul 07 08:12:58 devstack cinder-volume[87199]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 07 08:12:58 devstack cinder-volume[87199]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 07 08:12:58 devstack cinder-volume[87199]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 08:12:58 devstack cinder-volume[87199]: WARNING oslo.privsep.daemon [-] privsep log: Jul 07 08:12:58 devstack cinder-volume[87199]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 07 08:12:59 devstack cinder-volume[87199]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 07 08:12:59 devstack cinder-volume[87199]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 08:12:59 devstack cinder-volume[87199]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 07 08:12:59 devstack cinder-volume[87199]: WARNING oslo.privsep.daemon [-] privsep log: Jul 07 08:12:59 devstack cinder-volume[87199]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 07 08:12:59 devstack cinder-volume[87199]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 07 08:12:59 devstack cinder-volume[87199]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 08:12:59 devstack cinder-volume[87199]: WARNING oslo.privsep.daemon [-] privsep log: Jul 07 08:12:59 devstack cinder-volume[87199]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 07 08:12:59 devstack sudo[88199]: pam_unix(sudo:session): session closed for user root Jul 07 08:12:59 devstack cinder-volume[87199]: INFO oslo.privsep.daemon [None req-68c9dd77-9f8a-4325-b12d-a972d93bbd19 tempest-VolumesAdminNegativeTest-100810025 None] Spawned new privsep daemon via rootwrap Jul 07 08:12:59 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [None req-68c9dd77-9f8a-4325-b12d-a972d93bbd19 tempest-VolumesAdminNegativeTest-100810025 None] Accepted privsep connection to /tmp/tmpfpl0vrlg/privsep.sock {{(pid=87199) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 07 08:12:59 devstack cinder-volume[87199]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 07 08:12:59 devstack cinder-volume[87199]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 07 08:12:59 devstack cinder-volume[87199]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 07 08:12:59 devstack cinder-volume[87199]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88203 Jul 07 08:12:59 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8d851b-e1a0-48be-a580-66b7025669f6]: (2,) {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:12:59 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0b4c31-a140-4b3b-b6a5-ea89183ab914]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:12:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-68c9dd77-9f8a-4325-b12d-a972d93bbd19 tempest-VolumesAdminNegativeTest-100810025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-210ead72-ab53-4be0-9402-820ffdc6db06 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:12:59 devstack sudo[88205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-210ead72-ab53-4be0-9402-820ffdc6db06 Jul 07 08:12:59 devstack sudo[88205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:13:00 devstack sudo[88205]: pam_unix(sudo:session): session closed for user root Jul 07 08:13:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-68c9dd77-9f8a-4325-b12d-a972d93bbd19 tempest-VolumesAdminNegativeTest-100810025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-210ead72-ab53-4be0-9402-820ffdc6db06" returned: 0 in 0.822s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:13:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-68c9dd77-9f8a-4325-b12d-a972d93bbd19 tempest-VolumesAdminNegativeTest-100810025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-210ead72-ab53-4be0-9402-820ffdc6db06 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:13:00 devstack sudo[88212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-210ead72-ab53-4be0-9402-820ffdc6db06 Jul 07 08:13:00 devstack sudo[88212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:13:01 devstack sudo[88212]: pam_unix(sudo:session): session closed for user root Jul 07 08:13:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-68c9dd77-9f8a-4325-b12d-a972d93bbd19 tempest-VolumesAdminNegativeTest-100810025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-210ead72-ab53-4be0-9402-820ffdc6db06" returned: 0 in 1.227s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:13:01 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-68c9dd77-9f8a-4325-b12d-a972d93bbd19 tempest-VolumesAdminNegativeTest-100810025 None] Lock "cinder-quobyte-210ead72-ab53-4be0-9402-820ffdc6db06" released by "delete_volume" :: held 3.827s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:13:01 devstack cinder-volume[87199]: WARNING cinder.quota [None req-68c9dd77-9f8a-4325-b12d-a972d93bbd19 tempest-VolumesAdminNegativeTest-100810025 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:13:01 devstack cinder-volume[87199]: WARNING cinder.quota [None req-68c9dd77-9f8a-4325-b12d-a972d93bbd19 tempest-VolumesAdminNegativeTest-100810025 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:13:02 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-68c9dd77-9f8a-4325-b12d-a972d93bbd19 tempest-VolumesAdminNegativeTest-100810025 None] Created reservations ['54a520a9-1754-4cde-af8d-8afd49e0f7e2', '9be34824-77b5-4aee-bbd9-b0433aeb4209', 'ae367839-4290-4fbe-b48b-c96b1b764dae', 'aba1fb11-c8e4-4eaa-97b6-444a2f5cc49b'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:13:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-68c9dd77-9f8a-4325-b12d-a972d93bbd19 tempest-VolumesAdminNegativeTest-100810025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:13:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-68c9dd77-9f8a-4325-b12d-a972d93bbd19 tempest-VolumesAdminNegativeTest-100810025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:13:02 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-68c9dd77-9f8a-4325-b12d-a972d93bbd19 tempest-VolumesAdminNegativeTest-100810025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:13:02 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-68c9dd77-9f8a-4325-b12d-a972d93bbd19 tempest-VolumesAdminNegativeTest-100810025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:13:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-68c9dd77-9f8a-4325-b12d-a972d93bbd19 tempest-VolumesAdminNegativeTest-100810025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:13:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-68c9dd77-9f8a-4325-b12d-a972d93bbd19 tempest-VolumesAdminNegativeTest-100810025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:13:02 devstack sudo[88219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:13:02 devstack sudo[88219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:13:03 devstack sudo[88219]: pam_unix(sudo:session): session closed for user root Jul 07 08:13:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-68c9dd77-9f8a-4325-b12d-a972d93bbd19 tempest-VolumesAdminNegativeTest-100810025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 1.400s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:13:03 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-68c9dd77-9f8a-4325-b12d-a972d93bbd19 tempest-VolumesAdminNegativeTest-100810025 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:13:03 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-68c9dd77-9f8a-4325-b12d-a972d93bbd19 tempest-VolumesAdminNegativeTest-100810025 None] Deleted volume successfully. Jul 07 08:13:03 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-68c9dd77-9f8a-4325-b12d-a972d93bbd19 tempest-VolumesAdminNegativeTest-100810025 None] Lock "cinder-210ead72-ab53-4be0-9402-820ffdc6db06-delete_volume" released by "delete_volume" :: held 5.734s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:13:05 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:13:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:13:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:13:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:13:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:13:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:13:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:13:05 devstack sudo[88246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:13:05 devstack sudo[88246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:13:06 devstack sudo[88246]: pam_unix(sudo:session): session closed for user root Jul 07 08:13:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.942s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:13:06 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:13:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running periodic task VolumeManager._thread_info {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:13:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] thread count: 8 {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 08:13:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] thread info: [<_MainThread(MainThread, started 133056092332160)>, , , , , , , ] {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 08:13:07 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dc9aeff-f077-49c0-816a-39e337ddbc54 tempest-AttachVolumeNegativeTest-328651626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:13:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2dc9aeff-f077-49c0-816a-39e337ddbc54 tempest-AttachVolumeNegativeTest-328651626 None] Flow 'volume_create_manager' (6db92435-dead-4f4b-bba3-12b770580871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:13:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2dc9aeff-f077-49c0-816a-39e337ddbc54 tempest-AttachVolumeNegativeTest-328651626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f01bf9f0-d858-4da1-9135-8bd1fd056f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:13:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2dc9aeff-f077-49c0-816a-39e337ddbc54 tempest-AttachVolumeNegativeTest-328651626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f01bf9f0-d858-4da1-9135-8bd1fd056f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:13:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1172415488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb73b43b-a8ea-4b8a-8af6-6cbf80a64688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3444540d904f436ea41d3b0f1e7efb46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:13:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:13:07Z,use_quota=True,user_id='c39c7aaf7a1347d3b8d2396e3041b4b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:13:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2dc9aeff-f077-49c0-816a-39e337ddbc54 tempest-AttachVolumeNegativeTest-328651626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21e50d95-13f2-49a0-9071-994f1be4769c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:13:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2dc9aeff-f077-49c0-816a-39e337ddbc54 tempest-AttachVolumeNegativeTest-328651626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21e50d95-13f2-49a0-9071-994f1be4769c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:13:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2dc9aeff-f077-49c0-816a-39e337ddbc54 tempest-AttachVolumeNegativeTest-328651626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4931037e-7074-4699-9800-41b393664d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:13:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2dc9aeff-f077-49c0-816a-39e337ddbc54 tempest-AttachVolumeNegativeTest-328651626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4931037e-7074-4699-9800-41b393664d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb73b43b-a8ea-4b8a-8af6-6cbf80a64688', 'volume_name': 'volume-cb73b43b-a8ea-4b8a-8af6-6cbf80a64688', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:13:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2dc9aeff-f077-49c0-816a-39e337ddbc54 tempest-AttachVolumeNegativeTest-328651626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55c4cb8a-16c8-42ae-aa80-d85b8366957f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:13:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2dc9aeff-f077-49c0-816a-39e337ddbc54 tempest-AttachVolumeNegativeTest-328651626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55c4cb8a-16c8-42ae-aa80-d85b8366957f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:13:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2dc9aeff-f077-49c0-816a-39e337ddbc54 tempest-AttachVolumeNegativeTest-328651626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c44c4595-1e24-41c4-a7b3-0eda44b38299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:13:07 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-2dc9aeff-f077-49c0-816a-39e337ddbc54 tempest-AttachVolumeNegativeTest-328651626 None] Volume cb73b43b-a8ea-4b8a-8af6-6cbf80a64688: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb73b43b-a8ea-4b8a-8af6-6cbf80a64688', 'volume_size': 1} Jul 07 08:13:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-2dc9aeff-f077-49c0-816a-39e337ddbc54 tempest-AttachVolumeNegativeTest-328651626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:13:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-2dc9aeff-f077-49c0-816a-39e337ddbc54 tempest-AttachVolumeNegativeTest-328651626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:13:07 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-2dc9aeff-f077-49c0-816a-39e337ddbc54 tempest-AttachVolumeNegativeTest-328651626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:13:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1172415488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb73b43b-a8ea-4b8a-8af6-6cbf80a64688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3444540d904f436ea41d3b0f1e7efb46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:13:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:13:07Z,use_quota=True,user_id='c39c7aaf7a1347d3b8d2396e3041b4b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:13:07 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-2dc9aeff-f077-49c0-816a-39e337ddbc54 tempest-AttachVolumeNegativeTest-328651626 None] Creating volume cb73b43b-a8ea-4b8a-8af6-6cbf80a64688 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:13:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-2dc9aeff-f077-49c0-816a-39e337ddbc54 tempest-AttachVolumeNegativeTest-328651626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:13:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-2dc9aeff-f077-49c0-816a-39e337ddbc54 tempest-AttachVolumeNegativeTest-328651626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:13:07 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-2dc9aeff-f077-49c0-816a-39e337ddbc54 tempest-AttachVolumeNegativeTest-328651626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:13:07 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-2dc9aeff-f077-49c0-816a-39e337ddbc54 tempest-AttachVolumeNegativeTest-328651626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:13:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-2dc9aeff-f077-49c0-816a-39e337ddbc54 tempest-AttachVolumeNegativeTest-328651626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:13:07 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-2dc9aeff-f077-49c0-816a-39e337ddbc54 tempest-AttachVolumeNegativeTest-328651626 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:13:07 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-2dc9aeff-f077-49c0-816a-39e337ddbc54 tempest-AttachVolumeNegativeTest-328651626 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:13:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-2dc9aeff-f077-49c0-816a-39e337ddbc54 tempest-AttachVolumeNegativeTest-328651626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cb73b43b-a8ea-4b8a-8af6-6cbf80a64688 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:13:07 devstack sudo[88253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cb73b43b-a8ea-4b8a-8af6-6cbf80a64688 1073741824 Jul 07 08:13:07 devstack sudo[88253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:13:08 devstack sudo[88253]: pam_unix(sudo:session): session closed for user root Jul 07 08:13:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-2dc9aeff-f077-49c0-816a-39e337ddbc54 tempest-AttachVolumeNegativeTest-328651626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cb73b43b-a8ea-4b8a-8af6-6cbf80a64688 1073741824" returned: 0 in 1.198s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:13:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-2dc9aeff-f077-49c0-816a-39e337ddbc54 tempest-AttachVolumeNegativeTest-328651626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cb73b43b-a8ea-4b8a-8af6-6cbf80a64688 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:13:08 devstack sudo[88260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cb73b43b-a8ea-4b8a-8af6-6cbf80a64688 Jul 07 08:13:08 devstack sudo[88260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:13:09 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-9120cc34-857d-4270-b14e-15240f0ec5e5 tempest-ServerActionsTestOtherA-1077245219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:13:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-9120cc34-857d-4270-b14e-15240f0ec5e5 tempest-ServerActionsTestOtherA-1077245219 None] Flow 'volume_create_manager' (4f6c7aa1-dd18-4744-a849-74ed5d3227fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:13:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-9120cc34-857d-4270-b14e-15240f0ec5e5 tempest-ServerActionsTestOtherA-1077245219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ba9e664-59fa-4e1e-8e18-ce7c475db0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:13:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-9120cc34-857d-4270-b14e-15240f0ec5e5 tempest-ServerActionsTestOtherA-1077245219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ba9e664-59fa-4e1e-8e18-ce7c475db0a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-712591262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ee22943-c515-4fc1-8216-44d5acb54cac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba242122d0784605afdee8cac0ef9d65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:13:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:13:09Z,use_quota=True,user_id='f3ba53f58a3d4bd28fecea03440b25e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:13:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-9120cc34-857d-4270-b14e-15240f0ec5e5 tempest-ServerActionsTestOtherA-1077245219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd9dedc3-94c1-433c-a9eb-e6bc552760d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:13:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-9120cc34-857d-4270-b14e-15240f0ec5e5 tempest-ServerActionsTestOtherA-1077245219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd9dedc3-94c1-433c-a9eb-e6bc552760d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:13:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-9120cc34-857d-4270-b14e-15240f0ec5e5 tempest-ServerActionsTestOtherA-1077245219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a494d9c7-8c5e-4e59-ba85-20f208b13f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:13:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-9120cc34-857d-4270-b14e-15240f0ec5e5 tempest-ServerActionsTestOtherA-1077245219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a494d9c7-8c5e-4e59-ba85-20f208b13f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ee22943-c515-4fc1-8216-44d5acb54cac', 'volume_name': 'volume-6ee22943-c515-4fc1-8216-44d5acb54cac', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:13:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-9120cc34-857d-4270-b14e-15240f0ec5e5 tempest-ServerActionsTestOtherA-1077245219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0fa31c7-ea84-4f08-bb33-a4b6e654338e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:13:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-9120cc34-857d-4270-b14e-15240f0ec5e5 tempest-ServerActionsTestOtherA-1077245219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0fa31c7-ea84-4f08-bb33-a4b6e654338e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:13:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-9120cc34-857d-4270-b14e-15240f0ec5e5 tempest-ServerActionsTestOtherA-1077245219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (994dec97-ac5f-4c44-82e6-cd8fab3e6f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:13:09 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-9120cc34-857d-4270-b14e-15240f0ec5e5 tempest-ServerActionsTestOtherA-1077245219 None] Volume 6ee22943-c515-4fc1-8216-44d5acb54cac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ee22943-c515-4fc1-8216-44d5acb54cac', 'volume_size': 1} Jul 07 08:13:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9120cc34-857d-4270-b14e-15240f0ec5e5 tempest-ServerActionsTestOtherA-1077245219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:13:09 devstack sudo[88260]: pam_unix(sudo:session): session closed for user root Jul 07 08:13:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-2dc9aeff-f077-49c0-816a-39e337ddbc54 tempest-AttachVolumeNegativeTest-328651626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cb73b43b-a8ea-4b8a-8af6-6cbf80a64688" returned: 0 in 0.970s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:13:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-2dc9aeff-f077-49c0-816a-39e337ddbc54 tempest-AttachVolumeNegativeTest-328651626 None] <== create_volume: return (2249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:13:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-2dc9aeff-f077-49c0-816a-39e337ddbc54 tempest-AttachVolumeNegativeTest-328651626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.252s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:13:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9120cc34-857d-4270-b14e-15240f0ec5e5 tempest-ServerActionsTestOtherA-1077245219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.246s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:13:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-9120cc34-857d-4270-b14e-15240f0ec5e5 tempest-ServerActionsTestOtherA-1077245219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-712591262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ee22943-c515-4fc1-8216-44d5acb54cac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba242122d0784605afdee8cac0ef9d65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:13:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:13:09Z,use_quota=True,user_id='f3ba53f58a3d4bd28fecea03440b25e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:13:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-9120cc34-857d-4270-b14e-15240f0ec5e5 tempest-ServerActionsTestOtherA-1077245219 None] Creating volume 6ee22943-c515-4fc1-8216-44d5acb54cac {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:13:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9120cc34-857d-4270-b14e-15240f0ec5e5 tempest-ServerActionsTestOtherA-1077245219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:13:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9120cc34-857d-4270-b14e-15240f0ec5e5 tempest-ServerActionsTestOtherA-1077245219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:13:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-9120cc34-857d-4270-b14e-15240f0ec5e5 tempest-ServerActionsTestOtherA-1077245219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:13:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-9120cc34-857d-4270-b14e-15240f0ec5e5 tempest-ServerActionsTestOtherA-1077245219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:13:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9120cc34-857d-4270-b14e-15240f0ec5e5 tempest-ServerActionsTestOtherA-1077245219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:13:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-9120cc34-857d-4270-b14e-15240f0ec5e5 tempest-ServerActionsTestOtherA-1077245219 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:13:09 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-9120cc34-857d-4270-b14e-15240f0ec5e5 tempest-ServerActionsTestOtherA-1077245219 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:13:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9120cc34-857d-4270-b14e-15240f0ec5e5 tempest-ServerActionsTestOtherA-1077245219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6ee22943-c515-4fc1-8216-44d5acb54cac 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:13:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2dc9aeff-f077-49c0-816a-39e337ddbc54 tempest-AttachVolumeNegativeTest-328651626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c44c4595-1e24-41c4-a7b3-0eda44b38299) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb73b43b-a8ea-4b8a-8af6-6cbf80a64688', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:13:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2dc9aeff-f077-49c0-816a-39e337ddbc54 tempest-AttachVolumeNegativeTest-328651626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36057c7e-de02-438e-8c1e-b0e1855aa443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:13:09 devstack sudo[88264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6ee22943-c515-4fc1-8216-44d5acb54cac 1073741824 Jul 07 08:13:09 devstack sudo[88264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:13:09 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-2dc9aeff-f077-49c0-816a-39e337ddbc54 tempest-AttachVolumeNegativeTest-328651626 None] Volume volume-cb73b43b-a8ea-4b8a-8af6-6cbf80a64688 (cb73b43b-a8ea-4b8a-8af6-6cbf80a64688): created successfully Jul 07 08:13:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2dc9aeff-f077-49c0-816a-39e337ddbc54 tempest-AttachVolumeNegativeTest-328651626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36057c7e-de02-438e-8c1e-b0e1855aa443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:13:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2dc9aeff-f077-49c0-816a-39e337ddbc54 tempest-AttachVolumeNegativeTest-328651626 None] Flow 'volume_create_manager' (6db92435-dead-4f4b-bba3-12b770580871) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:13:09 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-2dc9aeff-f077-49c0-816a-39e337ddbc54 tempest-AttachVolumeNegativeTest-328651626 None] Created volume successfully. Jul 07 08:13:10 devstack sudo[88264]: pam_unix(sudo:session): session closed for user root Jul 07 08:13:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9120cc34-857d-4270-b14e-15240f0ec5e5 tempest-ServerActionsTestOtherA-1077245219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6ee22943-c515-4fc1-8216-44d5acb54cac 1073741824" returned: 0 in 1.075s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:13:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9120cc34-857d-4270-b14e-15240f0ec5e5 tempest-ServerActionsTestOtherA-1077245219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6ee22943-c515-4fc1-8216-44d5acb54cac {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:13:10 devstack sudo[88271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6ee22943-c515-4fc1-8216-44d5acb54cac Jul 07 08:13:10 devstack sudo[88271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:13:11 devstack sudo[88271]: pam_unix(sudo:session): session closed for user root Jul 07 08:13:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9120cc34-857d-4270-b14e-15240f0ec5e5 tempest-ServerActionsTestOtherA-1077245219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6ee22943-c515-4fc1-8216-44d5acb54cac" returned: 0 in 0.823s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:13:11 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-9120cc34-857d-4270-b14e-15240f0ec5e5 tempest-ServerActionsTestOtherA-1077245219 None] <== create_volume: return (1960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:13:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9120cc34-857d-4270-b14e-15240f0ec5e5 tempest-ServerActionsTestOtherA-1077245219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.963s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:13:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-9120cc34-857d-4270-b14e-15240f0ec5e5 tempest-ServerActionsTestOtherA-1077245219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (994dec97-ac5f-4c44-82e6-cd8fab3e6f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ee22943-c515-4fc1-8216-44d5acb54cac', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:13:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-9120cc34-857d-4270-b14e-15240f0ec5e5 tempest-ServerActionsTestOtherA-1077245219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e307021-694d-4993-b7fe-c84585cb47f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:13:11 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-9120cc34-857d-4270-b14e-15240f0ec5e5 tempest-ServerActionsTestOtherA-1077245219 None] Volume volume-6ee22943-c515-4fc1-8216-44d5acb54cac (6ee22943-c515-4fc1-8216-44d5acb54cac): created successfully Jul 07 08:13:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-9120cc34-857d-4270-b14e-15240f0ec5e5 tempest-ServerActionsTestOtherA-1077245219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e307021-694d-4993-b7fe-c84585cb47f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:13:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-9120cc34-857d-4270-b14e-15240f0ec5e5 tempest-ServerActionsTestOtherA-1077245219 None] Flow 'volume_create_manager' (4f6c7aa1-dd18-4744-a849-74ed5d3227fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:13:11 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-9120cc34-857d-4270-b14e-15240f0ec5e5 tempest-ServerActionsTestOtherA-1077245219 None] Created volume successfully. Jul 07 08:13:16 devstack cinder-volume[87199]: WARNING py.warnings [req-ce9969e2-97cb-4020-a1bf-a1ed57c5b625 req-6cbd3098-41a8-4f67-9418-4cfddb189d8d tempest-AttachVolumeNegativeTest-328651626 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Jul 07 08:13:16 devstack cinder-volume[87199]: .first() Jul 07 08:13:16 devstack cinder-volume[87199]: Jul 07 08:13:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-ce9969e2-97cb-4020-a1bf-a1ed57c5b625 req-6cbd3098-41a8-4f67-9418-4cfddb189d8d tempest-AttachVolumeNegativeTest-328651626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:13:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-ce9969e2-97cb-4020-a1bf-a1ed57c5b625 req-6cbd3098-41a8-4f67-9418-4cfddb189d8d tempest-AttachVolumeNegativeTest-328651626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:13:16 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[db73b53b-0d99-4053-aa52-1d050a300031]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:13:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-ce9969e2-97cb-4020-a1bf-a1ed57c5b625 req-6cbd3098-41a8-4f67-9418-4cfddb189d8d tempest-AttachVolumeNegativeTest-328651626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cb73b43b-a8ea-4b8a-8af6-6cbf80a64688 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:13:16 devstack sudo[88298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cb73b43b-a8ea-4b8a-8af6-6cbf80a64688 Jul 07 08:13:16 devstack sudo[88298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:13:17 devstack sudo[88298]: pam_unix(sudo:session): session closed for user root Jul 07 08:13:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-ce9969e2-97cb-4020-a1bf-a1ed57c5b625 req-6cbd3098-41a8-4f67-9418-4cfddb189d8d tempest-AttachVolumeNegativeTest-328651626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cb73b43b-a8ea-4b8a-8af6-6cbf80a64688" returned: 0 in 1.142s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:13:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-ce9969e2-97cb-4020-a1bf-a1ed57c5b625 req-6cbd3098-41a8-4f67-9418-4cfddb189d8d tempest-AttachVolumeNegativeTest-328651626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.163s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:13:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-ce9969e2-97cb-4020-a1bf-a1ed57c5b625 req-6cbd3098-41a8-4f67-9418-4cfddb189d8d tempest-AttachVolumeNegativeTest-328651626 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b', 'name': 'volume-cb73b43b-a8ea-4b8a-8af6-6cbf80a64688', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1723a514-c82e-4cda-b831-d63c88003fd0', 'enforce_multipath': True} {{(pid=87199) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 08:13:17 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-ce9969e2-97cb-4020-a1bf-a1ed57c5b625 req-6cbd3098-41a8-4f67-9418-4cfddb189d8d tempest-AttachVolumeNegativeTest-328651626 None] attachment_update completed successfully. Jul 07 08:13:18 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-4df07414-fd17-4386-a2ae-c11af4db88bb tempest-TaggedAttachmentsTest-841350389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:13:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4df07414-fd17-4386-a2ae-c11af4db88bb tempest-TaggedAttachmentsTest-841350389 None] Flow 'volume_create_manager' (083ce2c4-f039-42c0-9448-47220ba7db73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:13:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4df07414-fd17-4386-a2ae-c11af4db88bb tempest-TaggedAttachmentsTest-841350389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1f03e6a-dc5f-4997-9481-76911ed1ff93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:13:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4df07414-fd17-4386-a2ae-c11af4db88bb tempest-TaggedAttachmentsTest-841350389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1f03e6a-dc5f-4997-9481-76911ed1ff93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-957182963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=802ae173-7b87-410e-b6cd-29369003d874,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23b034a02e1045d1842a17b874a499ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:13:18Z,use_quota=True,user_id='41ddf7371ee14cef854472df321006d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:13:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4df07414-fd17-4386-a2ae-c11af4db88bb tempest-TaggedAttachmentsTest-841350389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9dc52cf-637e-46e7-9c61-542208f954db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:13:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4df07414-fd17-4386-a2ae-c11af4db88bb tempest-TaggedAttachmentsTest-841350389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9dc52cf-637e-46e7-9c61-542208f954db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:13:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4df07414-fd17-4386-a2ae-c11af4db88bb tempest-TaggedAttachmentsTest-841350389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5cae585-2a5b-480e-9d1b-016cbe07eae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:13:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4df07414-fd17-4386-a2ae-c11af4db88bb tempest-TaggedAttachmentsTest-841350389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5cae585-2a5b-480e-9d1b-016cbe07eae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '802ae173-7b87-410e-b6cd-29369003d874', 'volume_name': 'volume-802ae173-7b87-410e-b6cd-29369003d874', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:13:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4df07414-fd17-4386-a2ae-c11af4db88bb tempest-TaggedAttachmentsTest-841350389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20234f28-0405-474b-881e-49c6a9440d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:13:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4df07414-fd17-4386-a2ae-c11af4db88bb tempest-TaggedAttachmentsTest-841350389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20234f28-0405-474b-881e-49c6a9440d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:13:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4df07414-fd17-4386-a2ae-c11af4db88bb tempest-TaggedAttachmentsTest-841350389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaf572ae-4364-4fb5-a7d4-cedc2a64bcf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:13:18 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-4df07414-fd17-4386-a2ae-c11af4db88bb tempest-TaggedAttachmentsTest-841350389 None] Volume 802ae173-7b87-410e-b6cd-29369003d874: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-802ae173-7b87-410e-b6cd-29369003d874', 'volume_size': 1} Jul 07 08:13:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4df07414-fd17-4386-a2ae-c11af4db88bb tempest-TaggedAttachmentsTest-841350389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:13:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4df07414-fd17-4386-a2ae-c11af4db88bb tempest-TaggedAttachmentsTest-841350389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:13:18 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4df07414-fd17-4386-a2ae-c11af4db88bb tempest-TaggedAttachmentsTest-841350389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-957182963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=802ae173-7b87-410e-b6cd-29369003d874,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23b034a02e1045d1842a17b874a499ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:13:18Z,use_quota=True,user_id='41ddf7371ee14cef854472df321006d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:13:18 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-4df07414-fd17-4386-a2ae-c11af4db88bb tempest-TaggedAttachmentsTest-841350389 None] Creating volume 802ae173-7b87-410e-b6cd-29369003d874 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:13:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4df07414-fd17-4386-a2ae-c11af4db88bb tempest-TaggedAttachmentsTest-841350389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:13:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4df07414-fd17-4386-a2ae-c11af4db88bb tempest-TaggedAttachmentsTest-841350389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:13:18 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4df07414-fd17-4386-a2ae-c11af4db88bb tempest-TaggedAttachmentsTest-841350389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:13:18 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4df07414-fd17-4386-a2ae-c11af4db88bb tempest-TaggedAttachmentsTest-841350389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:13:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4df07414-fd17-4386-a2ae-c11af4db88bb tempest-TaggedAttachmentsTest-841350389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:13:18 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4df07414-fd17-4386-a2ae-c11af4db88bb tempest-TaggedAttachmentsTest-841350389 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:13:18 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-4df07414-fd17-4386-a2ae-c11af4db88bb tempest-TaggedAttachmentsTest-841350389 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:13:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4df07414-fd17-4386-a2ae-c11af4db88bb tempest-TaggedAttachmentsTest-841350389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-802ae173-7b87-410e-b6cd-29369003d874 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:13:18 devstack sudo[88378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-802ae173-7b87-410e-b6cd-29369003d874 1073741824 Jul 07 08:13:18 devstack sudo[88378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:13:19 devstack sudo[88378]: pam_unix(sudo:session): session closed for user root Jul 07 08:13:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4df07414-fd17-4386-a2ae-c11af4db88bb tempest-TaggedAttachmentsTest-841350389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-802ae173-7b87-410e-b6cd-29369003d874 1073741824" returned: 0 in 1.003s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:13:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4df07414-fd17-4386-a2ae-c11af4db88bb tempest-TaggedAttachmentsTest-841350389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-802ae173-7b87-410e-b6cd-29369003d874 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:13:19 devstack sudo[88701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-802ae173-7b87-410e-b6cd-29369003d874 Jul 07 08:13:19 devstack sudo[88701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:13:20 devstack sudo[88701]: pam_unix(sudo:session): session closed for user root Jul 07 08:13:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4df07414-fd17-4386-a2ae-c11af4db88bb tempest-TaggedAttachmentsTest-841350389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-802ae173-7b87-410e-b6cd-29369003d874" returned: 0 in 0.655s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:13:20 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4df07414-fd17-4386-a2ae-c11af4db88bb tempest-TaggedAttachmentsTest-841350389 None] <== create_volume: return (1699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:13:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4df07414-fd17-4386-a2ae-c11af4db88bb tempest-TaggedAttachmentsTest-841350389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.702s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:13:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4df07414-fd17-4386-a2ae-c11af4db88bb tempest-TaggedAttachmentsTest-841350389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaf572ae-4364-4fb5-a7d4-cedc2a64bcf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-802ae173-7b87-410e-b6cd-29369003d874', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:13:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4df07414-fd17-4386-a2ae-c11af4db88bb tempest-TaggedAttachmentsTest-841350389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5a9d934-30e3-4754-be5f-8dc31b390b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:13:20 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-4df07414-fd17-4386-a2ae-c11af4db88bb tempest-TaggedAttachmentsTest-841350389 None] Volume volume-802ae173-7b87-410e-b6cd-29369003d874 (802ae173-7b87-410e-b6cd-29369003d874): created successfully Jul 07 08:13:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4df07414-fd17-4386-a2ae-c11af4db88bb tempest-TaggedAttachmentsTest-841350389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5a9d934-30e3-4754-be5f-8dc31b390b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:13:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4df07414-fd17-4386-a2ae-c11af4db88bb tempest-TaggedAttachmentsTest-841350389 None] Flow 'volume_create_manager' (083ce2c4-f039-42c0-9448-47220ba7db73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:13:20 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-4df07414-fd17-4386-a2ae-c11af4db88bb tempest-TaggedAttachmentsTest-841350389 None] Created volume successfully. Jul 07 08:13:33 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=21,cinder:UPDATE=23,cinder:DELETE=2,cinder:INSERT=1 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:13:33 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=17,cinder:UPDATE=21,cinder:INSERT=7,cinder:DELETE=3 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:14:03 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d76838e-b7dc-4fe6-a267-e8d88ae4d1ef tempest-DeleteServersTestJSON-305801338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:14:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7d76838e-b7dc-4fe6-a267-e8d88ae4d1ef tempest-DeleteServersTestJSON-305801338 None] Flow 'volume_create_manager' (a36e6444-d007-4af7-a0cc-95095698c1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:14:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7d76838e-b7dc-4fe6-a267-e8d88ae4d1ef tempest-DeleteServersTestJSON-305801338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40351238-7705-4f03-b211-72fff21bef29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:14:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7d76838e-b7dc-4fe6-a267-e8d88ae4d1ef tempest-DeleteServersTestJSON-305801338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40351238-7705-4f03-b211-72fff21bef29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:14:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-716332781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ed4dfc3-f843-43aa-96e7-7b120386c8cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfd8bbcd8ca34dbf83ca247d83d27bf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:14:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:14:03Z,use_quota=True,user_id='d8ce77cd29e5426eaa8630cbb8672a23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:14:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7d76838e-b7dc-4fe6-a267-e8d88ae4d1ef tempest-DeleteServersTestJSON-305801338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b526b8fb-aee1-477d-9ef9-c776d334099f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:14:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7d76838e-b7dc-4fe6-a267-e8d88ae4d1ef tempest-DeleteServersTestJSON-305801338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b526b8fb-aee1-477d-9ef9-c776d334099f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:14:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7d76838e-b7dc-4fe6-a267-e8d88ae4d1ef tempest-DeleteServersTestJSON-305801338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df0d6395-39de-46cc-b359-d63f2eec6bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:14:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7d76838e-b7dc-4fe6-a267-e8d88ae4d1ef tempest-DeleteServersTestJSON-305801338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df0d6395-39de-46cc-b359-d63f2eec6bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ed4dfc3-f843-43aa-96e7-7b120386c8cc', 'volume_name': 'volume-7ed4dfc3-f843-43aa-96e7-7b120386c8cc', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:14:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7d76838e-b7dc-4fe6-a267-e8d88ae4d1ef tempest-DeleteServersTestJSON-305801338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e393b78-07fd-4a85-95d6-cb1ef56a346f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:14:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7d76838e-b7dc-4fe6-a267-e8d88ae4d1ef tempest-DeleteServersTestJSON-305801338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e393b78-07fd-4a85-95d6-cb1ef56a346f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:14:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7d76838e-b7dc-4fe6-a267-e8d88ae4d1ef tempest-DeleteServersTestJSON-305801338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bd8181f-4d24-40bd-85ff-774d25495e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:14:03 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-7d76838e-b7dc-4fe6-a267-e8d88ae4d1ef tempest-DeleteServersTestJSON-305801338 None] Volume 7ed4dfc3-f843-43aa-96e7-7b120386c8cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ed4dfc3-f843-43aa-96e7-7b120386c8cc', 'volume_size': 1} Jul 07 08:14:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7d76838e-b7dc-4fe6-a267-e8d88ae4d1ef tempest-DeleteServersTestJSON-305801338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:14:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7d76838e-b7dc-4fe6-a267-e8d88ae4d1ef tempest-DeleteServersTestJSON-305801338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:14:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-7d76838e-b7dc-4fe6-a267-e8d88ae4d1ef tempest-DeleteServersTestJSON-305801338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:14:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-716332781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ed4dfc3-f843-43aa-96e7-7b120386c8cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfd8bbcd8ca34dbf83ca247d83d27bf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:14:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:14:03Z,use_quota=True,user_id='d8ce77cd29e5426eaa8630cbb8672a23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:14:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-7d76838e-b7dc-4fe6-a267-e8d88ae4d1ef tempest-DeleteServersTestJSON-305801338 None] Creating volume 7ed4dfc3-f843-43aa-96e7-7b120386c8cc {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:14:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7d76838e-b7dc-4fe6-a267-e8d88ae4d1ef tempest-DeleteServersTestJSON-305801338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:14:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7d76838e-b7dc-4fe6-a267-e8d88ae4d1ef tempest-DeleteServersTestJSON-305801338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:14:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-7d76838e-b7dc-4fe6-a267-e8d88ae4d1ef tempest-DeleteServersTestJSON-305801338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:14:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-7d76838e-b7dc-4fe6-a267-e8d88ae4d1ef tempest-DeleteServersTestJSON-305801338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:14:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7d76838e-b7dc-4fe6-a267-e8d88ae4d1ef tempest-DeleteServersTestJSON-305801338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:14:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-7d76838e-b7dc-4fe6-a267-e8d88ae4d1ef tempest-DeleteServersTestJSON-305801338 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:14:03 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-7d76838e-b7dc-4fe6-a267-e8d88ae4d1ef tempest-DeleteServersTestJSON-305801338 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:14:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7d76838e-b7dc-4fe6-a267-e8d88ae4d1ef tempest-DeleteServersTestJSON-305801338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7ed4dfc3-f843-43aa-96e7-7b120386c8cc 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:03 devstack sudo[89229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7ed4dfc3-f843-43aa-96e7-7b120386c8cc 1073741824 Jul 07 08:14:03 devstack sudo[89229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-84e5b63f-fabb-4101-9238-a54257cc3eeb req-6b757a8f-fc8a-4307-b668-e89529fe4a41 tempest-ServerActionsTestOtherA-1077245219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:14:04 devstack sudo[89229]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7d76838e-b7dc-4fe6-a267-e8d88ae4d1ef tempest-DeleteServersTestJSON-305801338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7ed4dfc3-f843-43aa-96e7-7b120386c8cc 1073741824" returned: 0 in 0.953s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7d76838e-b7dc-4fe6-a267-e8d88ae4d1ef tempest-DeleteServersTestJSON-305801338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7ed4dfc3-f843-43aa-96e7-7b120386c8cc {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:04 devstack sudo[89237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7ed4dfc3-f843-43aa-96e7-7b120386c8cc Jul 07 08:14:04 devstack sudo[89237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:05 devstack sudo[89237]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7d76838e-b7dc-4fe6-a267-e8d88ae4d1ef tempest-DeleteServersTestJSON-305801338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7ed4dfc3-f843-43aa-96e7-7b120386c8cc" returned: 0 in 0.710s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-7d76838e-b7dc-4fe6-a267-e8d88ae4d1ef tempest-DeleteServersTestJSON-305801338 None] <== create_volume: return (1714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:14:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7d76838e-b7dc-4fe6-a267-e8d88ae4d1ef tempest-DeleteServersTestJSON-305801338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.717s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:14:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-84e5b63f-fabb-4101-9238-a54257cc3eeb req-6b757a8f-fc8a-4307-b668-e89529fe4a41 tempest-ServerActionsTestOtherA-1077245219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.481s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:14:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7d76838e-b7dc-4fe6-a267-e8d88ae4d1ef tempest-DeleteServersTestJSON-305801338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bd8181f-4d24-40bd-85ff-774d25495e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ed4dfc3-f843-43aa-96e7-7b120386c8cc', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:14:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7d76838e-b7dc-4fe6-a267-e8d88ae4d1ef tempest-DeleteServersTestJSON-305801338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4654f84e-dd9e-4660-a444-791f58684881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:14:05 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be8338d-1fea-4277-a806-1cd3d0e019ee]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:14:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-84e5b63f-fabb-4101-9238-a54257cc3eeb req-6b757a8f-fc8a-4307-b668-e89529fe4a41 tempest-ServerActionsTestOtherA-1077245219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6ee22943-c515-4fc1-8216-44d5acb54cac {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:05 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-7d76838e-b7dc-4fe6-a267-e8d88ae4d1ef tempest-DeleteServersTestJSON-305801338 None] Volume volume-7ed4dfc3-f843-43aa-96e7-7b120386c8cc (7ed4dfc3-f843-43aa-96e7-7b120386c8cc): created successfully Jul 07 08:14:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7d76838e-b7dc-4fe6-a267-e8d88ae4d1ef tempest-DeleteServersTestJSON-305801338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4654f84e-dd9e-4660-a444-791f58684881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:14:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7d76838e-b7dc-4fe6-a267-e8d88ae4d1ef tempest-DeleteServersTestJSON-305801338 None] Flow 'volume_create_manager' (a36e6444-d007-4af7-a0cc-95095698c1ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:14:05 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-7d76838e-b7dc-4fe6-a267-e8d88ae4d1ef tempest-DeleteServersTestJSON-305801338 None] Created volume successfully. Jul 07 08:14:05 devstack sudo[89240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6ee22943-c515-4fc1-8216-44d5acb54cac Jul 07 08:14:05 devstack sudo[89240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:05 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:14:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:14:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:14:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:14:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:14:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:14:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:05 devstack sudo[89247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:14:05 devstack sudo[89247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:06 devstack sudo[89240]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-84e5b63f-fabb-4101-9238-a54257cc3eeb req-6b757a8f-fc8a-4307-b668-e89529fe4a41 tempest-ServerActionsTestOtherA-1077245219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6ee22943-c515-4fc1-8216-44d5acb54cac" returned: 0 in 0.946s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-84e5b63f-fabb-4101-9238-a54257cc3eeb req-6b757a8f-fc8a-4307-b668-e89529fe4a41 tempest-ServerActionsTestOtherA-1077245219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.976s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:14:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-84e5b63f-fabb-4101-9238-a54257cc3eeb req-6b757a8f-fc8a-4307-b668-e89529fe4a41 tempest-ServerActionsTestOtherA-1077245219 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b', 'name': 'volume-6ee22943-c515-4fc1-8216-44d5acb54cac', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3b657d69-89ff-438d-9c92-5c77688ac7f3', 'enforce_multipath': True} {{(pid=87199) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 08:14:06 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-84e5b63f-fabb-4101-9238-a54257cc3eeb req-6b757a8f-fc8a-4307-b668-e89529fe4a41 tempest-ServerActionsTestOtherA-1077245219 None] attachment_update completed successfully. Jul 07 08:14:06 devstack sudo[89247]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.938s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:06 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:14:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-74bd8a8f-ab85-4f0b-8b94-979e32005e0c req-13c0ae88-0d43-47ec-a442-44b7fc5cd67d tempest-DeleteServersTestJSON-305801338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:14:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-74bd8a8f-ab85-4f0b-8b94-979e32005e0c req-13c0ae88-0d43-47ec-a442-44b7fc5cd67d tempest-DeleteServersTestJSON-305801338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:14:08 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[4781c7e5-0e87-42ac-a497-7d5466d82978]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:14:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-74bd8a8f-ab85-4f0b-8b94-979e32005e0c req-13c0ae88-0d43-47ec-a442-44b7fc5cd67d tempest-DeleteServersTestJSON-305801338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7ed4dfc3-f843-43aa-96e7-7b120386c8cc {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:08 devstack sudo[89295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7ed4dfc3-f843-43aa-96e7-7b120386c8cc Jul 07 08:14:08 devstack sudo[89295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:09 devstack sudo[89295]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-74bd8a8f-ab85-4f0b-8b94-979e32005e0c req-13c0ae88-0d43-47ec-a442-44b7fc5cd67d tempest-DeleteServersTestJSON-305801338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7ed4dfc3-f843-43aa-96e7-7b120386c8cc" returned: 0 in 0.827s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-74bd8a8f-ab85-4f0b-8b94-979e32005e0c req-13c0ae88-0d43-47ec-a442-44b7fc5cd67d tempest-DeleteServersTestJSON-305801338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.844s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:14:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-74bd8a8f-ab85-4f0b-8b94-979e32005e0c req-13c0ae88-0d43-47ec-a442-44b7fc5cd67d tempest-DeleteServersTestJSON-305801338 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b', 'name': 'volume-7ed4dfc3-f843-43aa-96e7-7b120386c8cc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6c1a3552-3811-46a1-8bde-867b34d2a415', 'enforce_multipath': True} {{(pid=87199) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 08:14:09 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-74bd8a8f-ab85-4f0b-8b94-979e32005e0c req-13c0ae88-0d43-47ec-a442-44b7fc5cd67d tempest-DeleteServersTestJSON-305801338 None] attachment_update completed successfully. Jul 07 08:14:14 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-52296df5-f82a-4449-8695-561ceccae806 req-a6ed97c2-5656-4999-8743-d8111c987f36 tempest-ServerActionsTestOtherA-1077245219 None] Terminate volume connection completed successfully. Jul 07 08:14:14 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-52296df5-f82a-4449-8695-561ceccae806 req-a6ed97c2-5656-4999-8743-d8111c987f36 tempest-ServerActionsTestOtherA-1077245219 None] Deleting attachment 3b657d69-89ff-438d-9c92-5c77688ac7f3. {{(pid=87199) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 08:14:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-52296df5-f82a-4449-8695-561ceccae806 req-1fdd2f3b-12ac-4269-a208-f27c6dea8472 tempest-ServerActionsTestOtherA-1077245219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:14:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-52296df5-f82a-4449-8695-561ceccae806 req-1fdd2f3b-12ac-4269-a208-f27c6dea8472 tempest-ServerActionsTestOtherA-1077245219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:14:17 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0468a0f-4894-4f26-8faf-5e6688451259]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:14:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-52296df5-f82a-4449-8695-561ceccae806 req-1fdd2f3b-12ac-4269-a208-f27c6dea8472 tempest-ServerActionsTestOtherA-1077245219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6ee22943-c515-4fc1-8216-44d5acb54cac {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:17 devstack sudo[89416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6ee22943-c515-4fc1-8216-44d5acb54cac Jul 07 08:14:17 devstack sudo[89416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:18 devstack sudo[89416]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-52296df5-f82a-4449-8695-561ceccae806 req-1fdd2f3b-12ac-4269-a208-f27c6dea8472 tempest-ServerActionsTestOtherA-1077245219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6ee22943-c515-4fc1-8216-44d5acb54cac" returned: 0 in 0.965s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-52296df5-f82a-4449-8695-561ceccae806 req-1fdd2f3b-12ac-4269-a208-f27c6dea8472 tempest-ServerActionsTestOtherA-1077245219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.004s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:14:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-52296df5-f82a-4449-8695-561ceccae806 req-1fdd2f3b-12ac-4269-a208-f27c6dea8472 tempest-ServerActionsTestOtherA-1077245219 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b', 'name': 'volume-6ee22943-c515-4fc1-8216-44d5acb54cac', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '460e9f6a-6c6e-4537-acca-f74149fcabe8', 'enforce_multipath': True} {{(pid=87199) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 08:14:18 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-52296df5-f82a-4449-8695-561ceccae806 req-1fdd2f3b-12ac-4269-a208-f27c6dea8472 tempest-ServerActionsTestOtherA-1077245219 None] attachment_update completed successfully. Jul 07 08:14:19 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-0b9df735-f4e2-44b9-bed2-fcbd79e2b8ed req-2c7ec2a6-3451-488e-82e5-2bc86e30629e tempest-DeleteServersTestJSON-305801338 None] Terminate volume connection completed successfully. Jul 07 08:14:19 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-0b9df735-f4e2-44b9-bed2-fcbd79e2b8ed req-2c7ec2a6-3451-488e-82e5-2bc86e30629e tempest-DeleteServersTestJSON-305801338 None] Deleting attachment 6c1a3552-3811-46a1-8bde-867b34d2a415. {{(pid=87199) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 08:14:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-668c264a-7ced-4280-82b3-d395a319f74d tempest-DeleteServersTestJSON-305801338 None] Acquiring lock "cinder-7ed4dfc3-f843-43aa-96e7-7b120386c8cc-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:14:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-668c264a-7ced-4280-82b3-d395a319f74d tempest-DeleteServersTestJSON-305801338 None] Lock "cinder-7ed4dfc3-f843-43aa-96e7-7b120386c8cc-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:14:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-668c264a-7ced-4280-82b3-d395a319f74d tempest-DeleteServersTestJSON-305801338 None] Acquiring lock "cinder-quobyte-7ed4dfc3-f843-43aa-96e7-7b120386c8cc" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:14:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-668c264a-7ced-4280-82b3-d395a319f74d tempest-DeleteServersTestJSON-305801338 None] Lock "cinder-quobyte-7ed4dfc3-f843-43aa-96e7-7b120386c8cc" acquired by "delete_volume" :: waited 0.019s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:14:24 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[c188ac49-c9ae-4df4-ac70-1f3e62d65eb7]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:14:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-668c264a-7ced-4280-82b3-d395a319f74d tempest-DeleteServersTestJSON-305801338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7ed4dfc3-f843-43aa-96e7-7b120386c8cc {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:24 devstack sudo[89531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7ed4dfc3-f843-43aa-96e7-7b120386c8cc Jul 07 08:14:24 devstack sudo[89531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:25 devstack sudo[89531]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-668c264a-7ced-4280-82b3-d395a319f74d tempest-DeleteServersTestJSON-305801338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7ed4dfc3-f843-43aa-96e7-7b120386c8cc" returned: 0 in 0.970s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-668c264a-7ced-4280-82b3-d395a319f74d tempest-DeleteServersTestJSON-305801338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7ed4dfc3-f843-43aa-96e7-7b120386c8cc {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:25 devstack sudo[89541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7ed4dfc3-f843-43aa-96e7-7b120386c8cc Jul 07 08:14:25 devstack sudo[89541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:27 devstack sudo[89541]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-668c264a-7ced-4280-82b3-d395a319f74d tempest-DeleteServersTestJSON-305801338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7ed4dfc3-f843-43aa-96e7-7b120386c8cc" returned: 0 in 1.491s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:27 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-668c264a-7ced-4280-82b3-d395a319f74d tempest-DeleteServersTestJSON-305801338 None] Lock "cinder-quobyte-7ed4dfc3-f843-43aa-96e7-7b120386c8cc" released by "delete_volume" :: held 2.520s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:14:27 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-668c264a-7ced-4280-82b3-d395a319f74d tempest-DeleteServersTestJSON-305801338 None] Created reservations ['78c7e857-e841-40b9-9652-d02fb7b6fd18', 'a7f24665-2c20-4edb-8687-ffde606b8ad5', 'db9c6323-6e98-42d3-89d3-be48d5eff3ee', 'c0d3ad37-e922-45ff-9101-431265c2ddac'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:14:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-668c264a-7ced-4280-82b3-d395a319f74d tempest-DeleteServersTestJSON-305801338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:14:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-668c264a-7ced-4280-82b3-d395a319f74d tempest-DeleteServersTestJSON-305801338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:14:27 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-668c264a-7ced-4280-82b3-d395a319f74d tempest-DeleteServersTestJSON-305801338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:14:27 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-668c264a-7ced-4280-82b3-d395a319f74d tempest-DeleteServersTestJSON-305801338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:14:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-668c264a-7ced-4280-82b3-d395a319f74d tempest-DeleteServersTestJSON-305801338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:14:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-668c264a-7ced-4280-82b3-d395a319f74d tempest-DeleteServersTestJSON-305801338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:27 devstack sudo[89597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:14:27 devstack sudo[89597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:27 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-d25da1a5-cd57-4463-8059-f5df60b1687b req-4c72f70b-f3f0-458c-848d-d747bd0dc15f tempest-AttachVolumeNegativeTest-328651626 None] Terminate volume connection completed successfully. Jul 07 08:14:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-d25da1a5-cd57-4463-8059-f5df60b1687b req-4c72f70b-f3f0-458c-848d-d747bd0dc15f tempest-AttachVolumeNegativeTest-328651626 None] Deleting attachment 1723a514-c82e-4cda-b831-d63c88003fd0. {{(pid=87199) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 08:14:28 devstack sudo[89597]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-668c264a-7ced-4280-82b3-d395a319f74d tempest-DeleteServersTestJSON-305801338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 1.209s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:28 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-668c264a-7ced-4280-82b3-d395a319f74d tempest-DeleteServersTestJSON-305801338 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:14:28 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-668c264a-7ced-4280-82b3-d395a319f74d tempest-DeleteServersTestJSON-305801338 None] Deleted volume successfully. Jul 07 08:14:28 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-668c264a-7ced-4280-82b3-d395a319f74d tempest-DeleteServersTestJSON-305801338 None] Lock "cinder-7ed4dfc3-f843-43aa-96e7-7b120386c8cc-delete_volume" released by "delete_volume" :: held 4.185s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:14:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-2c4f5a40-a9d8-4226-85a7-57e53014d728 req-459782f4-9744-41a4-8545-63d13e7e01fc tempest-TaggedAttachmentsTest-841350389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:14:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-2c4f5a40-a9d8-4226-85a7-57e53014d728 req-459782f4-9744-41a4-8545-63d13e7e01fc tempest-TaggedAttachmentsTest-841350389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:14:33 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ae1cf7-7300-4832-a486-a82a54ebd893]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:14:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-2c4f5a40-a9d8-4226-85a7-57e53014d728 req-459782f4-9744-41a4-8545-63d13e7e01fc tempest-TaggedAttachmentsTest-841350389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-802ae173-7b87-410e-b6cd-29369003d874 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:33 devstack sudo[89670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-802ae173-7b87-410e-b6cd-29369003d874 Jul 07 08:14:33 devstack sudo[89670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:34 devstack sudo[89670]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-2c4f5a40-a9d8-4226-85a7-57e53014d728 req-459782f4-9744-41a4-8545-63d13e7e01fc tempest-TaggedAttachmentsTest-841350389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-802ae173-7b87-410e-b6cd-29369003d874" returned: 0 in 1.078s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-2c4f5a40-a9d8-4226-85a7-57e53014d728 req-459782f4-9744-41a4-8545-63d13e7e01fc tempest-TaggedAttachmentsTest-841350389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.113s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:14:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-2c4f5a40-a9d8-4226-85a7-57e53014d728 req-459782f4-9744-41a4-8545-63d13e7e01fc tempest-TaggedAttachmentsTest-841350389 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b', 'name': 'volume-802ae173-7b87-410e-b6cd-29369003d874', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1755bfa0-7bac-416b-be72-5fb740569cdc', 'enforce_multipath': True} {{(pid=87199) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 08:14:35 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-2c4f5a40-a9d8-4226-85a7-57e53014d728 req-459782f4-9744-41a4-8545-63d13e7e01fc tempest-TaggedAttachmentsTest-841350389 None] attachment_update completed successfully. Jul 07 08:14:42 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-02a16efb-19f2-4c93-a182-96a0ee69104a req-6ca66090-0188-4791-9e26-cd0f21b6378d tempest-TaggedAttachmentsTest-841350389 None] Terminate volume connection completed successfully. Jul 07 08:14:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-02a16efb-19f2-4c93-a182-96a0ee69104a req-6ca66090-0188-4791-9e26-cd0f21b6378d tempest-TaggedAttachmentsTest-841350389 None] Deleting attachment 1755bfa0-7bac-416b-be72-5fb740569cdc. {{(pid=87199) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 08:14:50 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-1e5fda72-9c93-4fd6-af44-5fb8057000e0 req-57944f4c-743e-4b11-ba5c-b50b6c13eb15 tempest-ServerActionsTestOtherA-1077245219 None] Terminate volume connection completed successfully. Jul 07 08:14:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-1e5fda72-9c93-4fd6-af44-5fb8057000e0 req-57944f4c-743e-4b11-ba5c-b50b6c13eb15 tempest-ServerActionsTestOtherA-1077245219 None] Deleting attachment 460e9f6a-6c6e-4537-acca-f74149fcabe8. {{(pid=87199) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 08:15:00 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:UPDATE=18,cinder:SELECT=34,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:15:00 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=34,cinder:UPDATE=16,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:15:05 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:15:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:15:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:15:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:15:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:15:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:15:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:05 devstack sudo[90050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:15:05 devstack sudo[90050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:06 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-dbe92cea-761e-4d7c-bf27-581c5fecadcd tempest-ServerActionsTestOtherA-1077245219 None] Acquiring lock "cinder-6ee22943-c515-4fc1-8216-44d5acb54cac-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:15:06 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-dbe92cea-761e-4d7c-bf27-581c5fecadcd tempest-ServerActionsTestOtherA-1077245219 None] Lock "cinder-6ee22943-c515-4fc1-8216-44d5acb54cac-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:15:06 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-dbe92cea-761e-4d7c-bf27-581c5fecadcd tempest-ServerActionsTestOtherA-1077245219 None] Acquiring lock "cinder-quobyte-6ee22943-c515-4fc1-8216-44d5acb54cac" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:15:06 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-dbe92cea-761e-4d7c-bf27-581c5fecadcd tempest-ServerActionsTestOtherA-1077245219 None] Lock "cinder-quobyte-6ee22943-c515-4fc1-8216-44d5acb54cac" acquired by "delete_volume" :: waited 0.027s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:15:06 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98fadd8-d1f4-4235-a391-fb8c5c6df0dc]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:15:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-dbe92cea-761e-4d7c-bf27-581c5fecadcd tempest-ServerActionsTestOtherA-1077245219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6ee22943-c515-4fc1-8216-44d5acb54cac {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:07 devstack sudo[90052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6ee22943-c515-4fc1-8216-44d5acb54cac Jul 07 08:15:07 devstack sudo[90052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:08 devstack sudo[90050]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 2.512s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:08 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:15:08 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running periodic task VolumeManager._thread_info {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:15:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] thread count: 8 {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 08:15:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] thread info: [<_MainThread(MainThread, started 133056092332160)>, , , , , , , ] {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 08:15:08 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-96e65108-f9c8-443a-b3c4-e5438d1b5c46 tempest-TaggedAttachmentsTest-841350389 None] Acquiring lock "cinder-802ae173-7b87-410e-b6cd-29369003d874-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:15:08 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-96e65108-f9c8-443a-b3c4-e5438d1b5c46 tempest-TaggedAttachmentsTest-841350389 None] Lock "cinder-802ae173-7b87-410e-b6cd-29369003d874-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:15:08 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-96e65108-f9c8-443a-b3c4-e5438d1b5c46 tempest-TaggedAttachmentsTest-841350389 None] Acquiring lock "cinder-quobyte-802ae173-7b87-410e-b6cd-29369003d874" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:15:08 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-96e65108-f9c8-443a-b3c4-e5438d1b5c46 tempest-TaggedAttachmentsTest-841350389 None] Lock "cinder-quobyte-802ae173-7b87-410e-b6cd-29369003d874" acquired by "delete_volume" :: waited 0.030s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:15:08 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6983bf4-f58a-432f-aa92-002f1e130d42]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:15:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-96e65108-f9c8-443a-b3c4-e5438d1b5c46 tempest-TaggedAttachmentsTest-841350389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-802ae173-7b87-410e-b6cd-29369003d874 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:08 devstack sudo[90052]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-dbe92cea-761e-4d7c-bf27-581c5fecadcd tempest-ServerActionsTestOtherA-1077245219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6ee22943-c515-4fc1-8216-44d5acb54cac" returned: 0 in 1.990s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-dbe92cea-761e-4d7c-bf27-581c5fecadcd tempest-ServerActionsTestOtherA-1077245219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6ee22943-c515-4fc1-8216-44d5acb54cac {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:08 devstack sudo[90062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6ee22943-c515-4fc1-8216-44d5acb54cac Jul 07 08:15:08 devstack sudo[90062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:09 devstack sudo[90061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-802ae173-7b87-410e-b6cd-29369003d874 Jul 07 08:15:09 devstack sudo[90061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:10 devstack sudo[90062]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-dbe92cea-761e-4d7c-bf27-581c5fecadcd tempest-ServerActionsTestOtherA-1077245219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6ee22943-c515-4fc1-8216-44d5acb54cac" returned: 0 in 1.185s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:10 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-dbe92cea-761e-4d7c-bf27-581c5fecadcd tempest-ServerActionsTestOtherA-1077245219 None] Lock "cinder-quobyte-6ee22943-c515-4fc1-8216-44d5acb54cac" released by "delete_volume" :: held 3.252s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:15:10 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-dbe92cea-761e-4d7c-bf27-581c5fecadcd tempest-ServerActionsTestOtherA-1077245219 None] Created reservations ['98dbd1b2-a5db-464a-9e0d-4a89f6413eb2', '1d41b779-6603-4e0e-aa2c-9aca0370674a', '17179779-4743-4959-ad49-1994deb11636', 'c9eda572-0561-40e7-a957-a8a117029a19'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:15:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-dbe92cea-761e-4d7c-bf27-581c5fecadcd tempest-ServerActionsTestOtherA-1077245219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:15:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-dbe92cea-761e-4d7c-bf27-581c5fecadcd tempest-ServerActionsTestOtherA-1077245219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:15:10 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-dbe92cea-761e-4d7c-bf27-581c5fecadcd tempest-ServerActionsTestOtherA-1077245219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:15:10 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-dbe92cea-761e-4d7c-bf27-581c5fecadcd tempest-ServerActionsTestOtherA-1077245219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:15:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-dbe92cea-761e-4d7c-bf27-581c5fecadcd tempest-ServerActionsTestOtherA-1077245219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:15:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-dbe92cea-761e-4d7c-bf27-581c5fecadcd tempest-ServerActionsTestOtherA-1077245219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:10 devstack sudo[90071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:15:10 devstack sudo[90071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:10 devstack sudo[90061]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-96e65108-f9c8-443a-b3c4-e5438d1b5c46 tempest-TaggedAttachmentsTest-841350389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-802ae173-7b87-410e-b6cd-29369003d874" returned: 0 in 1.735s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-96e65108-f9c8-443a-b3c4-e5438d1b5c46 tempest-TaggedAttachmentsTest-841350389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-802ae173-7b87-410e-b6cd-29369003d874 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:10 devstack sudo[90073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-802ae173-7b87-410e-b6cd-29369003d874 Jul 07 08:15:10 devstack sudo[90073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:11 devstack sudo[90071]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-dbe92cea-761e-4d7c-bf27-581c5fecadcd tempest-ServerActionsTestOtherA-1077245219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 1.469s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:11 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-dbe92cea-761e-4d7c-bf27-581c5fecadcd tempest-ServerActionsTestOtherA-1077245219 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:15:11 devstack sudo[90073]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:11 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-dbe92cea-761e-4d7c-bf27-581c5fecadcd tempest-ServerActionsTestOtherA-1077245219 None] Deleted volume successfully. Jul 07 08:15:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-96e65108-f9c8-443a-b3c4-e5438d1b5c46 tempest-TaggedAttachmentsTest-841350389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-802ae173-7b87-410e-b6cd-29369003d874" returned: 0 in 1.383s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:12 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-96e65108-f9c8-443a-b3c4-e5438d1b5c46 tempest-TaggedAttachmentsTest-841350389 None] Lock "cinder-quobyte-802ae173-7b87-410e-b6cd-29369003d874" released by "delete_volume" :: held 3.200s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:15:12 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-dbe92cea-761e-4d7c-bf27-581c5fecadcd tempest-ServerActionsTestOtherA-1077245219 None] Lock "cinder-6ee22943-c515-4fc1-8216-44d5acb54cac-delete_volume" released by "delete_volume" :: held 5.456s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:15:12 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-96e65108-f9c8-443a-b3c4-e5438d1b5c46 tempest-TaggedAttachmentsTest-841350389 None] Created reservations ['9cdf4ffd-f824-4e67-a50d-c1170c9e9e49', '916e0aa0-fc7b-45fd-a11d-7cf9d618f316', '6a39041c-35e3-46a9-b03b-ef6db6f7022c', '01a644a7-56a8-4b19-9e77-3cadf6c2dbfe'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:15:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-96e65108-f9c8-443a-b3c4-e5438d1b5c46 tempest-TaggedAttachmentsTest-841350389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:15:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-96e65108-f9c8-443a-b3c4-e5438d1b5c46 tempest-TaggedAttachmentsTest-841350389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:15:12 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-96e65108-f9c8-443a-b3c4-e5438d1b5c46 tempest-TaggedAttachmentsTest-841350389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:15:12 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-96e65108-f9c8-443a-b3c4-e5438d1b5c46 tempest-TaggedAttachmentsTest-841350389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:15:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-96e65108-f9c8-443a-b3c4-e5438d1b5c46 tempest-TaggedAttachmentsTest-841350389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:15:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-96e65108-f9c8-443a-b3c4-e5438d1b5c46 tempest-TaggedAttachmentsTest-841350389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:12 devstack sudo[90086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:15:12 devstack sudo[90086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:13 devstack sudo[90086]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-96e65108-f9c8-443a-b3c4-e5438d1b5c46 tempest-TaggedAttachmentsTest-841350389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 1.510s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:13 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-96e65108-f9c8-443a-b3c4-e5438d1b5c46 tempest-TaggedAttachmentsTest-841350389 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:15:13 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-96e65108-f9c8-443a-b3c4-e5438d1b5c46 tempest-TaggedAttachmentsTest-841350389 None] Deleted volume successfully. Jul 07 08:15:14 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-96e65108-f9c8-443a-b3c4-e5438d1b5c46 tempest-TaggedAttachmentsTest-841350389 None] Lock "cinder-802ae173-7b87-410e-b6cd-29369003d874-delete_volume" released by "delete_volume" :: held 5.407s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:15:22 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:UPDATE=17,cinder:SELECT=10,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:15:24 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-84b3bca0-4017-430e-996a-6ad47434e3f4 tempest-AttachVolumeNegativeTest-328651626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:15:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-84b3bca0-4017-430e-996a-6ad47434e3f4 tempest-AttachVolumeNegativeTest-328651626 None] Flow 'volume_create_manager' (b337dae6-763c-4e27-ba5b-6c8ddf51fda0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:15:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-84b3bca0-4017-430e-996a-6ad47434e3f4 tempest-AttachVolumeNegativeTest-328651626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79263b78-ffea-46f6-9e8d-9b4c8fab24cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:15:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-84b3bca0-4017-430e-996a-6ad47434e3f4 tempest-AttachVolumeNegativeTest-328651626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79263b78-ffea-46f6-9e8d-9b4c8fab24cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:15:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1721313357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00fdc747-25e0-433c-bc3f-47daf94b3668,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3444540d904f436ea41d3b0f1e7efb46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:15:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:15:24Z,use_quota=True,user_id='c39c7aaf7a1347d3b8d2396e3041b4b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:15:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-84b3bca0-4017-430e-996a-6ad47434e3f4 tempest-AttachVolumeNegativeTest-328651626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d20d3fdb-cff6-41f0-b35c-1775c2f01985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:15:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-84b3bca0-4017-430e-996a-6ad47434e3f4 tempest-AttachVolumeNegativeTest-328651626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d20d3fdb-cff6-41f0-b35c-1775c2f01985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:15:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-84b3bca0-4017-430e-996a-6ad47434e3f4 tempest-AttachVolumeNegativeTest-328651626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e4689f9-5d2a-4561-b7c1-77b8823df3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:15:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-84b3bca0-4017-430e-996a-6ad47434e3f4 tempest-AttachVolumeNegativeTest-328651626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e4689f9-5d2a-4561-b7c1-77b8823df3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00fdc747-25e0-433c-bc3f-47daf94b3668', 'volume_name': 'volume-00fdc747-25e0-433c-bc3f-47daf94b3668', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:15:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-84b3bca0-4017-430e-996a-6ad47434e3f4 tempest-AttachVolumeNegativeTest-328651626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e586b33c-83e8-4061-b286-554598df2705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:15:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-84b3bca0-4017-430e-996a-6ad47434e3f4 tempest-AttachVolumeNegativeTest-328651626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e586b33c-83e8-4061-b286-554598df2705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:15:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-84b3bca0-4017-430e-996a-6ad47434e3f4 tempest-AttachVolumeNegativeTest-328651626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0506d76c-bbb0-44da-8735-afa4bbac4650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:15:24 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-84b3bca0-4017-430e-996a-6ad47434e3f4 tempest-AttachVolumeNegativeTest-328651626 None] Volume 00fdc747-25e0-433c-bc3f-47daf94b3668: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00fdc747-25e0-433c-bc3f-47daf94b3668', 'volume_size': 1} Jul 07 08:15:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-84b3bca0-4017-430e-996a-6ad47434e3f4 tempest-AttachVolumeNegativeTest-328651626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:15:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-84b3bca0-4017-430e-996a-6ad47434e3f4 tempest-AttachVolumeNegativeTest-328651626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:15:24 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-84b3bca0-4017-430e-996a-6ad47434e3f4 tempest-AttachVolumeNegativeTest-328651626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:15:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1721313357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00fdc747-25e0-433c-bc3f-47daf94b3668,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3444540d904f436ea41d3b0f1e7efb46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:15:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:15:24Z,use_quota=True,user_id='c39c7aaf7a1347d3b8d2396e3041b4b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:15:24 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-84b3bca0-4017-430e-996a-6ad47434e3f4 tempest-AttachVolumeNegativeTest-328651626 None] Creating volume 00fdc747-25e0-433c-bc3f-47daf94b3668 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:15:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-84b3bca0-4017-430e-996a-6ad47434e3f4 tempest-AttachVolumeNegativeTest-328651626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:15:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-84b3bca0-4017-430e-996a-6ad47434e3f4 tempest-AttachVolumeNegativeTest-328651626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:15:24 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-84b3bca0-4017-430e-996a-6ad47434e3f4 tempest-AttachVolumeNegativeTest-328651626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:15:24 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-84b3bca0-4017-430e-996a-6ad47434e3f4 tempest-AttachVolumeNegativeTest-328651626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:15:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-84b3bca0-4017-430e-996a-6ad47434e3f4 tempest-AttachVolumeNegativeTest-328651626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:15:24 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-84b3bca0-4017-430e-996a-6ad47434e3f4 tempest-AttachVolumeNegativeTest-328651626 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:15:24 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-84b3bca0-4017-430e-996a-6ad47434e3f4 tempest-AttachVolumeNegativeTest-328651626 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:15:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-84b3bca0-4017-430e-996a-6ad47434e3f4 tempest-AttachVolumeNegativeTest-328651626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-00fdc747-25e0-433c-bc3f-47daf94b3668 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:24 devstack sudo[90250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-00fdc747-25e0-433c-bc3f-47daf94b3668 1073741824 Jul 07 08:15:24 devstack sudo[90250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:25 devstack sudo[90250]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-84b3bca0-4017-430e-996a-6ad47434e3f4 tempest-AttachVolumeNegativeTest-328651626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-00fdc747-25e0-433c-bc3f-47daf94b3668 1073741824" returned: 0 in 1.191s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-84b3bca0-4017-430e-996a-6ad47434e3f4 tempest-AttachVolumeNegativeTest-328651626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-00fdc747-25e0-433c-bc3f-47daf94b3668 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:25 devstack sudo[90258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-00fdc747-25e0-433c-bc3f-47daf94b3668 Jul 07 08:15:25 devstack sudo[90258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:26 devstack sudo[90258]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-84b3bca0-4017-430e-996a-6ad47434e3f4 tempest-AttachVolumeNegativeTest-328651626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-00fdc747-25e0-433c-bc3f-47daf94b3668" returned: 0 in 1.191s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:26 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-84b3bca0-4017-430e-996a-6ad47434e3f4 tempest-AttachVolumeNegativeTest-328651626 None] <== create_volume: return (2451ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:15:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-84b3bca0-4017-430e-996a-6ad47434e3f4 tempest-AttachVolumeNegativeTest-328651626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.454s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:15:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-84b3bca0-4017-430e-996a-6ad47434e3f4 tempest-AttachVolumeNegativeTest-328651626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0506d76c-bbb0-44da-8735-afa4bbac4650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00fdc747-25e0-433c-bc3f-47daf94b3668', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:15:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-84b3bca0-4017-430e-996a-6ad47434e3f4 tempest-AttachVolumeNegativeTest-328651626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (835118eb-cb2f-4e94-b7d0-23bdafcad280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:15:27 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-84b3bca0-4017-430e-996a-6ad47434e3f4 tempest-AttachVolumeNegativeTest-328651626 None] Volume volume-00fdc747-25e0-433c-bc3f-47daf94b3668 (00fdc747-25e0-433c-bc3f-47daf94b3668): created successfully Jul 07 08:15:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-84b3bca0-4017-430e-996a-6ad47434e3f4 tempest-AttachVolumeNegativeTest-328651626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (835118eb-cb2f-4e94-b7d0-23bdafcad280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:15:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-84b3bca0-4017-430e-996a-6ad47434e3f4 tempest-AttachVolumeNegativeTest-328651626 None] Flow 'volume_create_manager' (b337dae6-763c-4e27-ba5b-6c8ddf51fda0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:15:27 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-84b3bca0-4017-430e-996a-6ad47434e3f4 tempest-AttachVolumeNegativeTest-328651626 None] Created volume successfully. Jul 07 08:15:27 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa86f481-77fb-4f37-a4ae-ce394a8bfc10 tempest-ServerRescueNegativeTestJSON-2125793030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:15:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-aa86f481-77fb-4f37-a4ae-ce394a8bfc10 tempest-ServerRescueNegativeTestJSON-2125793030 None] Flow 'volume_create_manager' (6139e3ce-2b30-417c-baad-2dedef373c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:15:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-aa86f481-77fb-4f37-a4ae-ce394a8bfc10 tempest-ServerRescueNegativeTestJSON-2125793030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e45f33bd-a28d-4ddf-9f85-9b157f9ed385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:15:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-aa86f481-77fb-4f37-a4ae-ce394a8bfc10 tempest-ServerRescueNegativeTestJSON-2125793030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e45f33bd-a28d-4ddf-9f85-9b157f9ed385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:15:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1734184160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2658781-8762-40d7-add9-7e09c1cbe68b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d77e9381bcea4416a462e5a850e0a353',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:15:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:15:27Z,use_quota=True,user_id='9da9d74a20014610b48d990193faa775',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:15:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-aa86f481-77fb-4f37-a4ae-ce394a8bfc10 tempest-ServerRescueNegativeTestJSON-2125793030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b319347a-45ad-4940-8438-62c39a3a792b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:15:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-aa86f481-77fb-4f37-a4ae-ce394a8bfc10 tempest-ServerRescueNegativeTestJSON-2125793030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b319347a-45ad-4940-8438-62c39a3a792b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:15:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-aa86f481-77fb-4f37-a4ae-ce394a8bfc10 tempest-ServerRescueNegativeTestJSON-2125793030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9503b4b8-25f1-405a-ae72-59440ec21608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:15:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-aa86f481-77fb-4f37-a4ae-ce394a8bfc10 tempest-ServerRescueNegativeTestJSON-2125793030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9503b4b8-25f1-405a-ae72-59440ec21608) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2658781-8762-40d7-add9-7e09c1cbe68b', 'volume_name': 'volume-c2658781-8762-40d7-add9-7e09c1cbe68b', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:15:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-aa86f481-77fb-4f37-a4ae-ce394a8bfc10 tempest-ServerRescueNegativeTestJSON-2125793030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34288abc-4772-4576-b66c-e81388f69423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:15:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-aa86f481-77fb-4f37-a4ae-ce394a8bfc10 tempest-ServerRescueNegativeTestJSON-2125793030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34288abc-4772-4576-b66c-e81388f69423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:15:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-aa86f481-77fb-4f37-a4ae-ce394a8bfc10 tempest-ServerRescueNegativeTestJSON-2125793030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e3bdce1-0f98-498d-a9db-3ec42e81a49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:15:27 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-aa86f481-77fb-4f37-a4ae-ce394a8bfc10 tempest-ServerRescueNegativeTestJSON-2125793030 None] Volume c2658781-8762-40d7-add9-7e09c1cbe68b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2658781-8762-40d7-add9-7e09c1cbe68b', 'volume_size': 1} Jul 07 08:15:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-aa86f481-77fb-4f37-a4ae-ce394a8bfc10 tempest-ServerRescueNegativeTestJSON-2125793030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:15:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-aa86f481-77fb-4f37-a4ae-ce394a8bfc10 tempest-ServerRescueNegativeTestJSON-2125793030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:15:27 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-aa86f481-77fb-4f37-a4ae-ce394a8bfc10 tempest-ServerRescueNegativeTestJSON-2125793030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:15:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1734184160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2658781-8762-40d7-add9-7e09c1cbe68b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d77e9381bcea4416a462e5a850e0a353',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:15:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:15:27Z,use_quota=True,user_id='9da9d74a20014610b48d990193faa775',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:15:27 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-aa86f481-77fb-4f37-a4ae-ce394a8bfc10 tempest-ServerRescueNegativeTestJSON-2125793030 None] Creating volume c2658781-8762-40d7-add9-7e09c1cbe68b {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:15:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-aa86f481-77fb-4f37-a4ae-ce394a8bfc10 tempest-ServerRescueNegativeTestJSON-2125793030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:15:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-aa86f481-77fb-4f37-a4ae-ce394a8bfc10 tempest-ServerRescueNegativeTestJSON-2125793030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:15:27 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-aa86f481-77fb-4f37-a4ae-ce394a8bfc10 tempest-ServerRescueNegativeTestJSON-2125793030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:15:27 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-aa86f481-77fb-4f37-a4ae-ce394a8bfc10 tempest-ServerRescueNegativeTestJSON-2125793030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:15:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-aa86f481-77fb-4f37-a4ae-ce394a8bfc10 tempest-ServerRescueNegativeTestJSON-2125793030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:15:27 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-aa86f481-77fb-4f37-a4ae-ce394a8bfc10 tempest-ServerRescueNegativeTestJSON-2125793030 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:15:27 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-aa86f481-77fb-4f37-a4ae-ce394a8bfc10 tempest-ServerRescueNegativeTestJSON-2125793030 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:15:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-aa86f481-77fb-4f37-a4ae-ce394a8bfc10 tempest-ServerRescueNegativeTestJSON-2125793030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c2658781-8762-40d7-add9-7e09c1cbe68b 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:27 devstack sudo[90287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c2658781-8762-40d7-add9-7e09c1cbe68b 1073741824 Jul 07 08:15:27 devstack sudo[90287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:29 devstack sudo[90287]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-aa86f481-77fb-4f37-a4ae-ce394a8bfc10 tempest-ServerRescueNegativeTestJSON-2125793030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c2658781-8762-40d7-add9-7e09c1cbe68b 1073741824" returned: 0 in 1.665s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-aa86f481-77fb-4f37-a4ae-ce394a8bfc10 tempest-ServerRescueNegativeTestJSON-2125793030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c2658781-8762-40d7-add9-7e09c1cbe68b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:29 devstack sudo[90301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c2658781-8762-40d7-add9-7e09c1cbe68b Jul 07 08:15:29 devstack sudo[90301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:30 devstack sudo[90301]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-aa86f481-77fb-4f37-a4ae-ce394a8bfc10 tempest-ServerRescueNegativeTestJSON-2125793030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c2658781-8762-40d7-add9-7e09c1cbe68b" returned: 0 in 1.315s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:30 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-aa86f481-77fb-4f37-a4ae-ce394a8bfc10 tempest-ServerRescueNegativeTestJSON-2125793030 None] <== create_volume: return (3060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:15:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-aa86f481-77fb-4f37-a4ae-ce394a8bfc10 tempest-ServerRescueNegativeTestJSON-2125793030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.069s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:15:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-aa86f481-77fb-4f37-a4ae-ce394a8bfc10 tempest-ServerRescueNegativeTestJSON-2125793030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e3bdce1-0f98-498d-a9db-3ec42e81a49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2658781-8762-40d7-add9-7e09c1cbe68b', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:15:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-aa86f481-77fb-4f37-a4ae-ce394a8bfc10 tempest-ServerRescueNegativeTestJSON-2125793030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e61a871-f62f-4bd3-a842-af18b7c63089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:15:30 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-aa86f481-77fb-4f37-a4ae-ce394a8bfc10 tempest-ServerRescueNegativeTestJSON-2125793030 None] Volume volume-c2658781-8762-40d7-add9-7e09c1cbe68b (c2658781-8762-40d7-add9-7e09c1cbe68b): created successfully Jul 07 08:15:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-aa86f481-77fb-4f37-a4ae-ce394a8bfc10 tempest-ServerRescueNegativeTestJSON-2125793030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e61a871-f62f-4bd3-a842-af18b7c63089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:15:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-aa86f481-77fb-4f37-a4ae-ce394a8bfc10 tempest-ServerRescueNegativeTestJSON-2125793030 None] Flow 'volume_create_manager' (6139e3ce-2b30-417c-baad-2dedef373c35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:15:30 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-aa86f481-77fb-4f37-a4ae-ce394a8bfc10 tempest-ServerRescueNegativeTestJSON-2125793030 None] Created volume successfully. Jul 07 08:15:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-1dfd3c2f-e470-4b96-a458-0f39ab15dc1d req-98ad9f10-93f3-45e0-bb0f-6c3f09efc6cf tempest-AttachVolumeNegativeTest-328651626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:15:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-1dfd3c2f-e470-4b96-a458-0f39ab15dc1d req-98ad9f10-93f3-45e0-bb0f-6c3f09efc6cf tempest-AttachVolumeNegativeTest-328651626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:15:31 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[1873a397-7310-4c21-82cb-4745ee7e9a9a]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:15:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-1dfd3c2f-e470-4b96-a458-0f39ab15dc1d req-98ad9f10-93f3-45e0-bb0f-6c3f09efc6cf tempest-AttachVolumeNegativeTest-328651626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-00fdc747-25e0-433c-bc3f-47daf94b3668 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:31 devstack sudo[90314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-00fdc747-25e0-433c-bc3f-47daf94b3668 Jul 07 08:15:31 devstack sudo[90314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:32 devstack sudo[90314]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-1dfd3c2f-e470-4b96-a458-0f39ab15dc1d req-98ad9f10-93f3-45e0-bb0f-6c3f09efc6cf tempest-AttachVolumeNegativeTest-328651626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-00fdc747-25e0-433c-bc3f-47daf94b3668" returned: 0 in 1.214s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-1dfd3c2f-e470-4b96-a458-0f39ab15dc1d req-98ad9f10-93f3-45e0-bb0f-6c3f09efc6cf tempest-AttachVolumeNegativeTest-328651626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.261s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:15:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-1dfd3c2f-e470-4b96-a458-0f39ab15dc1d req-98ad9f10-93f3-45e0-bb0f-6c3f09efc6cf tempest-AttachVolumeNegativeTest-328651626 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b', 'name': 'volume-00fdc747-25e0-433c-bc3f-47daf94b3668', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '60a5b114-0b7a-4344-af19-6e94029e0ad7', 'enforce_multipath': True} {{(pid=87199) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 08:15:32 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-1dfd3c2f-e470-4b96-a458-0f39ab15dc1d req-98ad9f10-93f3-45e0-bb0f-6c3f09efc6cf tempest-AttachVolumeNegativeTest-328651626 None] attachment_update completed successfully. Jul 07 08:15:39 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-5855a536-3cca-4eff-a847-7fc2c5fec303 req-a16176e2-5128-4a1c-b4c1-b6fbe7c23bf8 tempest-AttachVolumeNegativeTest-328651626 None] Terminate volume connection completed successfully. Jul 07 08:15:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-5855a536-3cca-4eff-a847-7fc2c5fec303 req-a16176e2-5128-4a1c-b4c1-b6fbe7c23bf8 tempest-AttachVolumeNegativeTest-328651626 None] Deleting attachment 60a5b114-0b7a-4344-af19-6e94029e0ad7. {{(pid=87199) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 08:15:49 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:UPDATE=11,cinder:SELECT=10,cinder:DELETE=1 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:15:49 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=22,cinder:UPDATE=20,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:15:59 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e92201c4-8f6a-44bb-bd4c-54181ad14812 tempest-ServerRescueNegativeTestJSON-2125793030 None] Acquiring lock "cinder-c2658781-8762-40d7-add9-7e09c1cbe68b-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:15:59 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e92201c4-8f6a-44bb-bd4c-54181ad14812 tempest-ServerRescueNegativeTestJSON-2125793030 None] Lock "cinder-c2658781-8762-40d7-add9-7e09c1cbe68b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:15:59 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e92201c4-8f6a-44bb-bd4c-54181ad14812 tempest-ServerRescueNegativeTestJSON-2125793030 None] Acquiring lock "cinder-quobyte-c2658781-8762-40d7-add9-7e09c1cbe68b" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:15:59 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e92201c4-8f6a-44bb-bd4c-54181ad14812 tempest-ServerRescueNegativeTestJSON-2125793030 None] Lock "cinder-quobyte-c2658781-8762-40d7-add9-7e09c1cbe68b" acquired by "delete_volume" :: waited 0.018s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:15:59 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01f79d7-4877-45bb-9687-eb076e88d701]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:15:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e92201c4-8f6a-44bb-bd4c-54181ad14812 tempest-ServerRescueNegativeTestJSON-2125793030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c2658781-8762-40d7-add9-7e09c1cbe68b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:59 devstack sudo[90910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c2658781-8762-40d7-add9-7e09c1cbe68b Jul 07 08:15:59 devstack sudo[90910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:00 devstack sudo[90910]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e92201c4-8f6a-44bb-bd4c-54181ad14812 tempest-ServerRescueNegativeTestJSON-2125793030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c2658781-8762-40d7-add9-7e09c1cbe68b" returned: 0 in 1.089s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e92201c4-8f6a-44bb-bd4c-54181ad14812 tempest-ServerRescueNegativeTestJSON-2125793030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c2658781-8762-40d7-add9-7e09c1cbe68b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:00 devstack sudo[90916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c2658781-8762-40d7-add9-7e09c1cbe68b Jul 07 08:16:00 devstack sudo[90916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:02 devstack sudo[90916]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e92201c4-8f6a-44bb-bd4c-54181ad14812 tempest-ServerRescueNegativeTestJSON-2125793030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c2658781-8762-40d7-add9-7e09c1cbe68b" returned: 0 in 1.696s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:02 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e92201c4-8f6a-44bb-bd4c-54181ad14812 tempest-ServerRescueNegativeTestJSON-2125793030 None] Lock "cinder-quobyte-c2658781-8762-40d7-add9-7e09c1cbe68b" released by "delete_volume" :: held 2.848s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:16:02 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-e92201c4-8f6a-44bb-bd4c-54181ad14812 tempest-ServerRescueNegativeTestJSON-2125793030 None] Created reservations ['41fc722b-cc5d-4522-8e61-8c568fab7b62', '57846167-515f-4aaa-8f41-ec12a5620303', 'a7cad82b-73c7-4aab-b89e-0e0d8fe298f8', 'a1c7c5bf-b5ee-48c0-9ebf-57c03b982bee'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:16:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e92201c4-8f6a-44bb-bd4c-54181ad14812 tempest-ServerRescueNegativeTestJSON-2125793030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:16:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e92201c4-8f6a-44bb-bd4c-54181ad14812 tempest-ServerRescueNegativeTestJSON-2125793030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:16:02 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e92201c4-8f6a-44bb-bd4c-54181ad14812 tempest-ServerRescueNegativeTestJSON-2125793030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:16:02 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e92201c4-8f6a-44bb-bd4c-54181ad14812 tempest-ServerRescueNegativeTestJSON-2125793030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:16:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e92201c4-8f6a-44bb-bd4c-54181ad14812 tempest-ServerRescueNegativeTestJSON-2125793030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:16:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e92201c4-8f6a-44bb-bd4c-54181ad14812 tempest-ServerRescueNegativeTestJSON-2125793030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:02 devstack sudo[90983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:16:02 devstack sudo[90983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:04 devstack sudo[90983]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e92201c4-8f6a-44bb-bd4c-54181ad14812 tempest-ServerRescueNegativeTestJSON-2125793030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 1.677s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:04 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-e92201c4-8f6a-44bb-bd4c-54181ad14812 tempest-ServerRescueNegativeTestJSON-2125793030 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:16:04 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-e92201c4-8f6a-44bb-bd4c-54181ad14812 tempest-ServerRescueNegativeTestJSON-2125793030 None] Deleted volume successfully. Jul 07 08:16:04 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e92201c4-8f6a-44bb-bd4c-54181ad14812 tempest-ServerRescueNegativeTestJSON-2125793030 None] Lock "cinder-c2658781-8762-40d7-add9-7e09c1cbe68b-delete_volume" released by "delete_volume" :: held 5.051s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:16:05 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:16:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:16:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:16:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:16:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:16:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.047s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:16:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:05 devstack sudo[91046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:16:05 devstack sudo[91046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:08 devstack sudo[91046]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 2.786s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:08 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:16:12 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:UPDATE=8,cinder:SELECT=5 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:16:14 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=5,cinder:INSERT=4,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:16:36 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-de566720-d6e5-4ef0-af98-b5516b6543bb tempest-AttachVolumeTestJSON-1669838508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:16:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-de566720-d6e5-4ef0-af98-b5516b6543bb tempest-AttachVolumeTestJSON-1669838508 None] Flow 'volume_create_manager' (22f616e7-2a47-46b8-91a4-924f7302719a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:16:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-de566720-d6e5-4ef0-af98-b5516b6543bb tempest-AttachVolumeTestJSON-1669838508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1df5a92-1a28-4f7a-858e-2c4590a1fcbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:16:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-de566720-d6e5-4ef0-af98-b5516b6543bb tempest-AttachVolumeTestJSON-1669838508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1df5a92-1a28-4f7a-858e-2c4590a1fcbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:16:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1468726720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61b57946-83d4-4109-a18a-c1c7ba193ff0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dece2e57fb847e191255e8956dcc583',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:16:36Z,use_quota=True,user_id='d580e0190dfb4020999f268cfcb2a74c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:16:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-de566720-d6e5-4ef0-af98-b5516b6543bb tempest-AttachVolumeTestJSON-1669838508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b1dd452-4fec-432b-91f0-2bee7065c6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:16:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-de566720-d6e5-4ef0-af98-b5516b6543bb tempest-AttachVolumeTestJSON-1669838508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b1dd452-4fec-432b-91f0-2bee7065c6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:16:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-de566720-d6e5-4ef0-af98-b5516b6543bb tempest-AttachVolumeTestJSON-1669838508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (099d04b9-1984-458e-bd47-263812b04a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:16:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-de566720-d6e5-4ef0-af98-b5516b6543bb tempest-AttachVolumeTestJSON-1669838508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (099d04b9-1984-458e-bd47-263812b04a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61b57946-83d4-4109-a18a-c1c7ba193ff0', 'volume_name': 'volume-61b57946-83d4-4109-a18a-c1c7ba193ff0', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:16:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-de566720-d6e5-4ef0-af98-b5516b6543bb tempest-AttachVolumeTestJSON-1669838508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (445f64af-782d-4a50-ad72-e9e4454b4e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:16:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-de566720-d6e5-4ef0-af98-b5516b6543bb tempest-AttachVolumeTestJSON-1669838508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (445f64af-782d-4a50-ad72-e9e4454b4e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:16:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-de566720-d6e5-4ef0-af98-b5516b6543bb tempest-AttachVolumeTestJSON-1669838508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1719acc2-a5b2-42a8-a299-d22bd4879a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:16:36 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-de566720-d6e5-4ef0-af98-b5516b6543bb tempest-AttachVolumeTestJSON-1669838508 None] Volume 61b57946-83d4-4109-a18a-c1c7ba193ff0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61b57946-83d4-4109-a18a-c1c7ba193ff0', 'volume_size': 1} Jul 07 08:16:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-de566720-d6e5-4ef0-af98-b5516b6543bb tempest-AttachVolumeTestJSON-1669838508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:16:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-de566720-d6e5-4ef0-af98-b5516b6543bb tempest-AttachVolumeTestJSON-1669838508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:16:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-de566720-d6e5-4ef0-af98-b5516b6543bb tempest-AttachVolumeTestJSON-1669838508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:16:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1468726720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61b57946-83d4-4109-a18a-c1c7ba193ff0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dece2e57fb847e191255e8956dcc583',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:16:36Z,use_quota=True,user_id='d580e0190dfb4020999f268cfcb2a74c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:16:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-de566720-d6e5-4ef0-af98-b5516b6543bb tempest-AttachVolumeTestJSON-1669838508 None] Creating volume 61b57946-83d4-4109-a18a-c1c7ba193ff0 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:16:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-de566720-d6e5-4ef0-af98-b5516b6543bb tempest-AttachVolumeTestJSON-1669838508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:16:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-de566720-d6e5-4ef0-af98-b5516b6543bb tempest-AttachVolumeTestJSON-1669838508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:16:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-de566720-d6e5-4ef0-af98-b5516b6543bb tempest-AttachVolumeTestJSON-1669838508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:16:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-de566720-d6e5-4ef0-af98-b5516b6543bb tempest-AttachVolumeTestJSON-1669838508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:16:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-de566720-d6e5-4ef0-af98-b5516b6543bb tempest-AttachVolumeTestJSON-1669838508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:16:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-de566720-d6e5-4ef0-af98-b5516b6543bb tempest-AttachVolumeTestJSON-1669838508 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:16:36 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-de566720-d6e5-4ef0-af98-b5516b6543bb tempest-AttachVolumeTestJSON-1669838508 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:16:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-de566720-d6e5-4ef0-af98-b5516b6543bb tempest-AttachVolumeTestJSON-1669838508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61b57946-83d4-4109-a18a-c1c7ba193ff0 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:36 devstack sudo[91447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61b57946-83d4-4109-a18a-c1c7ba193ff0 1073741824 Jul 07 08:16:36 devstack sudo[91447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:37 devstack sudo[91447]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-de566720-d6e5-4ef0-af98-b5516b6543bb tempest-AttachVolumeTestJSON-1669838508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61b57946-83d4-4109-a18a-c1c7ba193ff0 1073741824" returned: 0 in 1.107s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-de566720-d6e5-4ef0-af98-b5516b6543bb tempest-AttachVolumeTestJSON-1669838508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61b57946-83d4-4109-a18a-c1c7ba193ff0 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:37 devstack sudo[91454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61b57946-83d4-4109-a18a-c1c7ba193ff0 Jul 07 08:16:37 devstack sudo[91454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:38 devstack sudo[91454]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-de566720-d6e5-4ef0-af98-b5516b6543bb tempest-AttachVolumeTestJSON-1669838508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61b57946-83d4-4109-a18a-c1c7ba193ff0" returned: 0 in 0.681s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:38 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-de566720-d6e5-4ef0-af98-b5516b6543bb tempest-AttachVolumeTestJSON-1669838508 None] <== create_volume: return (1830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:16:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-de566720-d6e5-4ef0-af98-b5516b6543bb tempest-AttachVolumeTestJSON-1669838508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.834s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:16:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-de566720-d6e5-4ef0-af98-b5516b6543bb tempest-AttachVolumeTestJSON-1669838508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1719acc2-a5b2-42a8-a299-d22bd4879a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61b57946-83d4-4109-a18a-c1c7ba193ff0', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:16:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-de566720-d6e5-4ef0-af98-b5516b6543bb tempest-AttachVolumeTestJSON-1669838508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b86887f0-5579-4f1f-be20-e648bc0f1967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:16:38 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-de566720-d6e5-4ef0-af98-b5516b6543bb tempest-AttachVolumeTestJSON-1669838508 None] Volume volume-61b57946-83d4-4109-a18a-c1c7ba193ff0 (61b57946-83d4-4109-a18a-c1c7ba193ff0): created successfully Jul 07 08:16:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-de566720-d6e5-4ef0-af98-b5516b6543bb tempest-AttachVolumeTestJSON-1669838508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b86887f0-5579-4f1f-be20-e648bc0f1967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:16:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-de566720-d6e5-4ef0-af98-b5516b6543bb tempest-AttachVolumeTestJSON-1669838508 None] Flow 'volume_create_manager' (22f616e7-2a47-46b8-91a4-924f7302719a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:16:38 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-de566720-d6e5-4ef0-af98-b5516b6543bb tempest-AttachVolumeTestJSON-1669838508 None] Created volume successfully. Jul 07 08:16:42 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-412d4c28-3a12-4b17-b7a1-46393d9b5d6d tempest-ServersNegativeTestJSON-29514613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:16:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-412d4c28-3a12-4b17-b7a1-46393d9b5d6d tempest-ServersNegativeTestJSON-29514613 None] Flow 'volume_create_manager' (a3a65664-8ad1-40a3-98eb-2917d0762e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:16:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-412d4c28-3a12-4b17-b7a1-46393d9b5d6d tempest-ServersNegativeTestJSON-29514613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40555a2b-ef92-48b2-8025-7e45ce48e939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:16:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-412d4c28-3a12-4b17-b7a1-46393d9b5d6d tempest-ServersNegativeTestJSON-29514613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40555a2b-ef92-48b2-8025-7e45ce48e939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:16:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-649049715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=670f433b-5994-48d3-97cc-7a20f7b3cb54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a862680ce58497b913123dde46833c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:16:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:16:42Z,use_quota=True,user_id='9cd5227bacda47bf928f6b5dd9f029e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:16:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-412d4c28-3a12-4b17-b7a1-46393d9b5d6d tempest-ServersNegativeTestJSON-29514613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab2189c9-5cb3-441f-9c6a-e5f549737a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:16:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-412d4c28-3a12-4b17-b7a1-46393d9b5d6d tempest-ServersNegativeTestJSON-29514613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab2189c9-5cb3-441f-9c6a-e5f549737a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:16:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-412d4c28-3a12-4b17-b7a1-46393d9b5d6d tempest-ServersNegativeTestJSON-29514613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6c1754b-fc2a-458d-8eab-b0d5589bfe4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:16:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-412d4c28-3a12-4b17-b7a1-46393d9b5d6d tempest-ServersNegativeTestJSON-29514613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6c1754b-fc2a-458d-8eab-b0d5589bfe4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '670f433b-5994-48d3-97cc-7a20f7b3cb54', 'volume_name': 'volume-670f433b-5994-48d3-97cc-7a20f7b3cb54', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:16:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-412d4c28-3a12-4b17-b7a1-46393d9b5d6d tempest-ServersNegativeTestJSON-29514613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4e5fe2e-5545-4b7e-ab42-fa427e9aca18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:16:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-412d4c28-3a12-4b17-b7a1-46393d9b5d6d tempest-ServersNegativeTestJSON-29514613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4e5fe2e-5545-4b7e-ab42-fa427e9aca18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:16:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-412d4c28-3a12-4b17-b7a1-46393d9b5d6d tempest-ServersNegativeTestJSON-29514613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0056f655-d1f0-400a-a52b-cf1dbf5f411a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:16:42 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-412d4c28-3a12-4b17-b7a1-46393d9b5d6d tempest-ServersNegativeTestJSON-29514613 None] Volume 670f433b-5994-48d3-97cc-7a20f7b3cb54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-670f433b-5994-48d3-97cc-7a20f7b3cb54', 'volume_size': 1} Jul 07 08:16:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-412d4c28-3a12-4b17-b7a1-46393d9b5d6d tempest-ServersNegativeTestJSON-29514613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:16:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-412d4c28-3a12-4b17-b7a1-46393d9b5d6d tempest-ServersNegativeTestJSON-29514613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:16:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-412d4c28-3a12-4b17-b7a1-46393d9b5d6d tempest-ServersNegativeTestJSON-29514613 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:16:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-649049715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=670f433b-5994-48d3-97cc-7a20f7b3cb54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a862680ce58497b913123dde46833c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:16:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:16:42Z,use_quota=True,user_id='9cd5227bacda47bf928f6b5dd9f029e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:16:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-412d4c28-3a12-4b17-b7a1-46393d9b5d6d tempest-ServersNegativeTestJSON-29514613 None] Creating volume 670f433b-5994-48d3-97cc-7a20f7b3cb54 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:16:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-412d4c28-3a12-4b17-b7a1-46393d9b5d6d tempest-ServersNegativeTestJSON-29514613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:16:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-412d4c28-3a12-4b17-b7a1-46393d9b5d6d tempest-ServersNegativeTestJSON-29514613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:16:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-412d4c28-3a12-4b17-b7a1-46393d9b5d6d tempest-ServersNegativeTestJSON-29514613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:16:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-412d4c28-3a12-4b17-b7a1-46393d9b5d6d tempest-ServersNegativeTestJSON-29514613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:16:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-412d4c28-3a12-4b17-b7a1-46393d9b5d6d tempest-ServersNegativeTestJSON-29514613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:16:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-412d4c28-3a12-4b17-b7a1-46393d9b5d6d tempest-ServersNegativeTestJSON-29514613 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:16:42 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-412d4c28-3a12-4b17-b7a1-46393d9b5d6d tempest-ServersNegativeTestJSON-29514613 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:16:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-412d4c28-3a12-4b17-b7a1-46393d9b5d6d tempest-ServersNegativeTestJSON-29514613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-670f433b-5994-48d3-97cc-7a20f7b3cb54 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:42 devstack sudo[91472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-670f433b-5994-48d3-97cc-7a20f7b3cb54 1073741824 Jul 07 08:16:42 devstack sudo[91472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-37bbf021-2544-4c11-b398-2a0e4cb10295 req-3e68de99-b7d7-44f3-b61d-2b04d75ec34b tempest-AttachVolumeTestJSON-1669838508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:16:43 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-85403d1d-44f0-47ff-a58f-215358634c38 tempest-AttachVolumeNegativeTest-328651626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:16:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-85403d1d-44f0-47ff-a58f-215358634c38 tempest-AttachVolumeNegativeTest-328651626 None] Flow 'volume_create_manager' (c87ca0b7-2e3b-45f5-b153-c6c6cf6637bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:16:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-85403d1d-44f0-47ff-a58f-215358634c38 tempest-AttachVolumeNegativeTest-328651626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5beb3687-f3aa-4112-bdfe-0dcc645f80db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:16:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-85403d1d-44f0-47ff-a58f-215358634c38 tempest-AttachVolumeNegativeTest-328651626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5beb3687-f3aa-4112-bdfe-0dcc645f80db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:16:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1403971941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f4ae1c5-5e1d-4486-b800-9461bf89032a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3444540d904f436ea41d3b0f1e7efb46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:16:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:16:43Z,use_quota=True,user_id='c39c7aaf7a1347d3b8d2396e3041b4b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:16:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-85403d1d-44f0-47ff-a58f-215358634c38 tempest-AttachVolumeNegativeTest-328651626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b120235-0c6e-4343-a32e-721d684a7be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:16:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-85403d1d-44f0-47ff-a58f-215358634c38 tempest-AttachVolumeNegativeTest-328651626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b120235-0c6e-4343-a32e-721d684a7be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:16:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-85403d1d-44f0-47ff-a58f-215358634c38 tempest-AttachVolumeNegativeTest-328651626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0923816-e507-4526-9553-abfef5e17702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:16:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-85403d1d-44f0-47ff-a58f-215358634c38 tempest-AttachVolumeNegativeTest-328651626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0923816-e507-4526-9553-abfef5e17702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f4ae1c5-5e1d-4486-b800-9461bf89032a', 'volume_name': 'volume-1f4ae1c5-5e1d-4486-b800-9461bf89032a', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:16:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-85403d1d-44f0-47ff-a58f-215358634c38 tempest-AttachVolumeNegativeTest-328651626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1c8025b-9d1a-49d6-901c-ada791e3d2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:16:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-85403d1d-44f0-47ff-a58f-215358634c38 tempest-AttachVolumeNegativeTest-328651626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1c8025b-9d1a-49d6-901c-ada791e3d2a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:16:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-85403d1d-44f0-47ff-a58f-215358634c38 tempest-AttachVolumeNegativeTest-328651626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bc98ee8-0bbf-451a-ac85-31875db8f282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:16:43 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-85403d1d-44f0-47ff-a58f-215358634c38 tempest-AttachVolumeNegativeTest-328651626 None] Volume 1f4ae1c5-5e1d-4486-b800-9461bf89032a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f4ae1c5-5e1d-4486-b800-9461bf89032a', 'volume_size': 1} Jul 07 08:16:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-85403d1d-44f0-47ff-a58f-215358634c38 tempest-AttachVolumeNegativeTest-328651626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:16:43 devstack sudo[91472]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-412d4c28-3a12-4b17-b7a1-46393d9b5d6d tempest-ServersNegativeTestJSON-29514613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-670f433b-5994-48d3-97cc-7a20f7b3cb54 1073741824" returned: 0 in 0.960s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-412d4c28-3a12-4b17-b7a1-46393d9b5d6d tempest-ServersNegativeTestJSON-29514613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-670f433b-5994-48d3-97cc-7a20f7b3cb54 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:43 devstack sudo[91479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-670f433b-5994-48d3-97cc-7a20f7b3cb54 Jul 07 08:16:43 devstack sudo[91479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:44 devstack sudo[91479]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-412d4c28-3a12-4b17-b7a1-46393d9b5d6d tempest-ServersNegativeTestJSON-29514613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-670f433b-5994-48d3-97cc-7a20f7b3cb54" returned: 0 in 0.672s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-412d4c28-3a12-4b17-b7a1-46393d9b5d6d tempest-ServersNegativeTestJSON-29514613 None] <== create_volume: return (1685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:16:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-412d4c28-3a12-4b17-b7a1-46393d9b5d6d tempest-ServersNegativeTestJSON-29514613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.688s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:16:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-37bbf021-2544-4c11-b398-2a0e4cb10295 req-3e68de99-b7d7-44f3-b61d-2b04d75ec34b tempest-AttachVolumeTestJSON-1669838508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.462s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:16:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-412d4c28-3a12-4b17-b7a1-46393d9b5d6d tempest-ServersNegativeTestJSON-29514613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0056f655-d1f0-400a-a52b-cf1dbf5f411a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-670f433b-5994-48d3-97cc-7a20f7b3cb54', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:16:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-412d4c28-3a12-4b17-b7a1-46393d9b5d6d tempest-ServersNegativeTestJSON-29514613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10269f08-b27b-43ae-b7ad-89f7e2c3451f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:16:44 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b82e0e-ce38-4d3e-b2a3-c0730316114e]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:16:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-37bbf021-2544-4c11-b398-2a0e4cb10295 req-3e68de99-b7d7-44f3-b61d-2b04d75ec34b tempest-AttachVolumeTestJSON-1669838508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61b57946-83d4-4109-a18a-c1c7ba193ff0 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:44 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-412d4c28-3a12-4b17-b7a1-46393d9b5d6d tempest-ServersNegativeTestJSON-29514613 None] Volume volume-670f433b-5994-48d3-97cc-7a20f7b3cb54 (670f433b-5994-48d3-97cc-7a20f7b3cb54): created successfully Jul 07 08:16:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-412d4c28-3a12-4b17-b7a1-46393d9b5d6d tempest-ServersNegativeTestJSON-29514613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10269f08-b27b-43ae-b7ad-89f7e2c3451f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:16:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-412d4c28-3a12-4b17-b7a1-46393d9b5d6d tempest-ServersNegativeTestJSON-29514613 None] Flow 'volume_create_manager' (a3a65664-8ad1-40a3-98eb-2917d0762e95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:16:44 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-412d4c28-3a12-4b17-b7a1-46393d9b5d6d tempest-ServersNegativeTestJSON-29514613 None] Created volume successfully. Jul 07 08:16:44 devstack sudo[91482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61b57946-83d4-4109-a18a-c1c7ba193ff0 Jul 07 08:16:44 devstack sudo[91482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:45 devstack sudo[91482]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-37bbf021-2544-4c11-b398-2a0e4cb10295 req-3e68de99-b7d7-44f3-b61d-2b04d75ec34b tempest-AttachVolumeTestJSON-1669838508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61b57946-83d4-4109-a18a-c1c7ba193ff0" returned: 0 in 0.827s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-37bbf021-2544-4c11-b398-2a0e4cb10295 req-3e68de99-b7d7-44f3-b61d-2b04d75ec34b tempest-AttachVolumeTestJSON-1669838508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.853s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:16:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-85403d1d-44f0-47ff-a58f-215358634c38 tempest-AttachVolumeNegativeTest-328651626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.845s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:16:45 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-85403d1d-44f0-47ff-a58f-215358634c38 tempest-AttachVolumeNegativeTest-328651626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:16:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1403971941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f4ae1c5-5e1d-4486-b800-9461bf89032a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3444540d904f436ea41d3b0f1e7efb46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:16:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:16:43Z,use_quota=True,user_id='c39c7aaf7a1347d3b8d2396e3041b4b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:16:45 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-85403d1d-44f0-47ff-a58f-215358634c38 tempest-AttachVolumeNegativeTest-328651626 None] Creating volume 1f4ae1c5-5e1d-4486-b800-9461bf89032a {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:16:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-85403d1d-44f0-47ff-a58f-215358634c38 tempest-AttachVolumeNegativeTest-328651626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:16:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-85403d1d-44f0-47ff-a58f-215358634c38 tempest-AttachVolumeNegativeTest-328651626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:16:45 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-85403d1d-44f0-47ff-a58f-215358634c38 tempest-AttachVolumeNegativeTest-328651626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:16:45 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-85403d1d-44f0-47ff-a58f-215358634c38 tempest-AttachVolumeNegativeTest-328651626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:16:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-85403d1d-44f0-47ff-a58f-215358634c38 tempest-AttachVolumeNegativeTest-328651626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:16:45 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-85403d1d-44f0-47ff-a58f-215358634c38 tempest-AttachVolumeNegativeTest-328651626 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:16:45 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-85403d1d-44f0-47ff-a58f-215358634c38 tempest-AttachVolumeNegativeTest-328651626 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:16:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-85403d1d-44f0-47ff-a58f-215358634c38 tempest-AttachVolumeNegativeTest-328651626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1f4ae1c5-5e1d-4486-b800-9461bf89032a 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:45 devstack sudo[91489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1f4ae1c5-5e1d-4486-b800-9461bf89032a 1073741824 Jul 07 08:16:45 devstack sudo[91489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-37bbf021-2544-4c11-b398-2a0e4cb10295 req-3e68de99-b7d7-44f3-b61d-2b04d75ec34b tempest-AttachVolumeTestJSON-1669838508 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b', 'name': 'volume-61b57946-83d4-4109-a18a-c1c7ba193ff0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bc4ff686-2c84-4937-92ac-3bca646a8f3a', 'enforce_multipath': True} {{(pid=87199) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 08:16:45 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-37bbf021-2544-4c11-b398-2a0e4cb10295 req-3e68de99-b7d7-44f3-b61d-2b04d75ec34b tempest-AttachVolumeTestJSON-1669838508 None] attachment_update completed successfully. Jul 07 08:16:46 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ef9c9df-28dc-46d2-87c2-18f6e24ba243 tempest-ServersNegativeTestJSON-29514613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:16:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6ef9c9df-28dc-46d2-87c2-18f6e24ba243 tempest-ServersNegativeTestJSON-29514613 None] Flow 'volume_create_manager' (335e4b31-b068-40c2-a3e5-e489541c20ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:16:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6ef9c9df-28dc-46d2-87c2-18f6e24ba243 tempest-ServersNegativeTestJSON-29514613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4674a7e-300d-4446-9a8c-0e119538b087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:16:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6ef9c9df-28dc-46d2-87c2-18f6e24ba243 tempest-ServersNegativeTestJSON-29514613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4674a7e-300d-4446-9a8c-0e119538b087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-225768898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02fe8c54-3337-41d6-9b79-a5eb3b7f2646,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a862680ce58497b913123dde46833c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:16:46Z,use_quota=True,user_id='9cd5227bacda47bf928f6b5dd9f029e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:16:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6ef9c9df-28dc-46d2-87c2-18f6e24ba243 tempest-ServersNegativeTestJSON-29514613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddf63a13-438d-414b-ad9a-05ac00d40769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:16:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6ef9c9df-28dc-46d2-87c2-18f6e24ba243 tempest-ServersNegativeTestJSON-29514613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddf63a13-438d-414b-ad9a-05ac00d40769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:16:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6ef9c9df-28dc-46d2-87c2-18f6e24ba243 tempest-ServersNegativeTestJSON-29514613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eb5b79a-98a8-487f-938a-63e79e968949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:16:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6ef9c9df-28dc-46d2-87c2-18f6e24ba243 tempest-ServersNegativeTestJSON-29514613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eb5b79a-98a8-487f-938a-63e79e968949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02fe8c54-3337-41d6-9b79-a5eb3b7f2646', 'volume_name': 'volume-02fe8c54-3337-41d6-9b79-a5eb3b7f2646', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:16:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6ef9c9df-28dc-46d2-87c2-18f6e24ba243 tempest-ServersNegativeTestJSON-29514613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4245d9e9-3d09-4aab-9fd7-0b64dd8979bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:16:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6ef9c9df-28dc-46d2-87c2-18f6e24ba243 tempest-ServersNegativeTestJSON-29514613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4245d9e9-3d09-4aab-9fd7-0b64dd8979bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:16:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6ef9c9df-28dc-46d2-87c2-18f6e24ba243 tempest-ServersNegativeTestJSON-29514613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (548a2c99-2385-44e2-8d00-330fb33749b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:16:46 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-6ef9c9df-28dc-46d2-87c2-18f6e24ba243 tempest-ServersNegativeTestJSON-29514613 None] Volume 02fe8c54-3337-41d6-9b79-a5eb3b7f2646: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02fe8c54-3337-41d6-9b79-a5eb3b7f2646', 'volume_size': 1} Jul 07 08:16:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6ef9c9df-28dc-46d2-87c2-18f6e24ba243 tempest-ServersNegativeTestJSON-29514613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:16:46 devstack sudo[91489]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-85403d1d-44f0-47ff-a58f-215358634c38 tempest-AttachVolumeNegativeTest-328651626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1f4ae1c5-5e1d-4486-b800-9461bf89032a 1073741824" returned: 0 in 1.204s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-85403d1d-44f0-47ff-a58f-215358634c38 tempest-AttachVolumeNegativeTest-328651626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1f4ae1c5-5e1d-4486-b800-9461bf89032a {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:46 devstack sudo[91571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1f4ae1c5-5e1d-4486-b800-9461bf89032a Jul 07 08:16:46 devstack sudo[91571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:47 devstack sudo[91571]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-85403d1d-44f0-47ff-a58f-215358634c38 tempest-AttachVolumeNegativeTest-328651626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1f4ae1c5-5e1d-4486-b800-9461bf89032a" returned: 0 in 0.722s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-85403d1d-44f0-47ff-a58f-215358634c38 tempest-AttachVolumeNegativeTest-328651626 None] <== create_volume: return (1974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:16:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-85403d1d-44f0-47ff-a58f-215358634c38 tempest-AttachVolumeNegativeTest-328651626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.978s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:16:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6ef9c9df-28dc-46d2-87c2-18f6e24ba243 tempest-ServersNegativeTestJSON-29514613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.806s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:16:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6ef9c9df-28dc-46d2-87c2-18f6e24ba243 tempest-ServersNegativeTestJSON-29514613 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-225768898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02fe8c54-3337-41d6-9b79-a5eb3b7f2646,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a862680ce58497b913123dde46833c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:16:46Z,use_quota=True,user_id='9cd5227bacda47bf928f6b5dd9f029e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:16:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-6ef9c9df-28dc-46d2-87c2-18f6e24ba243 tempest-ServersNegativeTestJSON-29514613 None] Creating volume 02fe8c54-3337-41d6-9b79-a5eb3b7f2646 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:16:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6ef9c9df-28dc-46d2-87c2-18f6e24ba243 tempest-ServersNegativeTestJSON-29514613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:16:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6ef9c9df-28dc-46d2-87c2-18f6e24ba243 tempest-ServersNegativeTestJSON-29514613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:16:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6ef9c9df-28dc-46d2-87c2-18f6e24ba243 tempest-ServersNegativeTestJSON-29514613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:16:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6ef9c9df-28dc-46d2-87c2-18f6e24ba243 tempest-ServersNegativeTestJSON-29514613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:16:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6ef9c9df-28dc-46d2-87c2-18f6e24ba243 tempest-ServersNegativeTestJSON-29514613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:16:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6ef9c9df-28dc-46d2-87c2-18f6e24ba243 tempest-ServersNegativeTestJSON-29514613 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:16:47 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-6ef9c9df-28dc-46d2-87c2-18f6e24ba243 tempest-ServersNegativeTestJSON-29514613 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:16:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6ef9c9df-28dc-46d2-87c2-18f6e24ba243 tempest-ServersNegativeTestJSON-29514613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-02fe8c54-3337-41d6-9b79-a5eb3b7f2646 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:47 devstack sudo[91889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-02fe8c54-3337-41d6-9b79-a5eb3b7f2646 1073741824 Jul 07 08:16:47 devstack sudo[91889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-85403d1d-44f0-47ff-a58f-215358634c38 tempest-AttachVolumeNegativeTest-328651626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bc98ee8-0bbf-451a-ac85-31875db8f282) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f4ae1c5-5e1d-4486-b800-9461bf89032a', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:16:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-85403d1d-44f0-47ff-a58f-215358634c38 tempest-AttachVolumeNegativeTest-328651626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e40a095-cc09-43c7-aece-29e5aab2aff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:16:47 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-85403d1d-44f0-47ff-a58f-215358634c38 tempest-AttachVolumeNegativeTest-328651626 None] Volume volume-1f4ae1c5-5e1d-4486-b800-9461bf89032a (1f4ae1c5-5e1d-4486-b800-9461bf89032a): created successfully Jul 07 08:16:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-85403d1d-44f0-47ff-a58f-215358634c38 tempest-AttachVolumeNegativeTest-328651626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e40a095-cc09-43c7-aece-29e5aab2aff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:16:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-85403d1d-44f0-47ff-a58f-215358634c38 tempest-AttachVolumeNegativeTest-328651626 None] Flow 'volume_create_manager' (c87ca0b7-2e3b-45f5-b153-c6c6cf6637bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:16:47 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-85403d1d-44f0-47ff-a58f-215358634c38 tempest-AttachVolumeNegativeTest-328651626 None] Created volume successfully. Jul 07 08:16:48 devstack sudo[91889]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6ef9c9df-28dc-46d2-87c2-18f6e24ba243 tempest-ServersNegativeTestJSON-29514613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-02fe8c54-3337-41d6-9b79-a5eb3b7f2646 1073741824" returned: 0 in 0.902s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6ef9c9df-28dc-46d2-87c2-18f6e24ba243 tempest-ServersNegativeTestJSON-29514613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-02fe8c54-3337-41d6-9b79-a5eb3b7f2646 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:48 devstack sudo[91898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-02fe8c54-3337-41d6-9b79-a5eb3b7f2646 Jul 07 08:16:48 devstack sudo[91898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:48 devstack sudo[91898]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6ef9c9df-28dc-46d2-87c2-18f6e24ba243 tempest-ServersNegativeTestJSON-29514613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-02fe8c54-3337-41d6-9b79-a5eb3b7f2646" returned: 0 in 0.662s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6ef9c9df-28dc-46d2-87c2-18f6e24ba243 tempest-ServersNegativeTestJSON-29514613 None] <== create_volume: return (1600ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:16:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6ef9c9df-28dc-46d2-87c2-18f6e24ba243 tempest-ServersNegativeTestJSON-29514613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.604s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:16:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6ef9c9df-28dc-46d2-87c2-18f6e24ba243 tempest-ServersNegativeTestJSON-29514613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (548a2c99-2385-44e2-8d00-330fb33749b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02fe8c54-3337-41d6-9b79-a5eb3b7f2646', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:16:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6ef9c9df-28dc-46d2-87c2-18f6e24ba243 tempest-ServersNegativeTestJSON-29514613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55988ff4-3482-4bd4-bdb8-349098174bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:16:48 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-6ef9c9df-28dc-46d2-87c2-18f6e24ba243 tempest-ServersNegativeTestJSON-29514613 None] Volume volume-02fe8c54-3337-41d6-9b79-a5eb3b7f2646 (02fe8c54-3337-41d6-9b79-a5eb3b7f2646): created successfully Jul 07 08:16:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6ef9c9df-28dc-46d2-87c2-18f6e24ba243 tempest-ServersNegativeTestJSON-29514613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55988ff4-3482-4bd4-bdb8-349098174bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:16:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6ef9c9df-28dc-46d2-87c2-18f6e24ba243 tempest-ServersNegativeTestJSON-29514613 None] Flow 'volume_create_manager' (335e4b31-b068-40c2-a3e5-e489541c20ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:16:48 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-6ef9c9df-28dc-46d2-87c2-18f6e24ba243 tempest-ServersNegativeTestJSON-29514613 None] Created volume successfully. Jul 07 08:16:49 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-06aeece3-e05f-489a-954b-317862833f87 tempest-ServersNegativeTestJSON-29514613 None] Acquiring lock "cinder-02fe8c54-3337-41d6-9b79-a5eb3b7f2646-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:16:49 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-06aeece3-e05f-489a-954b-317862833f87 tempest-ServersNegativeTestJSON-29514613 None] Lock "cinder-02fe8c54-3337-41d6-9b79-a5eb3b7f2646-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:16:49 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-06aeece3-e05f-489a-954b-317862833f87 tempest-ServersNegativeTestJSON-29514613 None] Acquiring lock "cinder-quobyte-02fe8c54-3337-41d6-9b79-a5eb3b7f2646" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:16:49 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-06aeece3-e05f-489a-954b-317862833f87 tempest-ServersNegativeTestJSON-29514613 None] Lock "cinder-quobyte-02fe8c54-3337-41d6-9b79-a5eb3b7f2646" acquired by "delete_volume" :: waited 0.022s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:16:49 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[6216aa3f-e31b-4baf-b668-27a23b29bb9b]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:16:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-06aeece3-e05f-489a-954b-317862833f87 tempest-ServersNegativeTestJSON-29514613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-02fe8c54-3337-41d6-9b79-a5eb3b7f2646 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:49 devstack sudo[91902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-02fe8c54-3337-41d6-9b79-a5eb3b7f2646 Jul 07 08:16:49 devstack sudo[91902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:50 devstack sudo[91902]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-06aeece3-e05f-489a-954b-317862833f87 tempest-ServersNegativeTestJSON-29514613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-02fe8c54-3337-41d6-9b79-a5eb3b7f2646" returned: 0 in 0.917s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-06aeece3-e05f-489a-954b-317862833f87 tempest-ServersNegativeTestJSON-29514613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-02fe8c54-3337-41d6-9b79-a5eb3b7f2646 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:50 devstack sudo[91918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-02fe8c54-3337-41d6-9b79-a5eb3b7f2646 Jul 07 08:16:50 devstack sudo[91918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-60b5468b-75c4-4d7e-8b69-fa48b2b15ba6 req-30980419-f0a4-4204-a434-a0922a4d51c3 tempest-AttachVolumeNegativeTest-328651626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:16:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-60b5468b-75c4-4d7e-8b69-fa48b2b15ba6 req-30980419-f0a4-4204-a434-a0922a4d51c3 tempest-AttachVolumeNegativeTest-328651626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:16:50 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[956d0a2c-2166-4afa-b8e0-842ea0df55a5]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:16:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-60b5468b-75c4-4d7e-8b69-fa48b2b15ba6 req-30980419-f0a4-4204-a434-a0922a4d51c3 tempest-AttachVolumeNegativeTest-328651626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1f4ae1c5-5e1d-4486-b800-9461bf89032a {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:50 devstack sudo[91920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1f4ae1c5-5e1d-4486-b800-9461bf89032a Jul 07 08:16:50 devstack sudo[91920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:51 devstack sudo[91918]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-06aeece3-e05f-489a-954b-317862833f87 tempest-ServersNegativeTestJSON-29514613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-02fe8c54-3337-41d6-9b79-a5eb3b7f2646" returned: 0 in 0.972s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:51 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-06aeece3-e05f-489a-954b-317862833f87 tempest-ServersNegativeTestJSON-29514613 None] Lock "cinder-quobyte-02fe8c54-3337-41d6-9b79-a5eb3b7f2646" released by "delete_volume" :: held 1.947s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:16:51 devstack sudo[91920]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-60b5468b-75c4-4d7e-8b69-fa48b2b15ba6 req-30980419-f0a4-4204-a434-a0922a4d51c3 tempest-AttachVolumeNegativeTest-328651626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1f4ae1c5-5e1d-4486-b800-9461bf89032a" returned: 0 in 0.900s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-60b5468b-75c4-4d7e-8b69-fa48b2b15ba6 req-30980419-f0a4-4204-a434-a0922a4d51c3 tempest-AttachVolumeNegativeTest-328651626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.958s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:16:51 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-06aeece3-e05f-489a-954b-317862833f87 tempest-ServersNegativeTestJSON-29514613 None] Created reservations ['1aabcfb9-5c41-47bf-b2b1-dab6e157dca7', '99ad4cb4-1483-44a2-924d-01f28185ff37', 'cea2db15-3286-4f06-ae51-4ec590908c7b', '392ebd38-a6a4-42c8-8a5e-579c9c5512b3'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:16:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-60b5468b-75c4-4d7e-8b69-fa48b2b15ba6 req-30980419-f0a4-4204-a434-a0922a4d51c3 tempest-AttachVolumeNegativeTest-328651626 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b', 'name': 'volume-1f4ae1c5-5e1d-4486-b800-9461bf89032a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '20671371-f4bd-4002-b93c-a828d8e8dd54', 'enforce_multipath': True} {{(pid=87199) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 08:16:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-06aeece3-e05f-489a-954b-317862833f87 tempest-ServersNegativeTestJSON-29514613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:16:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-06aeece3-e05f-489a-954b-317862833f87 tempest-ServersNegativeTestJSON-29514613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:16:51 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-06aeece3-e05f-489a-954b-317862833f87 tempest-ServersNegativeTestJSON-29514613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:16:51 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-06aeece3-e05f-489a-954b-317862833f87 tempest-ServersNegativeTestJSON-29514613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:16:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-06aeece3-e05f-489a-954b-317862833f87 tempest-ServersNegativeTestJSON-29514613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:16:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-06aeece3-e05f-489a-954b-317862833f87 tempest-ServersNegativeTestJSON-29514613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:51 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-60b5468b-75c4-4d7e-8b69-fa48b2b15ba6 req-30980419-f0a4-4204-a434-a0922a4d51c3 tempest-AttachVolumeNegativeTest-328651626 None] attachment_update completed successfully. Jul 07 08:16:51 devstack sudo[91927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:16:51 devstack sudo[91927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:51 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-260283c8-8b07-4da6-b512-9fa1795ad2ee tempest-ServersNegativeTestJSON-29514613 None] Acquiring lock "cinder-670f433b-5994-48d3-97cc-7a20f7b3cb54-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:16:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-260283c8-8b07-4da6-b512-9fa1795ad2ee tempest-ServersNegativeTestJSON-29514613 None] Lock "cinder-670f433b-5994-48d3-97cc-7a20f7b3cb54-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:16:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-260283c8-8b07-4da6-b512-9fa1795ad2ee tempest-ServersNegativeTestJSON-29514613 None] Acquiring lock "cinder-quobyte-670f433b-5994-48d3-97cc-7a20f7b3cb54" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:16:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-260283c8-8b07-4da6-b512-9fa1795ad2ee tempest-ServersNegativeTestJSON-29514613 None] Lock "cinder-quobyte-670f433b-5994-48d3-97cc-7a20f7b3cb54" acquired by "delete_volume" :: waited 0.025s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:16:52 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd75f82-6eee-4b6d-a2b2-6d9be03f9f7c]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:16:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-260283c8-8b07-4da6-b512-9fa1795ad2ee tempest-ServersNegativeTestJSON-29514613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-670f433b-5994-48d3-97cc-7a20f7b3cb54 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:52 devstack sudo[91935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-670f433b-5994-48d3-97cc-7a20f7b3cb54 Jul 07 08:16:52 devstack sudo[91935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:52 devstack sudo[91927]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-06aeece3-e05f-489a-954b-317862833f87 tempest-ServersNegativeTestJSON-29514613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.924s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:52 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-06aeece3-e05f-489a-954b-317862833f87 tempest-ServersNegativeTestJSON-29514613 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:16:52 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-06aeece3-e05f-489a-954b-317862833f87 tempest-ServersNegativeTestJSON-29514613 None] Deleted volume successfully. Jul 07 08:16:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-06aeece3-e05f-489a-954b-317862833f87 tempest-ServersNegativeTestJSON-29514613 None] Lock "cinder-02fe8c54-3337-41d6-9b79-a5eb3b7f2646-delete_volume" released by "delete_volume" :: held 3.173s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:16:53 devstack sudo[91935]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-260283c8-8b07-4da6-b512-9fa1795ad2ee tempest-ServersNegativeTestJSON-29514613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-670f433b-5994-48d3-97cc-7a20f7b3cb54" returned: 0 in 1.042s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-260283c8-8b07-4da6-b512-9fa1795ad2ee tempest-ServersNegativeTestJSON-29514613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-670f433b-5994-48d3-97cc-7a20f7b3cb54 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:53 devstack sudo[91961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-670f433b-5994-48d3-97cc-7a20f7b3cb54 Jul 07 08:16:53 devstack sudo[91961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:53 devstack sudo[91961]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-260283c8-8b07-4da6-b512-9fa1795ad2ee tempest-ServersNegativeTestJSON-29514613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-670f433b-5994-48d3-97cc-7a20f7b3cb54" returned: 0 in 0.710s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:53 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-260283c8-8b07-4da6-b512-9fa1795ad2ee tempest-ServersNegativeTestJSON-29514613 None] Lock "cinder-quobyte-670f433b-5994-48d3-97cc-7a20f7b3cb54" released by "delete_volume" :: held 1.802s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:16:53 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-260283c8-8b07-4da6-b512-9fa1795ad2ee tempest-ServersNegativeTestJSON-29514613 None] Created reservations ['1e70e64c-268e-4788-b20a-a7f5b2e1f6bd', 'ffc74cdf-4e97-4dec-818f-7010fa4890fc', 'fe1c106f-d89f-4d9f-acd7-c35e04f0b075', 'fb138c11-efc7-4d27-bd65-995b3eecfb59'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:16:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-260283c8-8b07-4da6-b512-9fa1795ad2ee tempest-ServersNegativeTestJSON-29514613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:16:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-260283c8-8b07-4da6-b512-9fa1795ad2ee tempest-ServersNegativeTestJSON-29514613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:16:54 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-260283c8-8b07-4da6-b512-9fa1795ad2ee tempest-ServersNegativeTestJSON-29514613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:16:54 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-260283c8-8b07-4da6-b512-9fa1795ad2ee tempest-ServersNegativeTestJSON-29514613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:16:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-260283c8-8b07-4da6-b512-9fa1795ad2ee tempest-ServersNegativeTestJSON-29514613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:16:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-260283c8-8b07-4da6-b512-9fa1795ad2ee tempest-ServersNegativeTestJSON-29514613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:54 devstack sudo[91965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:16:54 devstack sudo[91965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:54 devstack sudo[91965]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-260283c8-8b07-4da6-b512-9fa1795ad2ee tempest-ServersNegativeTestJSON-29514613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.755s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:54 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-260283c8-8b07-4da6-b512-9fa1795ad2ee tempest-ServersNegativeTestJSON-29514613 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:16:54 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-260283c8-8b07-4da6-b512-9fa1795ad2ee tempest-ServersNegativeTestJSON-29514613 None] Deleted volume successfully. Jul 07 08:16:54 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-260283c8-8b07-4da6-b512-9fa1795ad2ee tempest-ServersNegativeTestJSON-29514613 None] Lock "cinder-670f433b-5994-48d3-97cc-7a20f7b3cb54-delete_volume" released by "delete_volume" :: held 2.814s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:16:58 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-9a8cceca-5e70-4bac-81c0-03ba8125e38f req-7ad28c19-cee6-4e9a-a541-99062571a8b6 tempest-AttachVolumeNegativeTest-328651626 None] Terminate volume connection completed successfully. Jul 07 08:16:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-9a8cceca-5e70-4bac-81c0-03ba8125e38f req-7ad28c19-cee6-4e9a-a541-99062571a8b6 tempest-AttachVolumeNegativeTest-328651626 None] Deleting attachment 20671371-f4bd-4002-b93c-a828d8e8dd54. {{(pid=87199) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 08:17:04 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:UPDATE=31,cinder:DELETE=1,cinder:SELECT=29,cinder:INSERT=6 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:17:05 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:17:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:17:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:17:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:17:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:17:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:17:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:05 devstack sudo[92590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:17:05 devstack sudo[92590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:07 devstack sudo[92590]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 1.684s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:07 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:17:07 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running periodic task VolumeManager._thread_info {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:17:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] thread count: 8 {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 08:17:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] thread info: [<_MainThread(MainThread, started 133056092332160)>, , , , , , , ] {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 08:17:08 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=31,cinder:UPDATE=31,cinder:INSERT=6,cinder:DELETE=5 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:17:11 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8243c044-6c2d-4375-a31a-3f836829197b tempest-AttachVolumeNegativeTest-328651626 None] Acquiring lock "cinder-1f4ae1c5-5e1d-4486-b800-9461bf89032a-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:17:11 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8243c044-6c2d-4375-a31a-3f836829197b tempest-AttachVolumeNegativeTest-328651626 None] Lock "cinder-1f4ae1c5-5e1d-4486-b800-9461bf89032a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:17:11 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8243c044-6c2d-4375-a31a-3f836829197b tempest-AttachVolumeNegativeTest-328651626 None] Acquiring lock "cinder-quobyte-1f4ae1c5-5e1d-4486-b800-9461bf89032a" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:17:12 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8243c044-6c2d-4375-a31a-3f836829197b tempest-AttachVolumeNegativeTest-328651626 None] Lock "cinder-quobyte-1f4ae1c5-5e1d-4486-b800-9461bf89032a" acquired by "delete_volume" :: waited 0.033s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:17:12 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54711aa-d46d-405a-bf13-f1028d0a6725]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:17:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8243c044-6c2d-4375-a31a-3f836829197b tempest-AttachVolumeNegativeTest-328651626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1f4ae1c5-5e1d-4486-b800-9461bf89032a {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:12 devstack sudo[92621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1f4ae1c5-5e1d-4486-b800-9461bf89032a Jul 07 08:17:12 devstack sudo[92621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:12 devstack sudo[92621]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8243c044-6c2d-4375-a31a-3f836829197b tempest-AttachVolumeNegativeTest-328651626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1f4ae1c5-5e1d-4486-b800-9461bf89032a" returned: 0 in 0.860s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8243c044-6c2d-4375-a31a-3f836829197b tempest-AttachVolumeNegativeTest-328651626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1f4ae1c5-5e1d-4486-b800-9461bf89032a {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:12 devstack sudo[92626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1f4ae1c5-5e1d-4486-b800-9461bf89032a Jul 07 08:17:12 devstack sudo[92626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:13 devstack sudo[92626]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8243c044-6c2d-4375-a31a-3f836829197b tempest-AttachVolumeNegativeTest-328651626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1f4ae1c5-5e1d-4486-b800-9461bf89032a" returned: 0 in 0.676s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:13 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8243c044-6c2d-4375-a31a-3f836829197b tempest-AttachVolumeNegativeTest-328651626 None] Lock "cinder-quobyte-1f4ae1c5-5e1d-4486-b800-9461bf89032a" released by "delete_volume" :: held 1.619s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:17:13 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-8243c044-6c2d-4375-a31a-3f836829197b tempest-AttachVolumeNegativeTest-328651626 None] Created reservations ['bed035f8-54e5-4712-8acf-69c7bbf64d46', '27d986ec-1292-4bb4-bf3b-2c9da8af6bfa', '32e1ce93-e5c2-441f-90ca-d662790c2b25', '220dde18-cb69-4577-a7c2-33ff5ec4f064'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:17:13 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [req-6e78e0cf-8097-4836-87b8-16650da0c280 req-76b46738-3238-405c-96fa-6d0fa7a3d19d tempest-VolumesGetTestJSON-982652735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:17:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-6e78e0cf-8097-4836-87b8-16650da0c280 req-76b46738-3238-405c-96fa-6d0fa7a3d19d tempest-VolumesGetTestJSON-982652735 None] Flow 'volume_create_manager' (f9443d1d-a2aa-473b-9bea-0670b239afd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:17:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-6e78e0cf-8097-4836-87b8-16650da0c280 req-76b46738-3238-405c-96fa-6d0fa7a3d19d tempest-VolumesGetTestJSON-982652735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62e1b45a-785f-40ab-8a6a-bc147f9b6b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-6e78e0cf-8097-4836-87b8-16650da0c280 req-76b46738-3238-405c-96fa-6d0fa7a3d19d tempest-VolumesGetTestJSON-982652735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62e1b45a-785f-40ab-8a6a-bc147f9b6b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:17:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-933662543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=563be2fe-4cf9-4d66-8830-58f86acd51af,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e36a7358035b4bd38fbbf316ab8094a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:17:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:17:14Z,use_quota=True,user_id='19fc1fe5f3fb4cafafec4d0edd176286',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-6e78e0cf-8097-4836-87b8-16650da0c280 req-76b46738-3238-405c-96fa-6d0fa7a3d19d tempest-VolumesGetTestJSON-982652735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c050d42-b89b-441e-9aac-61b0a647a6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-6e78e0cf-8097-4836-87b8-16650da0c280 req-76b46738-3238-405c-96fa-6d0fa7a3d19d tempest-VolumesGetTestJSON-982652735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c050d42-b89b-441e-9aac-61b0a647a6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-6e78e0cf-8097-4836-87b8-16650da0c280 req-76b46738-3238-405c-96fa-6d0fa7a3d19d tempest-VolumesGetTestJSON-982652735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6370fc18-66a3-493a-b33a-f751f277bc36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-6e78e0cf-8097-4836-87b8-16650da0c280 req-76b46738-3238-405c-96fa-6d0fa7a3d19d tempest-VolumesGetTestJSON-982652735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6370fc18-66a3-493a-b33a-f751f277bc36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '563be2fe-4cf9-4d66-8830-58f86acd51af', 'volume_name': 'volume-563be2fe-4cf9-4d66-8830-58f86acd51af', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-6e78e0cf-8097-4836-87b8-16650da0c280 req-76b46738-3238-405c-96fa-6d0fa7a3d19d tempest-VolumesGetTestJSON-982652735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea95cd71-111b-451f-8781-27598fdf62e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-6e78e0cf-8097-4836-87b8-16650da0c280 req-76b46738-3238-405c-96fa-6d0fa7a3d19d tempest-VolumesGetTestJSON-982652735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea95cd71-111b-451f-8781-27598fdf62e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-6e78e0cf-8097-4836-87b8-16650da0c280 req-76b46738-3238-405c-96fa-6d0fa7a3d19d tempest-VolumesGetTestJSON-982652735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ac2e06e-c5f6-4b45-a9a0-1d1718d1e7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:13 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [req-6e78e0cf-8097-4836-87b8-16650da0c280 req-76b46738-3238-405c-96fa-6d0fa7a3d19d tempest-VolumesGetTestJSON-982652735 None] Volume 563be2fe-4cf9-4d66-8830-58f86acd51af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-563be2fe-4cf9-4d66-8830-58f86acd51af', 'volume_size': 1} Jul 07 08:17:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-6e78e0cf-8097-4836-87b8-16650da0c280 req-76b46738-3238-405c-96fa-6d0fa7a3d19d tempest-VolumesGetTestJSON-982652735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:17:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-6e78e0cf-8097-4836-87b8-16650da0c280 req-76b46738-3238-405c-96fa-6d0fa7a3d19d tempest-VolumesGetTestJSON-982652735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:17:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [req-6e78e0cf-8097-4836-87b8-16650da0c280 req-76b46738-3238-405c-96fa-6d0fa7a3d19d tempest-VolumesGetTestJSON-982652735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:17:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-933662543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=563be2fe-4cf9-4d66-8830-58f86acd51af,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e36a7358035b4bd38fbbf316ab8094a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:17:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:17:14Z,use_quota=True,user_id='19fc1fe5f3fb4cafafec4d0edd176286',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:17:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [req-6e78e0cf-8097-4836-87b8-16650da0c280 req-76b46738-3238-405c-96fa-6d0fa7a3d19d tempest-VolumesGetTestJSON-982652735 None] Creating volume 563be2fe-4cf9-4d66-8830-58f86acd51af {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:17:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-6e78e0cf-8097-4836-87b8-16650da0c280 req-76b46738-3238-405c-96fa-6d0fa7a3d19d tempest-VolumesGetTestJSON-982652735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:17:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-6e78e0cf-8097-4836-87b8-16650da0c280 req-76b46738-3238-405c-96fa-6d0fa7a3d19d tempest-VolumesGetTestJSON-982652735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:17:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [req-6e78e0cf-8097-4836-87b8-16650da0c280 req-76b46738-3238-405c-96fa-6d0fa7a3d19d tempest-VolumesGetTestJSON-982652735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:17:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [req-6e78e0cf-8097-4836-87b8-16650da0c280 req-76b46738-3238-405c-96fa-6d0fa7a3d19d tempest-VolumesGetTestJSON-982652735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:17:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-6e78e0cf-8097-4836-87b8-16650da0c280 req-76b46738-3238-405c-96fa-6d0fa7a3d19d tempest-VolumesGetTestJSON-982652735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:17:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [req-6e78e0cf-8097-4836-87b8-16650da0c280 req-76b46738-3238-405c-96fa-6d0fa7a3d19d tempest-VolumesGetTestJSON-982652735 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:17:13 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [req-6e78e0cf-8097-4836-87b8-16650da0c280 req-76b46738-3238-405c-96fa-6d0fa7a3d19d tempest-VolumesGetTestJSON-982652735 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:17:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-6e78e0cf-8097-4836-87b8-16650da0c280 req-76b46738-3238-405c-96fa-6d0fa7a3d19d tempest-VolumesGetTestJSON-982652735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-563be2fe-4cf9-4d66-8830-58f86acd51af 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8243c044-6c2d-4375-a31a-3f836829197b tempest-AttachVolumeNegativeTest-328651626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:17:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8243c044-6c2d-4375-a31a-3f836829197b tempest-AttachVolumeNegativeTest-328651626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:17:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8243c044-6c2d-4375-a31a-3f836829197b tempest-AttachVolumeNegativeTest-328651626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:17:13 devstack sudo[92629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-563be2fe-4cf9-4d66-8830-58f86acd51af 1073741824 Jul 07 08:17:13 devstack sudo[92629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8243c044-6c2d-4375-a31a-3f836829197b tempest-AttachVolumeNegativeTest-328651626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:17:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8243c044-6c2d-4375-a31a-3f836829197b tempest-AttachVolumeNegativeTest-328651626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:17:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8243c044-6c2d-4375-a31a-3f836829197b tempest-AttachVolumeNegativeTest-328651626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:13 devstack sudo[92631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:17:13 devstack sudo[92631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:14 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e2298571-e83f-4787-b3f0-7fd70c14c250 tempest-AttachVolumeNegativeTest-328651626 None] Acquiring lock "cinder-00fdc747-25e0-433c-bc3f-47daf94b3668-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:17:14 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e2298571-e83f-4787-b3f0-7fd70c14c250 tempest-AttachVolumeNegativeTest-328651626 None] Lock "cinder-00fdc747-25e0-433c-bc3f-47daf94b3668-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:17:14 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e2298571-e83f-4787-b3f0-7fd70c14c250 tempest-AttachVolumeNegativeTest-328651626 None] Acquiring lock "cinder-quobyte-00fdc747-25e0-433c-bc3f-47daf94b3668" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:17:14 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e2298571-e83f-4787-b3f0-7fd70c14c250 tempest-AttachVolumeNegativeTest-328651626 None] Lock "cinder-quobyte-00fdc747-25e0-433c-bc3f-47daf94b3668" acquired by "delete_volume" :: waited 0.025s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:17:14 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[602e886b-bf26-4932-91b0-412e0952d36a]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:17:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e2298571-e83f-4787-b3f0-7fd70c14c250 tempest-AttachVolumeNegativeTest-328651626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-00fdc747-25e0-433c-bc3f-47daf94b3668 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:14 devstack sudo[92633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-00fdc747-25e0-433c-bc3f-47daf94b3668 Jul 07 08:17:14 devstack sudo[92633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:14 devstack sudo[92631]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8243c044-6c2d-4375-a31a-3f836829197b tempest-AttachVolumeNegativeTest-328651626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.872s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:14 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-8243c044-6c2d-4375-a31a-3f836829197b tempest-AttachVolumeNegativeTest-328651626 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:17:14 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-8243c044-6c2d-4375-a31a-3f836829197b tempest-AttachVolumeNegativeTest-328651626 None] Deleted volume successfully. Jul 07 08:17:14 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8243c044-6c2d-4375-a31a-3f836829197b tempest-AttachVolumeNegativeTest-328651626 None] Lock "cinder-1f4ae1c5-5e1d-4486-b800-9461bf89032a-delete_volume" released by "delete_volume" :: held 2.924s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:17:15 devstack sudo[92629]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-6e78e0cf-8097-4836-87b8-16650da0c280 req-76b46738-3238-405c-96fa-6d0fa7a3d19d tempest-VolumesGetTestJSON-982652735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-563be2fe-4cf9-4d66-8830-58f86acd51af 1073741824" returned: 0 in 1.141s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-6e78e0cf-8097-4836-87b8-16650da0c280 req-76b46738-3238-405c-96fa-6d0fa7a3d19d tempest-VolumesGetTestJSON-982652735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-563be2fe-4cf9-4d66-8830-58f86acd51af {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:15 devstack sudo[92640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-563be2fe-4cf9-4d66-8830-58f86acd51af Jul 07 08:17:15 devstack sudo[92640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:15 devstack sudo[92633]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e2298571-e83f-4787-b3f0-7fd70c14c250 tempest-AttachVolumeNegativeTest-328651626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-00fdc747-25e0-433c-bc3f-47daf94b3668" returned: 0 in 0.924s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e2298571-e83f-4787-b3f0-7fd70c14c250 tempest-AttachVolumeNegativeTest-328651626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-00fdc747-25e0-433c-bc3f-47daf94b3668 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:15 devstack sudo[92646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-00fdc747-25e0-433c-bc3f-47daf94b3668 Jul 07 08:17:15 devstack sudo[92646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:15 devstack sudo[92640]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-6e78e0cf-8097-4836-87b8-16650da0c280 req-76b46738-3238-405c-96fa-6d0fa7a3d19d tempest-VolumesGetTestJSON-982652735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-563be2fe-4cf9-4d66-8830-58f86acd51af" returned: 0 in 0.639s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [req-6e78e0cf-8097-4836-87b8-16650da0c280 req-76b46738-3238-405c-96fa-6d0fa7a3d19d tempest-VolumesGetTestJSON-982652735 None] <== create_volume: return (1826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:17:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-6e78e0cf-8097-4836-87b8-16650da0c280 req-76b46738-3238-405c-96fa-6d0fa7a3d19d tempest-VolumesGetTestJSON-982652735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.829s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:17:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-6e78e0cf-8097-4836-87b8-16650da0c280 req-76b46738-3238-405c-96fa-6d0fa7a3d19d tempest-VolumesGetTestJSON-982652735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ac2e06e-c5f6-4b45-a9a0-1d1718d1e7bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-563be2fe-4cf9-4d66-8830-58f86acd51af', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-6e78e0cf-8097-4836-87b8-16650da0c280 req-76b46738-3238-405c-96fa-6d0fa7a3d19d tempest-VolumesGetTestJSON-982652735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3ff2e72-c27d-4dbd-9f66-a81dfe01be58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:15 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [req-6e78e0cf-8097-4836-87b8-16650da0c280 req-76b46738-3238-405c-96fa-6d0fa7a3d19d tempest-VolumesGetTestJSON-982652735 None] Volume volume-563be2fe-4cf9-4d66-8830-58f86acd51af (563be2fe-4cf9-4d66-8830-58f86acd51af): created successfully Jul 07 08:17:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-6e78e0cf-8097-4836-87b8-16650da0c280 req-76b46738-3238-405c-96fa-6d0fa7a3d19d tempest-VolumesGetTestJSON-982652735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3ff2e72-c27d-4dbd-9f66-a81dfe01be58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-6e78e0cf-8097-4836-87b8-16650da0c280 req-76b46738-3238-405c-96fa-6d0fa7a3d19d tempest-VolumesGetTestJSON-982652735 None] Flow 'volume_create_manager' (f9443d1d-a2aa-473b-9bea-0670b239afd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:17:15 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-6e78e0cf-8097-4836-87b8-16650da0c280 req-76b46738-3238-405c-96fa-6d0fa7a3d19d tempest-VolumesGetTestJSON-982652735 None] Created volume successfully. Jul 07 08:17:16 devstack cinder-volume[87199]: DEBUG cinder.coordination [req-7a205a86-4d3c-4572-b71b-dedf3167f156 req-2606cc64-961d-4642-abf1-8a979962b725 tempest-VolumesGetTestJSON-982652735 None] Acquiring lock "cinder-563be2fe-4cf9-4d66-8830-58f86acd51af-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:17:16 devstack sudo[92646]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e2298571-e83f-4787-b3f0-7fd70c14c250 tempest-AttachVolumeNegativeTest-328651626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-00fdc747-25e0-433c-bc3f-47daf94b3668" returned: 0 in 0.753s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:16 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e2298571-e83f-4787-b3f0-7fd70c14c250 tempest-AttachVolumeNegativeTest-328651626 None] Lock "cinder-quobyte-00fdc747-25e0-433c-bc3f-47daf94b3668" released by "delete_volume" :: held 1.747s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:17:16 devstack cinder-volume[87199]: DEBUG cinder.coordination [req-7a205a86-4d3c-4572-b71b-dedf3167f156 req-2606cc64-961d-4642-abf1-8a979962b725 tempest-VolumesGetTestJSON-982652735 None] Lock "cinder-563be2fe-4cf9-4d66-8830-58f86acd51af-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:17:16 devstack cinder-volume[87199]: DEBUG cinder.coordination [req-7a205a86-4d3c-4572-b71b-dedf3167f156 req-2606cc64-961d-4642-abf1-8a979962b725 tempest-VolumesGetTestJSON-982652735 None] Acquiring lock "cinder-quobyte-563be2fe-4cf9-4d66-8830-58f86acd51af" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:17:16 devstack cinder-volume[87199]: DEBUG cinder.coordination [req-7a205a86-4d3c-4572-b71b-dedf3167f156 req-2606cc64-961d-4642-abf1-8a979962b725 tempest-VolumesGetTestJSON-982652735 None] Lock "cinder-quobyte-563be2fe-4cf9-4d66-8830-58f86acd51af" acquired by "delete_volume" :: waited 0.022s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:17:16 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-e2298571-e83f-4787-b3f0-7fd70c14c250 tempest-AttachVolumeNegativeTest-328651626 None] Created reservations ['f4d02f10-29c3-420d-b6f1-048905eaa6e8', '2775e741-fc8c-4ff8-a809-5f55a0a1b6e6', 'f0177e2e-e7a7-44ce-b59e-ac95b31969c1', 'ba2ea55a-7d89-4e64-b359-923bd5e591ca'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:17:16 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4118c98-7e30-4f21-aefb-b205cc624d5b]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:17:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-7a205a86-4d3c-4572-b71b-dedf3167f156 req-2606cc64-961d-4642-abf1-8a979962b725 tempest-VolumesGetTestJSON-982652735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-563be2fe-4cf9-4d66-8830-58f86acd51af {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e2298571-e83f-4787-b3f0-7fd70c14c250 tempest-AttachVolumeNegativeTest-328651626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:17:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e2298571-e83f-4787-b3f0-7fd70c14c250 tempest-AttachVolumeNegativeTest-328651626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:17:16 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e2298571-e83f-4787-b3f0-7fd70c14c250 tempest-AttachVolumeNegativeTest-328651626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:17:16 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e2298571-e83f-4787-b3f0-7fd70c14c250 tempest-AttachVolumeNegativeTest-328651626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:17:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e2298571-e83f-4787-b3f0-7fd70c14c250 tempest-AttachVolumeNegativeTest-328651626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:17:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e2298571-e83f-4787-b3f0-7fd70c14c250 tempest-AttachVolumeNegativeTest-328651626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:16 devstack sudo[92650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-563be2fe-4cf9-4d66-8830-58f86acd51af Jul 07 08:17:16 devstack sudo[92651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:17:16 devstack sudo[92651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:16 devstack sudo[92650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:16 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f5046b0d-8893-49c9-a714-f97772a2096e tempest-AttachVolumeNegativeTest-328651626 None] Acquiring lock "cinder-cb73b43b-a8ea-4b8a-8af6-6cbf80a64688-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:17:16 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f5046b0d-8893-49c9-a714-f97772a2096e tempest-AttachVolumeNegativeTest-328651626 None] Lock "cinder-cb73b43b-a8ea-4b8a-8af6-6cbf80a64688-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:17:16 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f5046b0d-8893-49c9-a714-f97772a2096e tempest-AttachVolumeNegativeTest-328651626 None] Acquiring lock "cinder-quobyte-cb73b43b-a8ea-4b8a-8af6-6cbf80a64688" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:17:16 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f5046b0d-8893-49c9-a714-f97772a2096e tempest-AttachVolumeNegativeTest-328651626 None] Lock "cinder-quobyte-cb73b43b-a8ea-4b8a-8af6-6cbf80a64688" acquired by "delete_volume" :: waited 0.022s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:17:16 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e02693a-94ae-4311-a9e1-6032780a57d7]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:17:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f5046b0d-8893-49c9-a714-f97772a2096e tempest-AttachVolumeNegativeTest-328651626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cb73b43b-a8ea-4b8a-8af6-6cbf80a64688 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:17 devstack sudo[92654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cb73b43b-a8ea-4b8a-8af6-6cbf80a64688 Jul 07 08:17:17 devstack sudo[92654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:17 devstack sudo[92651]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e2298571-e83f-4787-b3f0-7fd70c14c250 tempest-AttachVolumeNegativeTest-328651626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.868s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:17 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-e2298571-e83f-4787-b3f0-7fd70c14c250 tempest-AttachVolumeNegativeTest-328651626 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:17:17 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-e2298571-e83f-4787-b3f0-7fd70c14c250 tempest-AttachVolumeNegativeTest-328651626 None] Deleted volume successfully. Jul 07 08:17:17 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e2298571-e83f-4787-b3f0-7fd70c14c250 tempest-AttachVolumeNegativeTest-328651626 None] Lock "cinder-00fdc747-25e0-433c-bc3f-47daf94b3668-delete_volume" released by "delete_volume" :: held 2.978s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:17:17 devstack sudo[92650]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-7a205a86-4d3c-4572-b71b-dedf3167f156 req-2606cc64-961d-4642-abf1-8a979962b725 tempest-VolumesGetTestJSON-982652735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-563be2fe-4cf9-4d66-8830-58f86acd51af" returned: 0 in 1.092s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-7a205a86-4d3c-4572-b71b-dedf3167f156 req-2606cc64-961d-4642-abf1-8a979962b725 tempest-VolumesGetTestJSON-982652735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-563be2fe-4cf9-4d66-8830-58f86acd51af {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:17 devstack sudo[92661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-563be2fe-4cf9-4d66-8830-58f86acd51af Jul 07 08:17:17 devstack sudo[92661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:17 devstack sudo[92654]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f5046b0d-8893-49c9-a714-f97772a2096e tempest-AttachVolumeNegativeTest-328651626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cb73b43b-a8ea-4b8a-8af6-6cbf80a64688" returned: 0 in 0.822s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f5046b0d-8893-49c9-a714-f97772a2096e tempest-AttachVolumeNegativeTest-328651626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cb73b43b-a8ea-4b8a-8af6-6cbf80a64688 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:17 devstack sudo[92666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cb73b43b-a8ea-4b8a-8af6-6cbf80a64688 Jul 07 08:17:17 devstack sudo[92666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:18 devstack sudo[92661]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-7a205a86-4d3c-4572-b71b-dedf3167f156 req-2606cc64-961d-4642-abf1-8a979962b725 tempest-VolumesGetTestJSON-982652735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-563be2fe-4cf9-4d66-8830-58f86acd51af" returned: 0 in 0.775s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:18 devstack cinder-volume[87199]: DEBUG cinder.coordination [req-7a205a86-4d3c-4572-b71b-dedf3167f156 req-2606cc64-961d-4642-abf1-8a979962b725 tempest-VolumesGetTestJSON-982652735 None] Lock "cinder-quobyte-563be2fe-4cf9-4d66-8830-58f86acd51af" released by "delete_volume" :: held 1.918s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:17:18 devstack cinder-volume[87199]: DEBUG cinder.quota [req-7a205a86-4d3c-4572-b71b-dedf3167f156 req-2606cc64-961d-4642-abf1-8a979962b725 tempest-VolumesGetTestJSON-982652735 None] Created reservations ['723e57e2-57cc-4fed-ac9b-da23a587808a', '12a15388-0a71-4744-ae88-c3ed08558826', '22800a63-981d-4011-9d62-0517b0d97333', '81ab4da1-43fd-43eb-8bd1-78fd35357212'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:17:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-7a205a86-4d3c-4572-b71b-dedf3167f156 req-2606cc64-961d-4642-abf1-8a979962b725 tempest-VolumesGetTestJSON-982652735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:17:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-7a205a86-4d3c-4572-b71b-dedf3167f156 req-2606cc64-961d-4642-abf1-8a979962b725 tempest-VolumesGetTestJSON-982652735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:17:18 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [req-7a205a86-4d3c-4572-b71b-dedf3167f156 req-2606cc64-961d-4642-abf1-8a979962b725 tempest-VolumesGetTestJSON-982652735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:17:18 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [req-7a205a86-4d3c-4572-b71b-dedf3167f156 req-2606cc64-961d-4642-abf1-8a979962b725 tempest-VolumesGetTestJSON-982652735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:17:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-7a205a86-4d3c-4572-b71b-dedf3167f156 req-2606cc64-961d-4642-abf1-8a979962b725 tempest-VolumesGetTestJSON-982652735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:17:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-7a205a86-4d3c-4572-b71b-dedf3167f156 req-2606cc64-961d-4642-abf1-8a979962b725 tempest-VolumesGetTestJSON-982652735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:18 devstack sudo[92670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:17:18 devstack sudo[92670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:18 devstack sudo[92666]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f5046b0d-8893-49c9-a714-f97772a2096e tempest-AttachVolumeNegativeTest-328651626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cb73b43b-a8ea-4b8a-8af6-6cbf80a64688" returned: 0 in 0.779s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:18 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f5046b0d-8893-49c9-a714-f97772a2096e tempest-AttachVolumeNegativeTest-328651626 None] Lock "cinder-quobyte-cb73b43b-a8ea-4b8a-8af6-6cbf80a64688" released by "delete_volume" :: held 1.665s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:17:18 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-f5046b0d-8893-49c9-a714-f97772a2096e tempest-AttachVolumeNegativeTest-328651626 None] Created reservations ['8f8e30e7-3797-4c16-bc86-a64b0095d2d9', 'c6b96c3d-3024-4cbb-9321-ce53db7edc89', 'f385cca7-c855-45f7-8da1-ec11127951c7', '9db17a34-942c-4a19-924b-3dc25df051b8'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:17:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f5046b0d-8893-49c9-a714-f97772a2096e tempest-AttachVolumeNegativeTest-328651626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:17:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f5046b0d-8893-49c9-a714-f97772a2096e tempest-AttachVolumeNegativeTest-328651626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:17:18 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f5046b0d-8893-49c9-a714-f97772a2096e tempest-AttachVolumeNegativeTest-328651626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:17:18 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f5046b0d-8893-49c9-a714-f97772a2096e tempest-AttachVolumeNegativeTest-328651626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:17:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f5046b0d-8893-49c9-a714-f97772a2096e tempest-AttachVolumeNegativeTest-328651626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:17:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f5046b0d-8893-49c9-a714-f97772a2096e tempest-AttachVolumeNegativeTest-328651626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:18 devstack sudo[92674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:17:18 devstack sudo[92674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:19 devstack sudo[92670]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-7a205a86-4d3c-4572-b71b-dedf3167f156 req-2606cc64-961d-4642-abf1-8a979962b725 tempest-VolumesGetTestJSON-982652735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.868s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:19 devstack cinder-volume[87199]: DEBUG cinder.manager [req-7a205a86-4d3c-4572-b71b-dedf3167f156 req-2606cc64-961d-4642-abf1-8a979962b725 tempest-VolumesGetTestJSON-982652735 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:17:19 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-7a205a86-4d3c-4572-b71b-dedf3167f156 req-2606cc64-961d-4642-abf1-8a979962b725 tempest-VolumesGetTestJSON-982652735 None] Deleted volume successfully. Jul 07 08:17:19 devstack cinder-volume[87199]: DEBUG cinder.coordination [req-7a205a86-4d3c-4572-b71b-dedf3167f156 req-2606cc64-961d-4642-abf1-8a979962b725 tempest-VolumesGetTestJSON-982652735 None] Lock "cinder-563be2fe-4cf9-4d66-8830-58f86acd51af-delete_volume" released by "delete_volume" :: held 3.104s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:17:19 devstack sudo[92674]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f5046b0d-8893-49c9-a714-f97772a2096e tempest-AttachVolumeNegativeTest-328651626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.995s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:19 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-f5046b0d-8893-49c9-a714-f97772a2096e tempest-AttachVolumeNegativeTest-328651626 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:17:19 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-f5046b0d-8893-49c9-a714-f97772a2096e tempest-AttachVolumeNegativeTest-328651626 None] Deleted volume successfully. Jul 07 08:17:19 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f5046b0d-8893-49c9-a714-f97772a2096e tempest-AttachVolumeNegativeTest-328651626 None] Lock "cinder-cb73b43b-a8ea-4b8a-8af6-6cbf80a64688-delete_volume" released by "delete_volume" :: held 3.101s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:17:23 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c9f89ee-1293-46d7-86f3-b21701c60021 tempest-AttachVolumeShelveTestJSON-1859139297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:17:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5c9f89ee-1293-46d7-86f3-b21701c60021 tempest-AttachVolumeShelveTestJSON-1859139297 None] Flow 'volume_create_manager' (e8856e84-f137-43fe-af47-df2b42f8f528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:17:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5c9f89ee-1293-46d7-86f3-b21701c60021 tempest-AttachVolumeShelveTestJSON-1859139297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e911986-002a-495c-a17d-2fd8355fbf5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:23 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-e2136bce-200e-4a96-9c8d-07b529fac9b1 tempest-GroupSnapshotsV319Test-1678235269 None] Group tempest-GroupSnapshotsV319Test-Group-1741927421: creating Jul 07 08:17:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5c9f89ee-1293-46d7-86f3-b21701c60021 tempest-AttachVolumeShelveTestJSON-1859139297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e911986-002a-495c-a17d-2fd8355fbf5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:17:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1929995682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b08d6ff4-55a4-44e0-b858-3f9cf1d5a201,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f6ba6b3f5f74674ae2494cfe950b7d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:17:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:17:24Z,use_quota=True,user_id='f46f8849a9ed4223bb1b16f387a03a17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5c9f89ee-1293-46d7-86f3-b21701c60021 tempest-AttachVolumeShelveTestJSON-1859139297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb2c9503-4b80-46de-af84-6cf35d586ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5c9f89ee-1293-46d7-86f3-b21701c60021 tempest-AttachVolumeShelveTestJSON-1859139297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb2c9503-4b80-46de-af84-6cf35d586ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5c9f89ee-1293-46d7-86f3-b21701c60021 tempest-AttachVolumeShelveTestJSON-1859139297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd6ab177-eeae-44bd-94eb-c0355a307652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5c9f89ee-1293-46d7-86f3-b21701c60021 tempest-AttachVolumeShelveTestJSON-1859139297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd6ab177-eeae-44bd-94eb-c0355a307652) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b08d6ff4-55a4-44e0-b858-3f9cf1d5a201', 'volume_name': 'volume-b08d6ff4-55a4-44e0-b858-3f9cf1d5a201', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5c9f89ee-1293-46d7-86f3-b21701c60021 tempest-AttachVolumeShelveTestJSON-1859139297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ece701ee-a7fd-4651-a356-404a6b53f7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5c9f89ee-1293-46d7-86f3-b21701c60021 tempest-AttachVolumeShelveTestJSON-1859139297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ece701ee-a7fd-4651-a356-404a6b53f7ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5c9f89ee-1293-46d7-86f3-b21701c60021 tempest-AttachVolumeShelveTestJSON-1859139297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cea025cf-b2b1-4843-9d18-caa5bbc5d59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:24 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-5c9f89ee-1293-46d7-86f3-b21701c60021 tempest-AttachVolumeShelveTestJSON-1859139297 None] Volume b08d6ff4-55a4-44e0-b858-3f9cf1d5a201: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b08d6ff4-55a4-44e0-b858-3f9cf1d5a201', 'volume_size': 1} Jul 07 08:17:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-5c9f89ee-1293-46d7-86f3-b21701c60021 tempest-AttachVolumeShelveTestJSON-1859139297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:17:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-5c9f89ee-1293-46d7-86f3-b21701c60021 tempest-AttachVolumeShelveTestJSON-1859139297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:17:24 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-5c9f89ee-1293-46d7-86f3-b21701c60021 tempest-AttachVolumeShelveTestJSON-1859139297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:17:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1929995682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b08d6ff4-55a4-44e0-b858-3f9cf1d5a201,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f6ba6b3f5f74674ae2494cfe950b7d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:17:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:17:24Z,use_quota=True,user_id='f46f8849a9ed4223bb1b16f387a03a17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:17:24 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-5c9f89ee-1293-46d7-86f3-b21701c60021 tempest-AttachVolumeShelveTestJSON-1859139297 None] Creating volume b08d6ff4-55a4-44e0-b858-3f9cf1d5a201 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:17:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-5c9f89ee-1293-46d7-86f3-b21701c60021 tempest-AttachVolumeShelveTestJSON-1859139297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:17:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-5c9f89ee-1293-46d7-86f3-b21701c60021 tempest-AttachVolumeShelveTestJSON-1859139297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:17:24 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-5c9f89ee-1293-46d7-86f3-b21701c60021 tempest-AttachVolumeShelveTestJSON-1859139297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:17:24 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-5c9f89ee-1293-46d7-86f3-b21701c60021 tempest-AttachVolumeShelveTestJSON-1859139297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:17:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-5c9f89ee-1293-46d7-86f3-b21701c60021 tempest-AttachVolumeShelveTestJSON-1859139297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:17:24 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-5c9f89ee-1293-46d7-86f3-b21701c60021 tempest-AttachVolumeShelveTestJSON-1859139297 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:17:24 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-5c9f89ee-1293-46d7-86f3-b21701c60021 tempest-AttachVolumeShelveTestJSON-1859139297 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:17:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5c9f89ee-1293-46d7-86f3-b21701c60021 tempest-AttachVolumeShelveTestJSON-1859139297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b08d6ff4-55a4-44e0-b858-3f9cf1d5a201 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:24 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-e2136bce-200e-4a96-9c8d-07b529fac9b1 tempest-GroupSnapshotsV319Test-1678235269 None] Group tempest-GroupSnapshotsV319Test-Group-1741927421: created successfully Jul 07 08:17:24 devstack sudo[92776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b08d6ff4-55a4-44e0-b858-3f9cf1d5a201 1073741824 Jul 07 08:17:24 devstack sudo[92776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:24 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-e2136bce-200e-4a96-9c8d-07b529fac9b1 tempest-GroupSnapshotsV319Test-1678235269 None] Create group completed successfully. Jul 07 08:17:25 devstack sudo[92776]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5c9f89ee-1293-46d7-86f3-b21701c60021 tempest-AttachVolumeShelveTestJSON-1859139297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b08d6ff4-55a4-44e0-b858-3f9cf1d5a201 1073741824" returned: 0 in 1.077s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5c9f89ee-1293-46d7-86f3-b21701c60021 tempest-AttachVolumeShelveTestJSON-1859139297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b08d6ff4-55a4-44e0-b858-3f9cf1d5a201 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:25 devstack sudo[92786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b08d6ff4-55a4-44e0-b858-3f9cf1d5a201 Jul 07 08:17:25 devstack sudo[92786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:25 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-87096c89-2327-40c3-b6c3-09cbd542d646 tempest-GroupSnapshotsV319Test-1678235269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:17:25 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-87096c89-2327-40c3-b6c3-09cbd542d646 tempest-GroupSnapshotsV319Test-1678235269 None] Flow 'volume_create_manager' (651e7462-fe0f-4740-a1b3-eab7aa543236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:17:25 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-87096c89-2327-40c3-b6c3-09cbd542d646 tempest-GroupSnapshotsV319Test-1678235269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d16b9984-ebad-4971-88ee-709d52b01b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:25 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-87096c89-2327-40c3-b6c3-09cbd542d646 tempest-GroupSnapshotsV319Test-1678235269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d16b9984-ebad-4971-88ee-709d52b01b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-651419261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=24ced780-4188-4a96-9977-803c462cf5ba,host='devstack@QuobyteHD#QuobyteHD',id=5184807d-be65-4e51-b425-ebf0ee52fea3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17c25b52ce1149609bafff4261be0b42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:17:25Z,use_quota=True,user_id='dc8d267270a94d4caa8261de0ba0d051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f08f10f-2683-4009-806b-f09e20c6745b),volume_type_id=3f08f10f-2683-4009-806b-f09e20c6745b)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:25 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-87096c89-2327-40c3-b6c3-09cbd542d646 tempest-GroupSnapshotsV319Test-1678235269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf65439f-3d5a-45d7-b167-f7ee7e83e3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:25 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-87096c89-2327-40c3-b6c3-09cbd542d646 tempest-GroupSnapshotsV319Test-1678235269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf65439f-3d5a-45d7-b167-f7ee7e83e3f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:25 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-87096c89-2327-40c3-b6c3-09cbd542d646 tempest-GroupSnapshotsV319Test-1678235269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f72d352b-f958-46a4-b0d6-c913944e40b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:25 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-87096c89-2327-40c3-b6c3-09cbd542d646 tempest-GroupSnapshotsV319Test-1678235269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f72d352b-f958-46a4-b0d6-c913944e40b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5184807d-be65-4e51-b425-ebf0ee52fea3', 'volume_name': 'volume-5184807d-be65-4e51-b425-ebf0ee52fea3', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:25 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-87096c89-2327-40c3-b6c3-09cbd542d646 tempest-GroupSnapshotsV319Test-1678235269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (697ca250-4f67-4807-9d05-70f77b5cd08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:25 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-87096c89-2327-40c3-b6c3-09cbd542d646 tempest-GroupSnapshotsV319Test-1678235269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (697ca250-4f67-4807-9d05-70f77b5cd08a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:25 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-87096c89-2327-40c3-b6c3-09cbd542d646 tempest-GroupSnapshotsV319Test-1678235269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24c79796-1eaf-4bea-85dc-b328fab2feb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:25 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-87096c89-2327-40c3-b6c3-09cbd542d646 tempest-GroupSnapshotsV319Test-1678235269 None] Volume 5184807d-be65-4e51-b425-ebf0ee52fea3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5184807d-be65-4e51-b425-ebf0ee52fea3', 'volume_size': 1} Jul 07 08:17:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-87096c89-2327-40c3-b6c3-09cbd542d646 tempest-GroupSnapshotsV319Test-1678235269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:17:25 devstack sudo[92786]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5c9f89ee-1293-46d7-86f3-b21701c60021 tempest-AttachVolumeShelveTestJSON-1859139297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b08d6ff4-55a4-44e0-b858-3f9cf1d5a201" returned: 0 in 0.797s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:25 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-5c9f89ee-1293-46d7-86f3-b21701c60021 tempest-AttachVolumeShelveTestJSON-1859139297 None] <== create_volume: return (1941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:17:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-5c9f89ee-1293-46d7-86f3-b21701c60021 tempest-AttachVolumeShelveTestJSON-1859139297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.944s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:17:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-87096c89-2327-40c3-b6c3-09cbd542d646 tempest-GroupSnapshotsV319Test-1678235269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.465s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:17:25 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-87096c89-2327-40c3-b6c3-09cbd542d646 tempest-GroupSnapshotsV319Test-1678235269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=24ced780-4188-4a96-9977-803c462cf5ba,created_at=2026-07-07T06:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-651419261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=24ced780-4188-4a96-9977-803c462cf5ba,host='devstack@QuobyteHD#QuobyteHD',id=5184807d-be65-4e51-b425-ebf0ee52fea3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17c25b52ce1149609bafff4261be0b42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:17:25Z,use_quota=True,user_id='dc8d267270a94d4caa8261de0ba0d051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f08f10f-2683-4009-806b-f09e20c6745b),volume_type_id=3f08f10f-2683-4009-806b-f09e20c6745b)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:17:25 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-87096c89-2327-40c3-b6c3-09cbd542d646 tempest-GroupSnapshotsV319Test-1678235269 None] Creating volume 5184807d-be65-4e51-b425-ebf0ee52fea3 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:17:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-87096c89-2327-40c3-b6c3-09cbd542d646 tempest-GroupSnapshotsV319Test-1678235269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:17:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-87096c89-2327-40c3-b6c3-09cbd542d646 tempest-GroupSnapshotsV319Test-1678235269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:17:25 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-87096c89-2327-40c3-b6c3-09cbd542d646 tempest-GroupSnapshotsV319Test-1678235269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:17:26 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-87096c89-2327-40c3-b6c3-09cbd542d646 tempest-GroupSnapshotsV319Test-1678235269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:17:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-87096c89-2327-40c3-b6c3-09cbd542d646 tempest-GroupSnapshotsV319Test-1678235269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:17:26 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-87096c89-2327-40c3-b6c3-09cbd542d646 tempest-GroupSnapshotsV319Test-1678235269 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:17:26 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-87096c89-2327-40c3-b6c3-09cbd542d646 tempest-GroupSnapshotsV319Test-1678235269 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:17:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-87096c89-2327-40c3-b6c3-09cbd542d646 tempest-GroupSnapshotsV319Test-1678235269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5184807d-be65-4e51-b425-ebf0ee52fea3 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5c9f89ee-1293-46d7-86f3-b21701c60021 tempest-AttachVolumeShelveTestJSON-1859139297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cea025cf-b2b1-4843-9d18-caa5bbc5d59d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b08d6ff4-55a4-44e0-b858-3f9cf1d5a201', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:26 devstack sudo[92789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5184807d-be65-4e51-b425-ebf0ee52fea3 1073741824 Jul 07 08:17:26 devstack sudo[92789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5c9f89ee-1293-46d7-86f3-b21701c60021 tempest-AttachVolumeShelveTestJSON-1859139297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2997cc08-3ac2-4616-a94a-4ee2025b3bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:26 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-5c9f89ee-1293-46d7-86f3-b21701c60021 tempest-AttachVolumeShelveTestJSON-1859139297 None] Volume volume-b08d6ff4-55a4-44e0-b858-3f9cf1d5a201 (b08d6ff4-55a4-44e0-b858-3f9cf1d5a201): created successfully Jul 07 08:17:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5c9f89ee-1293-46d7-86f3-b21701c60021 tempest-AttachVolumeShelveTestJSON-1859139297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2997cc08-3ac2-4616-a94a-4ee2025b3bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5c9f89ee-1293-46d7-86f3-b21701c60021 tempest-AttachVolumeShelveTestJSON-1859139297 None] Flow 'volume_create_manager' (e8856e84-f137-43fe-af47-df2b42f8f528) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:17:26 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-5c9f89ee-1293-46d7-86f3-b21701c60021 tempest-AttachVolumeShelveTestJSON-1859139297 None] Created volume successfully. Jul 07 08:17:27 devstack sudo[92789]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-87096c89-2327-40c3-b6c3-09cbd542d646 tempest-GroupSnapshotsV319Test-1678235269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5184807d-be65-4e51-b425-ebf0ee52fea3 1073741824" returned: 0 in 1.011s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-87096c89-2327-40c3-b6c3-09cbd542d646 tempest-GroupSnapshotsV319Test-1678235269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5184807d-be65-4e51-b425-ebf0ee52fea3 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:27 devstack sudo[92798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5184807d-be65-4e51-b425-ebf0ee52fea3 Jul 07 08:17:27 devstack sudo[92798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:27 devstack sudo[92798]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-87096c89-2327-40c3-b6c3-09cbd542d646 tempest-GroupSnapshotsV319Test-1678235269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5184807d-be65-4e51-b425-ebf0ee52fea3" returned: 0 in 0.914s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:27 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-87096c89-2327-40c3-b6c3-09cbd542d646 tempest-GroupSnapshotsV319Test-1678235269 None] <== create_volume: return (1983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:17:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-87096c89-2327-40c3-b6c3-09cbd542d646 tempest-GroupSnapshotsV319Test-1678235269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.986s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:17:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-87096c89-2327-40c3-b6c3-09cbd542d646 tempest-GroupSnapshotsV319Test-1678235269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24c79796-1eaf-4bea-85dc-b328fab2feb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5184807d-be65-4e51-b425-ebf0ee52fea3', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-87096c89-2327-40c3-b6c3-09cbd542d646 tempest-GroupSnapshotsV319Test-1678235269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10ae2208-b0ab-4300-9c39-f4baaff4b8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:28 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-87096c89-2327-40c3-b6c3-09cbd542d646 tempest-GroupSnapshotsV319Test-1678235269 None] Volume volume-5184807d-be65-4e51-b425-ebf0ee52fea3 (5184807d-be65-4e51-b425-ebf0ee52fea3): created successfully Jul 07 08:17:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-87096c89-2327-40c3-b6c3-09cbd542d646 tempest-GroupSnapshotsV319Test-1678235269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10ae2208-b0ab-4300-9c39-f4baaff4b8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-87096c89-2327-40c3-b6c3-09cbd542d646 tempest-GroupSnapshotsV319Test-1678235269 None] Flow 'volume_create_manager' (651e7462-fe0f-4740-a1b3-eab7aa543236) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:17:28 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-87096c89-2327-40c3-b6c3-09cbd542d646 tempest-GroupSnapshotsV319Test-1678235269 None] Created volume successfully. Jul 07 08:17:28 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [req-756001cb-d029-4b44-93f0-949bac4aa3b1 req-90e3e57e-e481-4ec6-9922-476534bdabf3 tempest-VolumesSnapshotsTestJSON-1986971332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:17:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-756001cb-d029-4b44-93f0-949bac4aa3b1 req-90e3e57e-e481-4ec6-9922-476534bdabf3 tempest-VolumesSnapshotsTestJSON-1986971332 None] Flow 'volume_create_manager' (7d18143f-fe3f-442a-9b9e-81c3d221e4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:17:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-756001cb-d029-4b44-93f0-949bac4aa3b1 req-90e3e57e-e481-4ec6-9922-476534bdabf3 tempest-VolumesSnapshotsTestJSON-1986971332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cd2c32e-d3c4-42dd-9b75-9b11b766205c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-756001cb-d029-4b44-93f0-949bac4aa3b1 req-90e3e57e-e481-4ec6-9922-476534bdabf3 tempest-VolumesSnapshotsTestJSON-1986971332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cd2c32e-d3c4-42dd-9b75-9b11b766205c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-444649587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a408a90-a3e3-4149-8d2a-b6f3f6bbea48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a405286c44c4d2f9cd7e3a5fb78e41e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:17:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:17:28Z,use_quota=True,user_id='d81418a53810418db29c896103eb7afb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-756001cb-d029-4b44-93f0-949bac4aa3b1 req-90e3e57e-e481-4ec6-9922-476534bdabf3 tempest-VolumesSnapshotsTestJSON-1986971332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df0abc9a-8962-47dd-a7d2-4dbc4a088d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-756001cb-d029-4b44-93f0-949bac4aa3b1 req-90e3e57e-e481-4ec6-9922-476534bdabf3 tempest-VolumesSnapshotsTestJSON-1986971332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df0abc9a-8962-47dd-a7d2-4dbc4a088d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-756001cb-d029-4b44-93f0-949bac4aa3b1 req-90e3e57e-e481-4ec6-9922-476534bdabf3 tempest-VolumesSnapshotsTestJSON-1986971332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a97ab2c-566e-4dec-84da-1094bf60b04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-756001cb-d029-4b44-93f0-949bac4aa3b1 req-90e3e57e-e481-4ec6-9922-476534bdabf3 tempest-VolumesSnapshotsTestJSON-1986971332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a97ab2c-566e-4dec-84da-1094bf60b04b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a408a90-a3e3-4149-8d2a-b6f3f6bbea48', 'volume_name': 'volume-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-756001cb-d029-4b44-93f0-949bac4aa3b1 req-90e3e57e-e481-4ec6-9922-476534bdabf3 tempest-VolumesSnapshotsTestJSON-1986971332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6580222c-5abd-4d16-b57e-a444ee659e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-756001cb-d029-4b44-93f0-949bac4aa3b1 req-90e3e57e-e481-4ec6-9922-476534bdabf3 tempest-VolumesSnapshotsTestJSON-1986971332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6580222c-5abd-4d16-b57e-a444ee659e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-756001cb-d029-4b44-93f0-949bac4aa3b1 req-90e3e57e-e481-4ec6-9922-476534bdabf3 tempest-VolumesSnapshotsTestJSON-1986971332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d6bd436-dbbc-4235-8fa9-a33215c9debd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:28 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [req-756001cb-d029-4b44-93f0-949bac4aa3b1 req-90e3e57e-e481-4ec6-9922-476534bdabf3 tempest-VolumesSnapshotsTestJSON-1986971332 None] Volume 4a408a90-a3e3-4149-8d2a-b6f3f6bbea48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48', 'volume_size': 1} Jul 07 08:17:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-756001cb-d029-4b44-93f0-949bac4aa3b1 req-90e3e57e-e481-4ec6-9922-476534bdabf3 tempest-VolumesSnapshotsTestJSON-1986971332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:17:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-756001cb-d029-4b44-93f0-949bac4aa3b1 req-90e3e57e-e481-4ec6-9922-476534bdabf3 tempest-VolumesSnapshotsTestJSON-1986971332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:17:28 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [req-756001cb-d029-4b44-93f0-949bac4aa3b1 req-90e3e57e-e481-4ec6-9922-476534bdabf3 tempest-VolumesSnapshotsTestJSON-1986971332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-444649587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a408a90-a3e3-4149-8d2a-b6f3f6bbea48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a405286c44c4d2f9cd7e3a5fb78e41e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:17:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:17:28Z,use_quota=True,user_id='d81418a53810418db29c896103eb7afb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:17:28 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [req-756001cb-d029-4b44-93f0-949bac4aa3b1 req-90e3e57e-e481-4ec6-9922-476534bdabf3 tempest-VolumesSnapshotsTestJSON-1986971332 None] Creating volume 4a408a90-a3e3-4149-8d2a-b6f3f6bbea48 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:17:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-756001cb-d029-4b44-93f0-949bac4aa3b1 req-90e3e57e-e481-4ec6-9922-476534bdabf3 tempest-VolumesSnapshotsTestJSON-1986971332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:17:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-756001cb-d029-4b44-93f0-949bac4aa3b1 req-90e3e57e-e481-4ec6-9922-476534bdabf3 tempest-VolumesSnapshotsTestJSON-1986971332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:17:28 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [req-756001cb-d029-4b44-93f0-949bac4aa3b1 req-90e3e57e-e481-4ec6-9922-476534bdabf3 tempest-VolumesSnapshotsTestJSON-1986971332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:17:28 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [req-756001cb-d029-4b44-93f0-949bac4aa3b1 req-90e3e57e-e481-4ec6-9922-476534bdabf3 tempest-VolumesSnapshotsTestJSON-1986971332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:17:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-756001cb-d029-4b44-93f0-949bac4aa3b1 req-90e3e57e-e481-4ec6-9922-476534bdabf3 tempest-VolumesSnapshotsTestJSON-1986971332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:17:28 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [req-756001cb-d029-4b44-93f0-949bac4aa3b1 req-90e3e57e-e481-4ec6-9922-476534bdabf3 tempest-VolumesSnapshotsTestJSON-1986971332 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:17:28 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [req-756001cb-d029-4b44-93f0-949bac4aa3b1 req-90e3e57e-e481-4ec6-9922-476534bdabf3 tempest-VolumesSnapshotsTestJSON-1986971332 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:17:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-756001cb-d029-4b44-93f0-949bac4aa3b1 req-90e3e57e-e481-4ec6-9922-476534bdabf3 tempest-VolumesSnapshotsTestJSON-1986971332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:28 devstack sudo[92801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48 1073741824 Jul 07 08:17:28 devstack sudo[92801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:29 devstack sudo[92801]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-756001cb-d029-4b44-93f0-949bac4aa3b1 req-90e3e57e-e481-4ec6-9922-476534bdabf3 tempest-VolumesSnapshotsTestJSON-1986971332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48 1073741824" returned: 0 in 0.857s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-756001cb-d029-4b44-93f0-949bac4aa3b1 req-90e3e57e-e481-4ec6-9922-476534bdabf3 tempest-VolumesSnapshotsTestJSON-1986971332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:29 devstack sudo[92811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48 Jul 07 08:17:29 devstack sudo[92811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:29 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-793795b8-7e8a-48ed-8420-9af2238ec457 tempest-GroupSnapshotsV319Test-1678235269 None] GroupSnapshot 5eb5a090-5de0-4138-a1ea-8d2b89413ab0: creating. Jul 07 08:17:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-793795b8-7e8a-48ed-8420-9af2238ec457 tempest-GroupSnapshotsV319Test-1678235269 None] Group snapshot 5eb5a090-5de0-4138-a1ea-8d2b89413ab0: creating. {{(pid=87199) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 07 08:17:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-793795b8-7e8a-48ed-8420-9af2238ec457 tempest-GroupSnapshotsV319Test-1678235269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:17:29 devstack sudo[92811]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-756001cb-d029-4b44-93f0-949bac4aa3b1 req-90e3e57e-e481-4ec6-9922-476534bdabf3 tempest-VolumesSnapshotsTestJSON-1986971332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48" returned: 0 in 0.665s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:29 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [req-756001cb-d029-4b44-93f0-949bac4aa3b1 req-90e3e57e-e481-4ec6-9922-476534bdabf3 tempest-VolumesSnapshotsTestJSON-1986971332 None] <== create_volume: return (1569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:17:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-756001cb-d029-4b44-93f0-949bac4aa3b1 req-90e3e57e-e481-4ec6-9922-476534bdabf3 tempest-VolumesSnapshotsTestJSON-1986971332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.572s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:17:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-793795b8-7e8a-48ed-8420-9af2238ec457 tempest-GroupSnapshotsV319Test-1678235269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.411s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:17:29 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-793795b8-7e8a-48ed-8420-9af2238ec457 tempest-GroupSnapshotsV319Test-1678235269 None] Creating offline snapshot c1049f85-86c6-4ad6-a489-8c2ab9704197 of volume 5184807d-be65-4e51-b425-ebf0ee52fea3 {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:17:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-756001cb-d029-4b44-93f0-949bac4aa3b1 req-90e3e57e-e481-4ec6-9922-476534bdabf3 tempest-VolumesSnapshotsTestJSON-1986971332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d6bd436-dbbc-4235-8fa9-a33215c9debd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-756001cb-d029-4b44-93f0-949bac4aa3b1 req-90e3e57e-e481-4ec6-9922-476534bdabf3 tempest-VolumesSnapshotsTestJSON-1986971332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1ca6988-ec3e-4f9b-abb0-e67ca0e3b1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:29 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[0650db17-1db9-4607-a207-12cdf2467a0e]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:17:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-793795b8-7e8a-48ed-8420-9af2238ec457 tempest-GroupSnapshotsV319Test-1678235269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5184807d-be65-4e51-b425-ebf0ee52fea3 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:29 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [req-756001cb-d029-4b44-93f0-949bac4aa3b1 req-90e3e57e-e481-4ec6-9922-476534bdabf3 tempest-VolumesSnapshotsTestJSON-1986971332 None] Volume volume-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48 (4a408a90-a3e3-4149-8d2a-b6f3f6bbea48): created successfully Jul 07 08:17:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-756001cb-d029-4b44-93f0-949bac4aa3b1 req-90e3e57e-e481-4ec6-9922-476534bdabf3 tempest-VolumesSnapshotsTestJSON-1986971332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1ca6988-ec3e-4f9b-abb0-e67ca0e3b1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-756001cb-d029-4b44-93f0-949bac4aa3b1 req-90e3e57e-e481-4ec6-9922-476534bdabf3 tempest-VolumesSnapshotsTestJSON-1986971332 None] Flow 'volume_create_manager' (7d18143f-fe3f-442a-9b9e-81c3d221e4d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:17:29 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-756001cb-d029-4b44-93f0-949bac4aa3b1 req-90e3e57e-e481-4ec6-9922-476534bdabf3 tempest-VolumesSnapshotsTestJSON-1986971332 None] Created volume successfully. Jul 07 08:17:30 devstack sudo[92814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5184807d-be65-4e51-b425-ebf0ee52fea3 Jul 07 08:17:30 devstack sudo[92814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:30 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-2c1ac538-2c75-4bf9-8a2b-f27bfe49f09a req-a545480b-e116-4fc4-aa0c-e77c6f61cbb0 tempest-AttachVolumeTestJSON-1669838508 None] Terminate volume connection completed successfully. Jul 07 08:17:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-2c1ac538-2c75-4bf9-8a2b-f27bfe49f09a req-a545480b-e116-4fc4-aa0c-e77c6f61cbb0 tempest-AttachVolumeTestJSON-1669838508 None] Deleting attachment bc4ff686-2c84-4937-92ac-3bca646a8f3a. {{(pid=87199) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 08:17:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-23c931bd-66c3-4675-931b-91daa659a2d0 req-9b891afb-67ab-4e4b-9a05-595ccb740ca4 tempest-VolumesSnapshotsTestJSON-1986971332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:17:30 devstack sudo[92814]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-793795b8-7e8a-48ed-8420-9af2238ec457 tempest-GroupSnapshotsV319Test-1678235269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5184807d-be65-4e51-b425-ebf0ee52fea3" returned: 0 in 0.883s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-793795b8-7e8a-48ed-8420-9af2238ec457 tempest-GroupSnapshotsV319Test-1678235269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5184807d-be65-4e51-b425-ebf0ee52fea3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5184807d-be65-4e51-b425-ebf0ee52fea3.c1049f85-86c6-4ad6-a489-8c2ab9704197 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:30 devstack sudo[92828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5184807d-be65-4e51-b425-ebf0ee52fea3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5184807d-be65-4e51-b425-ebf0ee52fea3.c1049f85-86c6-4ad6-a489-8c2ab9704197 1G Jul 07 08:17:30 devstack sudo[92828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:31 devstack sudo[92828]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-793795b8-7e8a-48ed-8420-9af2238ec457 tempest-GroupSnapshotsV319Test-1678235269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5184807d-be65-4e51-b425-ebf0ee52fea3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5184807d-be65-4e51-b425-ebf0ee52fea3.c1049f85-86c6-4ad6-a489-8c2ab9704197 1G" returned: 0 in 0.920s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-793795b8-7e8a-48ed-8420-9af2238ec457 tempest-GroupSnapshotsV319Test-1678235269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5184807d-be65-4e51-b425-ebf0ee52fea3 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5184807d-be65-4e51-b425-ebf0ee52fea3.c1049f85-86c6-4ad6-a489-8c2ab9704197 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:31 devstack sudo[92834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5184807d-be65-4e51-b425-ebf0ee52fea3 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5184807d-be65-4e51-b425-ebf0ee52fea3.c1049f85-86c6-4ad6-a489-8c2ab9704197 Jul 07 08:17:31 devstack sudo[92834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:32 devstack sudo[92834]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-793795b8-7e8a-48ed-8420-9af2238ec457 tempest-GroupSnapshotsV319Test-1678235269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5184807d-be65-4e51-b425-ebf0ee52fea3 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5184807d-be65-4e51-b425-ebf0ee52fea3.c1049f85-86c6-4ad6-a489-8c2ab9704197" returned: 0 in 0.705s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:32 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-793795b8-7e8a-48ed-8420-9af2238ec457 tempest-GroupSnapshotsV319Test-1678235269 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5184807d-be65-4e51-b425-ebf0ee52fea3.c1049f85-86c6-4ad6-a489-8c2ab9704197 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 08:17:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-793795b8-7e8a-48ed-8420-9af2238ec457 tempest-GroupSnapshotsV319Test-1678235269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5184807d-be65-4e51-b425-ebf0ee52fea3.c1049f85-86c6-4ad6-a489-8c2ab9704197 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:32 devstack sudo[92848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5184807d-be65-4e51-b425-ebf0ee52fea3.c1049f85-86c6-4ad6-a489-8c2ab9704197 Jul 07 08:17:32 devstack sudo[92848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:33 devstack sudo[92848]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-793795b8-7e8a-48ed-8420-9af2238ec457 tempest-GroupSnapshotsV319Test-1678235269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5184807d-be65-4e51-b425-ebf0ee52fea3.c1049f85-86c6-4ad6-a489-8c2ab9704197" returned: 0 in 0.708s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-793795b8-7e8a-48ed-8420-9af2238ec457 tempest-GroupSnapshotsV319Test-1678235269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5184807d-be65-4e51-b425-ebf0ee52fea3.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:33 devstack sudo[92854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5184807d-be65-4e51-b425-ebf0ee52fea3.info Jul 07 08:17:33 devstack sudo[92854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:33 devstack sudo[92854]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-793795b8-7e8a-48ed-8420-9af2238ec457 tempest-GroupSnapshotsV319Test-1678235269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5184807d-be65-4e51-b425-ebf0ee52fea3.info" returned: 0 in 0.778s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:33 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-793795b8-7e8a-48ed-8420-9af2238ec457 tempest-GroupSnapshotsV319Test-1678235269 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5184807d-be65-4e51-b425-ebf0ee52fea3.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 08:17:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-793795b8-7e8a-48ed-8420-9af2238ec457 tempest-GroupSnapshotsV319Test-1678235269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5184807d-be65-4e51-b425-ebf0ee52fea3.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:33 devstack sudo[92860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5184807d-be65-4e51-b425-ebf0ee52fea3.info Jul 07 08:17:33 devstack sudo[92860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:34 devstack sudo[92860]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-793795b8-7e8a-48ed-8420-9af2238ec457 tempest-GroupSnapshotsV319Test-1678235269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5184807d-be65-4e51-b425-ebf0ee52fea3.info" returned: 0 in 0.712s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-793795b8-7e8a-48ed-8420-9af2238ec457 tempest-GroupSnapshotsV319Test-1678235269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.812s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:17:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-23c931bd-66c3-4675-931b-91daa659a2d0 req-9b891afb-67ab-4e4b-9a05-595ccb740ca4 tempest-VolumesSnapshotsTestJSON-1986971332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.033s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:17:34 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [req-23c931bd-66c3-4675-931b-91daa659a2d0 req-9b891afb-67ab-4e4b-9a05-595ccb740ca4 tempest-VolumesSnapshotsTestJSON-1986971332 None] Creating offline snapshot 7d7b1d4b-f319-4ef2-abd7-aa353909a437 of volume 4a408a90-a3e3-4149-8d2a-b6f3f6bbea48 {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:17:34 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c56c75-59f3-415a-abab-65acb86eb6f9]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:17:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-23c931bd-66c3-4675-931b-91daa659a2d0 req-9b891afb-67ab-4e4b-9a05-595ccb740ca4 tempest-VolumesSnapshotsTestJSON-1986971332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:34 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-793795b8-7e8a-48ed-8420-9af2238ec457 tempest-GroupSnapshotsV319Test-1678235269 None] group_snapshot 5eb5a090-5de0-4138-a1ea-8d2b89413ab0: created successfully Jul 07 08:17:34 devstack sudo[92863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48 Jul 07 08:17:34 devstack sudo[92863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:35 devstack sudo[92863]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-23c931bd-66c3-4675-931b-91daa659a2d0 req-9b891afb-67ab-4e4b-9a05-595ccb740ca4 tempest-VolumesSnapshotsTestJSON-1986971332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48" returned: 0 in 0.922s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-23c931bd-66c3-4675-931b-91daa659a2d0 req-9b891afb-67ab-4e4b-9a05-595ccb740ca4 tempest-VolumesSnapshotsTestJSON-1986971332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48.7d7b1d4b-f319-4ef2-abd7-aa353909a437 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:35 devstack sudo[92871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48.7d7b1d4b-f319-4ef2-abd7-aa353909a437 1G Jul 07 08:17:35 devstack sudo[92871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:36 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-51bf9f75-0bd0-4e02-8e18-8ad9c49c7e65 tempest-GroupSnapshotsV319Test-1678235269 None] group_snapshot 5eb5a090-5de0-4138-a1ea-8d2b89413ab0: deleting Jul 07 08:17:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-51bf9f75-0bd0-4e02-8e18-8ad9c49c7e65 tempest-GroupSnapshotsV319Test-1678235269 None] group_snapshot 5eb5a090-5de0-4138-a1ea-8d2b89413ab0: deleting {{(pid=87199) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 07 08:17:36 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-51bf9f75-0bd0-4e02-8e18-8ad9c49c7e65 tempest-GroupSnapshotsV319Test-1678235269 None] Acquiring lock "cinder-quobyte-5184807d-be65-4e51-b425-ebf0ee52fea3" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:17:36 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-51bf9f75-0bd0-4e02-8e18-8ad9c49c7e65 tempest-GroupSnapshotsV319Test-1678235269 None] Lock "cinder-quobyte-5184807d-be65-4e51-b425-ebf0ee52fea3" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:17:36 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-51bf9f75-0bd0-4e02-8e18-8ad9c49c7e65 tempest-GroupSnapshotsV319Test-1678235269 None] Acquiring lock "cinder-quobyte-c1049f85-86c6-4ad6-a489-8c2ab9704197" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:17:36 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-51bf9f75-0bd0-4e02-8e18-8ad9c49c7e65 tempest-GroupSnapshotsV319Test-1678235269 None] Lock "cinder-quobyte-c1049f85-86c6-4ad6-a489-8c2ab9704197" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:17:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-51bf9f75-0bd0-4e02-8e18-8ad9c49c7e65 tempest-GroupSnapshotsV319Test-1678235269 None] Deleting offline snapshot c1049f85-86c6-4ad6-a489-8c2ab9704197 of volume 5184807d-be65-4e51-b425-ebf0ee52fea3 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:17:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-51bf9f75-0bd0-4e02-8e18-8ad9c49c7e65 tempest-GroupSnapshotsV319Test-1678235269 None] snapshot_file for this snap is: volume-5184807d-be65-4e51-b425-ebf0ee52fea3.c1049f85-86c6-4ad6-a489-8c2ab9704197 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:17:36 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d277806-fe1f-460e-949a-cbdfa8c42fe0]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:17:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-51bf9f75-0bd0-4e02-8e18-8ad9c49c7e65 tempest-GroupSnapshotsV319Test-1678235269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5184807d-be65-4e51-b425-ebf0ee52fea3.c1049f85-86c6-4ad6-a489-8c2ab9704197 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:36 devstack sudo[92876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5184807d-be65-4e51-b425-ebf0ee52fea3.c1049f85-86c6-4ad6-a489-8c2ab9704197 Jul 07 08:17:36 devstack sudo[92876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:36 devstack sudo[92871]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-23c931bd-66c3-4675-931b-91daa659a2d0 req-9b891afb-67ab-4e4b-9a05-595ccb740ca4 tempest-VolumesSnapshotsTestJSON-1986971332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48.7d7b1d4b-f319-4ef2-abd7-aa353909a437 1G" returned: 0 in 1.012s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-23c931bd-66c3-4675-931b-91daa659a2d0 req-9b891afb-67ab-4e4b-9a05-595ccb740ca4 tempest-VolumesSnapshotsTestJSON-1986971332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48.7d7b1d4b-f319-4ef2-abd7-aa353909a437 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:36 devstack sudo[92878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48.7d7b1d4b-f319-4ef2-abd7-aa353909a437 Jul 07 08:17:36 devstack sudo[92878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:37 devstack sudo[92876]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-51bf9f75-0bd0-4e02-8e18-8ad9c49c7e65 tempest-GroupSnapshotsV319Test-1678235269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5184807d-be65-4e51-b425-ebf0ee52fea3.c1049f85-86c6-4ad6-a489-8c2ab9704197" returned: 0 in 0.875s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:37 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-51bf9f75-0bd0-4e02-8e18-8ad9c49c7e65 tempest-GroupSnapshotsV319Test-1678235269 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5184807d-be65-4e51-b425-ebf0ee52fea3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:17:37 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b38eda4-6b65-485d-af5c-3653e4a433e8]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:17:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-51bf9f75-0bd0-4e02-8e18-8ad9c49c7e65 tempest-GroupSnapshotsV319Test-1678235269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5184807d-be65-4e51-b425-ebf0ee52fea3 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:37 devstack sudo[92878]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-23c931bd-66c3-4675-931b-91daa659a2d0 req-9b891afb-67ab-4e4b-9a05-595ccb740ca4 tempest-VolumesSnapshotsTestJSON-1986971332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48.7d7b1d4b-f319-4ef2-abd7-aa353909a437" returned: 0 in 0.708s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:37 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [req-23c931bd-66c3-4675-931b-91daa659a2d0 req-9b891afb-67ab-4e4b-9a05-595ccb740ca4 tempest-VolumesSnapshotsTestJSON-1986971332 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48.7d7b1d4b-f319-4ef2-abd7-aa353909a437 is being set with open permissions: ugo+rw Jul 07 08:17:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-23c931bd-66c3-4675-931b-91daa659a2d0 req-9b891afb-67ab-4e4b-9a05-595ccb740ca4 tempest-VolumesSnapshotsTestJSON-1986971332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48.7d7b1d4b-f319-4ef2-abd7-aa353909a437 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:37 devstack sudo[92889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48.7d7b1d4b-f319-4ef2-abd7-aa353909a437 Jul 07 08:17:37 devstack sudo[92889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:37 devstack sudo[92888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5184807d-be65-4e51-b425-ebf0ee52fea3 Jul 07 08:17:37 devstack sudo[92888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:38 devstack sudo[92889]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-23c931bd-66c3-4675-931b-91daa659a2d0 req-9b891afb-67ab-4e4b-9a05-595ccb740ca4 tempest-VolumesSnapshotsTestJSON-1986971332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48.7d7b1d4b-f319-4ef2-abd7-aa353909a437" returned: 0 in 0.759s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-23c931bd-66c3-4675-931b-91daa659a2d0 req-9b891afb-67ab-4e4b-9a05-595ccb740ca4 tempest-VolumesSnapshotsTestJSON-1986971332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:38 devstack sudo[92888]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:38 devstack sudo[92896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48.info Jul 07 08:17:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-51bf9f75-0bd0-4e02-8e18-8ad9c49c7e65 tempest-GroupSnapshotsV319Test-1678235269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5184807d-be65-4e51-b425-ebf0ee52fea3" returned: 0 in 0.879s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:38 devstack sudo[92896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-51bf9f75-0bd0-4e02-8e18-8ad9c49c7e65 tempest-GroupSnapshotsV319Test-1678235269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5184807d-be65-4e51-b425-ebf0ee52fea3.c1049f85-86c6-4ad6-a489-8c2ab9704197 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:38 devstack sudo[92898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5184807d-be65-4e51-b425-ebf0ee52fea3.c1049f85-86c6-4ad6-a489-8c2ab9704197 Jul 07 08:17:38 devstack sudo[92898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:38 devstack sudo[92896]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-23c931bd-66c3-4675-931b-91daa659a2d0 req-9b891afb-67ab-4e4b-9a05-595ccb740ca4 tempest-VolumesSnapshotsTestJSON-1986971332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48.info" returned: 0 in 0.707s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:38 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [req-23c931bd-66c3-4675-931b-91daa659a2d0 req-9b891afb-67ab-4e4b-9a05-595ccb740ca4 tempest-VolumesSnapshotsTestJSON-1986971332 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48.info is being set with open permissions: ugo+rw Jul 07 08:17:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-23c931bd-66c3-4675-931b-91daa659a2d0 req-9b891afb-67ab-4e4b-9a05-595ccb740ca4 tempest-VolumesSnapshotsTestJSON-1986971332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:38 devstack sudo[92904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48.info Jul 07 08:17:38 devstack sudo[92904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:39 devstack sudo[92898]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-51bf9f75-0bd0-4e02-8e18-8ad9c49c7e65 tempest-GroupSnapshotsV319Test-1678235269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5184807d-be65-4e51-b425-ebf0ee52fea3.c1049f85-86c6-4ad6-a489-8c2ab9704197" returned: 0 in 0.788s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-51bf9f75-0bd0-4e02-8e18-8ad9c49c7e65 tempest-GroupSnapshotsV319Test-1678235269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5184807d-be65-4e51-b425-ebf0ee52fea3.c1049f85-86c6-4ad6-a489-8c2ab9704197 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:39 devstack sudo[92906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5184807d-be65-4e51-b425-ebf0ee52fea3.c1049f85-86c6-4ad6-a489-8c2ab9704197 Jul 07 08:17:39 devstack sudo[92906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:39 devstack sudo[92904]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-23c931bd-66c3-4675-931b-91daa659a2d0 req-9b891afb-67ab-4e4b-9a05-595ccb740ca4 tempest-VolumesSnapshotsTestJSON-1986971332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48.info" returned: 0 in 0.767s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-23c931bd-66c3-4675-931b-91daa659a2d0 req-9b891afb-67ab-4e4b-9a05-595ccb740ca4 tempest-VolumesSnapshotsTestJSON-1986971332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.042s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:17:39 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-23c931bd-66c3-4675-931b-91daa659a2d0 req-9b891afb-67ab-4e4b-9a05-595ccb740ca4 tempest-VolumesSnapshotsTestJSON-1986971332 None] Create snapshot completed successfully Jul 07 08:17:39 devstack sudo[92906]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-51bf9f75-0bd0-4e02-8e18-8ad9c49c7e65 tempest-GroupSnapshotsV319Test-1678235269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5184807d-be65-4e51-b425-ebf0ee52fea3.c1049f85-86c6-4ad6-a489-8c2ab9704197" returned: 0 in 0.852s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:39 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-51bf9f75-0bd0-4e02-8e18-8ad9c49c7e65 tempest-GroupSnapshotsV319Test-1678235269 None] Lock "cinder-quobyte-c1049f85-86c6-4ad6-a489-8c2ab9704197" released by "_delete_snapshot" :: held 3.491s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:17:39 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-51bf9f75-0bd0-4e02-8e18-8ad9c49c7e65 tempest-GroupSnapshotsV319Test-1678235269 None] Lock "cinder-quobyte-5184807d-be65-4e51-b425-ebf0ee52fea3" released by "delete_snapshot" :: held 3.514s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:17:39 devstack cinder-volume[87199]: WARNING cinder.quota [None req-51bf9f75-0bd0-4e02-8e18-8ad9c49c7e65 tempest-GroupSnapshotsV319Test-1678235269 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-819401029 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-819401029, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:17:39 devstack cinder-volume[87199]: WARNING cinder.quota [None req-51bf9f75-0bd0-4e02-8e18-8ad9c49c7e65 tempest-GroupSnapshotsV319Test-1678235269 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-819401029 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-819401029, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:17:40 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-51bf9f75-0bd0-4e02-8e18-8ad9c49c7e65 tempest-GroupSnapshotsV319Test-1678235269 None] Created reservations ['35b53273-7a5a-4157-b180-b8ac737bf530', 'b18f8ed1-4040-4eed-8193-6bc0cd5c3dc8', 'c169415f-f4d6-430f-b3a1-634b3ba6cb47', 'bcf3a203-2f16-4bde-b0b2-110f0d217b99'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:17:40 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-51bf9f75-0bd0-4e02-8e18-8ad9c49c7e65 tempest-GroupSnapshotsV319Test-1678235269 None] group_snapshot 5eb5a090-5de0-4138-a1ea-8d2b89413ab0: deleted successfully Jul 07 08:17:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [req-d95c1a8f-6f89-4000-82a7-3fc37f8e0e5b req-2bfb9ddf-1d07-4beb-a345-7178f7c25589 tempest-VolumesSnapshotsTestJSON-1986971332 None] Acquiring lock "cinder-7d7b1d4b-f319-4ef2-abd7-aa353909a437-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:17:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [req-d95c1a8f-6f89-4000-82a7-3fc37f8e0e5b req-2bfb9ddf-1d07-4beb-a345-7178f7c25589 tempest-VolumesSnapshotsTestJSON-1986971332 None] Lock "cinder-7d7b1d4b-f319-4ef2-abd7-aa353909a437-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:17:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [req-d95c1a8f-6f89-4000-82a7-3fc37f8e0e5b req-2bfb9ddf-1d07-4beb-a345-7178f7c25589 tempest-VolumesSnapshotsTestJSON-1986971332 None] Acquiring lock "cinder-quobyte-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:17:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [req-d95c1a8f-6f89-4000-82a7-3fc37f8e0e5b req-2bfb9ddf-1d07-4beb-a345-7178f7c25589 tempest-VolumesSnapshotsTestJSON-1986971332 None] Lock "cinder-quobyte-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:17:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [req-d95c1a8f-6f89-4000-82a7-3fc37f8e0e5b req-2bfb9ddf-1d07-4beb-a345-7178f7c25589 tempest-VolumesSnapshotsTestJSON-1986971332 None] Acquiring lock "cinder-quobyte-7d7b1d4b-f319-4ef2-abd7-aa353909a437" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:17:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [req-d95c1a8f-6f89-4000-82a7-3fc37f8e0e5b req-2bfb9ddf-1d07-4beb-a345-7178f7c25589 tempest-VolumesSnapshotsTestJSON-1986971332 None] Lock "cinder-quobyte-7d7b1d4b-f319-4ef2-abd7-aa353909a437" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:17:40 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [req-d95c1a8f-6f89-4000-82a7-3fc37f8e0e5b req-2bfb9ddf-1d07-4beb-a345-7178f7c25589 tempest-VolumesSnapshotsTestJSON-1986971332 None] Deleting offline snapshot 7d7b1d4b-f319-4ef2-abd7-aa353909a437 of volume 4a408a90-a3e3-4149-8d2a-b6f3f6bbea48 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:17:40 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [req-d95c1a8f-6f89-4000-82a7-3fc37f8e0e5b req-2bfb9ddf-1d07-4beb-a345-7178f7c25589 tempest-VolumesSnapshotsTestJSON-1986971332 None] snapshot_file for this snap is: volume-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48.7d7b1d4b-f319-4ef2-abd7-aa353909a437 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:17:40 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dad7fdf-31b7-4145-baed-26eca6491bd5]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:17:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-d95c1a8f-6f89-4000-82a7-3fc37f8e0e5b req-2bfb9ddf-1d07-4beb-a345-7178f7c25589 tempest-VolumesSnapshotsTestJSON-1986971332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48.7d7b1d4b-f319-4ef2-abd7-aa353909a437 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:40 devstack sudo[92932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48.7d7b1d4b-f319-4ef2-abd7-aa353909a437 Jul 07 08:17:40 devstack sudo[92932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:41 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-dd8dd5a1-5246-4c40-b6ae-dfe3394f3c7a tempest-GroupSnapshotsV319Test-1678235269 None] Acquiring lock "cinder-quobyte-5184807d-be65-4e51-b425-ebf0ee52fea3" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:17:41 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-dd8dd5a1-5246-4c40-b6ae-dfe3394f3c7a tempest-GroupSnapshotsV319Test-1678235269 None] Lock "cinder-quobyte-5184807d-be65-4e51-b425-ebf0ee52fea3" acquired by "delete_volume" :: waited 0.026s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:17:41 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[5602b935-1a49-4e6f-8beb-9e59c1dbaff1]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:17:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-dd8dd5a1-5246-4c40-b6ae-dfe3394f3c7a tempest-GroupSnapshotsV319Test-1678235269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5184807d-be65-4e51-b425-ebf0ee52fea3 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:41 devstack sudo[92947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5184807d-be65-4e51-b425-ebf0ee52fea3 Jul 07 08:17:41 devstack sudo[92947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:42 devstack sudo[92932]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-d95c1a8f-6f89-4000-82a7-3fc37f8e0e5b req-2bfb9ddf-1d07-4beb-a345-7178f7c25589 tempest-VolumesSnapshotsTestJSON-1986971332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48.7d7b1d4b-f319-4ef2-abd7-aa353909a437" returned: 0 in 1.335s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [req-d95c1a8f-6f89-4000-82a7-3fc37f8e0e5b req-2bfb9ddf-1d07-4beb-a345-7178f7c25589 tempest-VolumesSnapshotsTestJSON-1986971332 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:17:42 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7b72a1-d069-4996-bda9-ee93fa2733ad]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:17:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-d95c1a8f-6f89-4000-82a7-3fc37f8e0e5b req-2bfb9ddf-1d07-4beb-a345-7178f7c25589 tempest-VolumesSnapshotsTestJSON-1986971332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:42 devstack sudo[92953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48 Jul 07 08:17:42 devstack sudo[92953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:42 devstack sudo[92947]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-dd8dd5a1-5246-4c40-b6ae-dfe3394f3c7a tempest-GroupSnapshotsV319Test-1678235269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5184807d-be65-4e51-b425-ebf0ee52fea3" returned: 0 in 1.149s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-dd8dd5a1-5246-4c40-b6ae-dfe3394f3c7a tempest-GroupSnapshotsV319Test-1678235269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5184807d-be65-4e51-b425-ebf0ee52fea3 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:42 devstack sudo[92962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5184807d-be65-4e51-b425-ebf0ee52fea3 Jul 07 08:17:42 devstack sudo[92962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-2dafe4c9-a18a-44cc-9498-1a6b2722682f req-43db72f9-cb68-4d88-affd-d2ee0bef2e3e tempest-AttachVolumeShelveTestJSON-1859139297 None] No connector for attachment e1a2c97b-b01c-4f4a-94d9-ac6bfd30c71f; skipping storage backend terminate_connection call. {{(pid=87199) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 07 08:17:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-2dafe4c9-a18a-44cc-9498-1a6b2722682f req-43db72f9-cb68-4d88-affd-d2ee0bef2e3e tempest-AttachVolumeShelveTestJSON-1859139297 None] Deleting attachment e1a2c97b-b01c-4f4a-94d9-ac6bfd30c71f. {{(pid=87199) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 08:17:43 devstack sudo[92953]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-d95c1a8f-6f89-4000-82a7-3fc37f8e0e5b req-2bfb9ddf-1d07-4beb-a345-7178f7c25589 tempest-VolumesSnapshotsTestJSON-1986971332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48" returned: 0 in 1.128s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-d95c1a8f-6f89-4000-82a7-3fc37f8e0e5b req-2bfb9ddf-1d07-4beb-a345-7178f7c25589 tempest-VolumesSnapshotsTestJSON-1986971332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48.7d7b1d4b-f319-4ef2-abd7-aa353909a437 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:43 devstack sudo[92971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48.7d7b1d4b-f319-4ef2-abd7-aa353909a437 Jul 07 08:17:43 devstack sudo[92971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:43 devstack sudo[92962]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-dd8dd5a1-5246-4c40-b6ae-dfe3394f3c7a tempest-GroupSnapshotsV319Test-1678235269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5184807d-be65-4e51-b425-ebf0ee52fea3" returned: 0 in 0.891s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:43 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-dd8dd5a1-5246-4c40-b6ae-dfe3394f3c7a tempest-GroupSnapshotsV319Test-1678235269 None] Lock "cinder-quobyte-5184807d-be65-4e51-b425-ebf0ee52fea3" released by "delete_volume" :: held 2.140s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:17:43 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-dd8dd5a1-5246-4c40-b6ae-dfe3394f3c7a tempest-GroupSnapshotsV319Test-1678235269 None] Created reservations ['11197a91-de8a-4823-b793-b3c7c04c4883'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:17:43 devstack cinder-volume[87199]: WARNING cinder.quota [None req-dd8dd5a1-5246-4c40-b6ae-dfe3394f3c7a tempest-GroupSnapshotsV319Test-1678235269 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-819401029 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-819401029, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:17:43 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-dd8dd5a1-5246-4c40-b6ae-dfe3394f3c7a tempest-GroupSnapshotsV319Test-1678235269 None] Created reservations ['810efc92-bb1b-414e-bbf5-c5af5949fc33', '511f6e0a-0692-44b6-8485-989999845ad5', '8cfc60f2-f3d2-4031-87b1-59d91fc36fa2', '04b1e3ba-a3eb-42e7-a985-3b45f50ac82a'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:17:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-dd8dd5a1-5246-4c40-b6ae-dfe3394f3c7a tempest-GroupSnapshotsV319Test-1678235269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:17:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-dd8dd5a1-5246-4c40-b6ae-dfe3394f3c7a tempest-GroupSnapshotsV319Test-1678235269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:17:43 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-dd8dd5a1-5246-4c40-b6ae-dfe3394f3c7a tempest-GroupSnapshotsV319Test-1678235269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:17:43 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-dd8dd5a1-5246-4c40-b6ae-dfe3394f3c7a tempest-GroupSnapshotsV319Test-1678235269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:17:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-dd8dd5a1-5246-4c40-b6ae-dfe3394f3c7a tempest-GroupSnapshotsV319Test-1678235269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:17:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-dd8dd5a1-5246-4c40-b6ae-dfe3394f3c7a tempest-GroupSnapshotsV319Test-1678235269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:43 devstack sudo[92985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:17:43 devstack sudo[92985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:44 devstack sudo[92971]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-d95c1a8f-6f89-4000-82a7-3fc37f8e0e5b req-2bfb9ddf-1d07-4beb-a345-7178f7c25589 tempest-VolumesSnapshotsTestJSON-1986971332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48.7d7b1d4b-f319-4ef2-abd7-aa353909a437" returned: 0 in 1.123s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-d95c1a8f-6f89-4000-82a7-3fc37f8e0e5b req-2bfb9ddf-1d07-4beb-a345-7178f7c25589 tempest-VolumesSnapshotsTestJSON-1986971332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48.7d7b1d4b-f319-4ef2-abd7-aa353909a437 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:44 devstack sudo[93004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48.7d7b1d4b-f319-4ef2-abd7-aa353909a437 Jul 07 08:17:44 devstack sudo[93004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:45 devstack sudo[92985]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-dd8dd5a1-5246-4c40-b6ae-dfe3394f3c7a tempest-GroupSnapshotsV319Test-1678235269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 1.784s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:45 devstack sudo[93004]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:45 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-dd8dd5a1-5246-4c40-b6ae-dfe3394f3c7a tempest-GroupSnapshotsV319Test-1678235269 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:17:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-d95c1a8f-6f89-4000-82a7-3fc37f8e0e5b req-2bfb9ddf-1d07-4beb-a345-7178f7c25589 tempest-VolumesSnapshotsTestJSON-1986971332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48.7d7b1d4b-f319-4ef2-abd7-aa353909a437" returned: 0 in 1.437s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:45 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-dd8dd5a1-5246-4c40-b6ae-dfe3394f3c7a tempest-GroupSnapshotsV319Test-1678235269 None] Delete group completed successfully. Jul 07 08:17:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [req-d95c1a8f-6f89-4000-82a7-3fc37f8e0e5b req-2bfb9ddf-1d07-4beb-a345-7178f7c25589 tempest-VolumesSnapshotsTestJSON-1986971332 None] Lock "cinder-quobyte-7d7b1d4b-f319-4ef2-abd7-aa353909a437" released by "_delete_snapshot" :: held 5.199s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:17:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [req-d95c1a8f-6f89-4000-82a7-3fc37f8e0e5b req-2bfb9ddf-1d07-4beb-a345-7178f7c25589 tempest-VolumesSnapshotsTestJSON-1986971332 None] Lock "cinder-quobyte-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48" released by "delete_snapshot" :: held 5.248s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:17:45 devstack cinder-volume[87199]: WARNING cinder.quota [req-d95c1a8f-6f89-4000-82a7-3fc37f8e0e5b req-2bfb9ddf-1d07-4beb-a345-7178f7c25589 tempest-VolumesSnapshotsTestJSON-1986971332 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:17:46 devstack cinder-volume[87199]: DEBUG cinder.quota [req-d95c1a8f-6f89-4000-82a7-3fc37f8e0e5b req-2bfb9ddf-1d07-4beb-a345-7178f7c25589 tempest-VolumesSnapshotsTestJSON-1986971332 None] Created reservations ['40ed05a5-6461-4d5b-b4f5-3a54810f6e4f', '4c8eb1b2-0fd9-432c-9b9c-3549e2c4d007', 'ab77b989-20e1-4e85-a377-2b0caf6c8b66', '6ab835ee-1fc7-4ba3-b6c1-e62df490110e'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:17:46 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-d95c1a8f-6f89-4000-82a7-3fc37f8e0e5b req-2bfb9ddf-1d07-4beb-a345-7178f7c25589 tempest-VolumesSnapshotsTestJSON-1986971332 None] Delete snapshot completed successfully. Jul 07 08:17:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [req-d95c1a8f-6f89-4000-82a7-3fc37f8e0e5b req-2bfb9ddf-1d07-4beb-a345-7178f7c25589 tempest-VolumesSnapshotsTestJSON-1986971332 None] Lock "cinder-7d7b1d4b-f319-4ef2-abd7-aa353909a437-delete_snapshot" released by "delete_snapshot" :: held 5.559s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:17:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [req-e9153741-8a2b-4e1d-9310-15427301f311 req-cc72e20f-13cc-4915-bcb7-228ad12927d1 tempest-VolumesSnapshotsTestJSON-1986971332 None] Acquiring lock "cinder-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:17:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [req-e9153741-8a2b-4e1d-9310-15427301f311 req-cc72e20f-13cc-4915-bcb7-228ad12927d1 tempest-VolumesSnapshotsTestJSON-1986971332 None] Lock "cinder-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:17:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [req-e9153741-8a2b-4e1d-9310-15427301f311 req-cc72e20f-13cc-4915-bcb7-228ad12927d1 tempest-VolumesSnapshotsTestJSON-1986971332 None] Acquiring lock "cinder-quobyte-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:17:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [req-e9153741-8a2b-4e1d-9310-15427301f311 req-cc72e20f-13cc-4915-bcb7-228ad12927d1 tempest-VolumesSnapshotsTestJSON-1986971332 None] Lock "cinder-quobyte-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48" acquired by "delete_volume" :: waited 0.027s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:17:46 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e876902-22e7-4bb7-a350-480b78953e58]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:17:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-e9153741-8a2b-4e1d-9310-15427301f311 req-cc72e20f-13cc-4915-bcb7-228ad12927d1 tempest-VolumesSnapshotsTestJSON-1986971332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:47 devstack sudo[93070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48 Jul 07 08:17:47 devstack sudo[93070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:48 devstack sudo[93070]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-e9153741-8a2b-4e1d-9310-15427301f311 req-cc72e20f-13cc-4915-bcb7-228ad12927d1 tempest-VolumesSnapshotsTestJSON-1986971332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48" returned: 0 in 1.379s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-e9153741-8a2b-4e1d-9310-15427301f311 req-cc72e20f-13cc-4915-bcb7-228ad12927d1 tempest-VolumesSnapshotsTestJSON-1986971332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:48 devstack sudo[93076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48 Jul 07 08:17:48 devstack sudo[93076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:49 devstack sudo[93076]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-e9153741-8a2b-4e1d-9310-15427301f311 req-cc72e20f-13cc-4915-bcb7-228ad12927d1 tempest-VolumesSnapshotsTestJSON-1986971332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48" returned: 0 in 1.004s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:49 devstack cinder-volume[87199]: DEBUG cinder.coordination [req-e9153741-8a2b-4e1d-9310-15427301f311 req-cc72e20f-13cc-4915-bcb7-228ad12927d1 tempest-VolumesSnapshotsTestJSON-1986971332 None] Lock "cinder-quobyte-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48" released by "delete_volume" :: held 2.487s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:17:49 devstack cinder-volume[87199]: DEBUG cinder.quota [req-e9153741-8a2b-4e1d-9310-15427301f311 req-cc72e20f-13cc-4915-bcb7-228ad12927d1 tempest-VolumesSnapshotsTestJSON-1986971332 None] Created reservations ['2ce7b4f4-fa4f-4ada-8d1a-84b01bbb3efb', '24080b52-abe2-405a-af9b-e2386273e4e0', 'a383b567-543e-40b0-8a1c-caeeb755c7d8', '8fba6543-ba95-4fbd-a2cf-843a6319e006'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:17:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-e9153741-8a2b-4e1d-9310-15427301f311 req-cc72e20f-13cc-4915-bcb7-228ad12927d1 tempest-VolumesSnapshotsTestJSON-1986971332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:17:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-e9153741-8a2b-4e1d-9310-15427301f311 req-cc72e20f-13cc-4915-bcb7-228ad12927d1 tempest-VolumesSnapshotsTestJSON-1986971332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:17:49 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [req-e9153741-8a2b-4e1d-9310-15427301f311 req-cc72e20f-13cc-4915-bcb7-228ad12927d1 tempest-VolumesSnapshotsTestJSON-1986971332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:17:49 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [req-e9153741-8a2b-4e1d-9310-15427301f311 req-cc72e20f-13cc-4915-bcb7-228ad12927d1 tempest-VolumesSnapshotsTestJSON-1986971332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:17:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-e9153741-8a2b-4e1d-9310-15427301f311 req-cc72e20f-13cc-4915-bcb7-228ad12927d1 tempest-VolumesSnapshotsTestJSON-1986971332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:17:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-e9153741-8a2b-4e1d-9310-15427301f311 req-cc72e20f-13cc-4915-bcb7-228ad12927d1 tempest-VolumesSnapshotsTestJSON-1986971332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:49 devstack sudo[93079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:17:49 devstack sudo[93079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:50 devstack sudo[93079]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-e9153741-8a2b-4e1d-9310-15427301f311 req-cc72e20f-13cc-4915-bcb7-228ad12927d1 tempest-VolumesSnapshotsTestJSON-1986971332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.650s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:50 devstack cinder-volume[87199]: DEBUG cinder.manager [req-e9153741-8a2b-4e1d-9310-15427301f311 req-cc72e20f-13cc-4915-bcb7-228ad12927d1 tempest-VolumesSnapshotsTestJSON-1986971332 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:17:50 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-e9153741-8a2b-4e1d-9310-15427301f311 req-cc72e20f-13cc-4915-bcb7-228ad12927d1 tempest-VolumesSnapshotsTestJSON-1986971332 None] Deleted volume successfully. Jul 07 08:17:50 devstack cinder-volume[87199]: DEBUG cinder.coordination [req-e9153741-8a2b-4e1d-9310-15427301f311 req-cc72e20f-13cc-4915-bcb7-228ad12927d1 tempest-VolumesSnapshotsTestJSON-1986971332 None] Lock "cinder-4a408a90-a3e3-4149-8d2a-b6f3f6bbea48-delete_volume" released by "delete_volume" :: held 3.387s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:17:56 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-48c9b4d6-92cd-401f-9ddd-78bd0821dbfc tempest-GroupSnapshotsTest-1158654987 None] Group tempest-GroupSnapshotsTest-Group-1493427498: creating Jul 07 08:17:56 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-48c9b4d6-92cd-401f-9ddd-78bd0821dbfc tempest-GroupSnapshotsTest-1158654987 None] Group tempest-GroupSnapshotsTest-Group-1493427498: created successfully Jul 07 08:17:56 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-48c9b4d6-92cd-401f-9ddd-78bd0821dbfc tempest-GroupSnapshotsTest-1158654987 None] Create group completed successfully. Jul 07 08:17:58 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-965dd9c5-5af5-41ae-833b-fa2dbb18b711 tempest-GroupSnapshotsTest-1158654987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:17:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-965dd9c5-5af5-41ae-833b-fa2dbb18b711 tempest-GroupSnapshotsTest-1158654987 None] Flow 'volume_create_manager' (23d8efa7-68f6-4739-8c1e-032265915245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:17:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-965dd9c5-5af5-41ae-833b-fa2dbb18b711 tempest-GroupSnapshotsTest-1158654987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92d29338-bae0-4ec8-9d07-268f5e12824c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-965dd9c5-5af5-41ae-833b-fa2dbb18b711 tempest-GroupSnapshotsTest-1158654987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92d29338-bae0-4ec8-9d07-268f5e12824c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1439526290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=926831b7-f76d-4583-943c-90b7360c8c61,host='devstack@QuobyteHD#QuobyteHD',id=cc1926b8-75cc-4af9-bebf-a8395afac0bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='417afe6a9344432aa5cf82d0c0628928',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:17:58Z,use_quota=True,user_id='2b4f760dc5264853ae3787b174694b5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f9a320b9-bba8-4a4f-926e-2a2f449079d8),volume_type_id=f9a320b9-bba8-4a4f-926e-2a2f449079d8)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-965dd9c5-5af5-41ae-833b-fa2dbb18b711 tempest-GroupSnapshotsTest-1158654987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb615b1a-9f1b-4c55-ab37-6479ca0b939c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-965dd9c5-5af5-41ae-833b-fa2dbb18b711 tempest-GroupSnapshotsTest-1158654987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb615b1a-9f1b-4c55-ab37-6479ca0b939c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-965dd9c5-5af5-41ae-833b-fa2dbb18b711 tempest-GroupSnapshotsTest-1158654987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdf57236-8ec0-4500-a4ea-f054a6849fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-965dd9c5-5af5-41ae-833b-fa2dbb18b711 tempest-GroupSnapshotsTest-1158654987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdf57236-8ec0-4500-a4ea-f054a6849fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc1926b8-75cc-4af9-bebf-a8395afac0bb', 'volume_name': 'volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-965dd9c5-5af5-41ae-833b-fa2dbb18b711 tempest-GroupSnapshotsTest-1158654987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea67ce3e-318a-4554-94f8-d3a28b61fdb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-965dd9c5-5af5-41ae-833b-fa2dbb18b711 tempest-GroupSnapshotsTest-1158654987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea67ce3e-318a-4554-94f8-d3a28b61fdb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-965dd9c5-5af5-41ae-833b-fa2dbb18b711 tempest-GroupSnapshotsTest-1158654987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0647402-cd91-4a9d-8ae4-f0a9752fb34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:58 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-965dd9c5-5af5-41ae-833b-fa2dbb18b711 tempest-GroupSnapshotsTest-1158654987 None] Volume cc1926b8-75cc-4af9-bebf-a8395afac0bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb', 'volume_size': 1} Jul 07 08:17:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-965dd9c5-5af5-41ae-833b-fa2dbb18b711 tempest-GroupSnapshotsTest-1158654987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:17:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-965dd9c5-5af5-41ae-833b-fa2dbb18b711 tempest-GroupSnapshotsTest-1158654987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:17:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-965dd9c5-5af5-41ae-833b-fa2dbb18b711 tempest-GroupSnapshotsTest-1158654987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=926831b7-f76d-4583-943c-90b7360c8c61,created_at=2026-07-07T06:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1439526290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=926831b7-f76d-4583-943c-90b7360c8c61,host='devstack@QuobyteHD#QuobyteHD',id=cc1926b8-75cc-4af9-bebf-a8395afac0bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='417afe6a9344432aa5cf82d0c0628928',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:17:58Z,use_quota=True,user_id='2b4f760dc5264853ae3787b174694b5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f9a320b9-bba8-4a4f-926e-2a2f449079d8),volume_type_id=f9a320b9-bba8-4a4f-926e-2a2f449079d8)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:17:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-965dd9c5-5af5-41ae-833b-fa2dbb18b711 tempest-GroupSnapshotsTest-1158654987 None] Creating volume cc1926b8-75cc-4af9-bebf-a8395afac0bb {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:17:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-965dd9c5-5af5-41ae-833b-fa2dbb18b711 tempest-GroupSnapshotsTest-1158654987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:17:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-965dd9c5-5af5-41ae-833b-fa2dbb18b711 tempest-GroupSnapshotsTest-1158654987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:17:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-965dd9c5-5af5-41ae-833b-fa2dbb18b711 tempest-GroupSnapshotsTest-1158654987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:17:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-965dd9c5-5af5-41ae-833b-fa2dbb18b711 tempest-GroupSnapshotsTest-1158654987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:17:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-965dd9c5-5af5-41ae-833b-fa2dbb18b711 tempest-GroupSnapshotsTest-1158654987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:17:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-965dd9c5-5af5-41ae-833b-fa2dbb18b711 tempest-GroupSnapshotsTest-1158654987 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:17:58 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-965dd9c5-5af5-41ae-833b-fa2dbb18b711 tempest-GroupSnapshotsTest-1158654987 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:17:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-965dd9c5-5af5-41ae-833b-fa2dbb18b711 tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:58 devstack sudo[93086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb 1073741824 Jul 07 08:17:58 devstack sudo[93086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:59 devstack sudo[93086]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-965dd9c5-5af5-41ae-833b-fa2dbb18b711 tempest-GroupSnapshotsTest-1158654987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb 1073741824" returned: 0 in 0.907s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-965dd9c5-5af5-41ae-833b-fa2dbb18b711 tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:59 devstack sudo[93109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb Jul 07 08:17:59 devstack sudo[93109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:00 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-67e900f7-f824-443d-8ab8-9e68041b3505 tempest-SnapshotsActionsTest-452788111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:18:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-67e900f7-f824-443d-8ab8-9e68041b3505 tempest-SnapshotsActionsTest-452788111 None] Flow 'volume_create_manager' (dc04a660-a8ea-4a7d-917c-db56b82220d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:18:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-67e900f7-f824-443d-8ab8-9e68041b3505 tempest-SnapshotsActionsTest-452788111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7252c534-422d-43c8-ae71-c3e1ac7d8366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:18:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-67e900f7-f824-443d-8ab8-9e68041b3505 tempest-SnapshotsActionsTest-452788111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7252c534-422d-43c8-ae71-c3e1ac7d8366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-616089730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97ff669d-e3e6-44da-95b7-dad653e0cecc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b2815a3c0e543fba5b8ba7693733378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:18:00Z,use_quota=True,user_id='4670fbc534e54b84bd1cde7f25ee2a82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:18:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-67e900f7-f824-443d-8ab8-9e68041b3505 tempest-SnapshotsActionsTest-452788111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (183bf8d9-c283-4d76-8681-0cfc4b023c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:18:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-67e900f7-f824-443d-8ab8-9e68041b3505 tempest-SnapshotsActionsTest-452788111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (183bf8d9-c283-4d76-8681-0cfc4b023c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:18:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-67e900f7-f824-443d-8ab8-9e68041b3505 tempest-SnapshotsActionsTest-452788111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03143ceb-325b-4bc1-b867-e166e9c9ecd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:18:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-67e900f7-f824-443d-8ab8-9e68041b3505 tempest-SnapshotsActionsTest-452788111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03143ceb-325b-4bc1-b867-e166e9c9ecd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97ff669d-e3e6-44da-95b7-dad653e0cecc', 'volume_name': 'volume-97ff669d-e3e6-44da-95b7-dad653e0cecc', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:18:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-67e900f7-f824-443d-8ab8-9e68041b3505 tempest-SnapshotsActionsTest-452788111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66f846a4-2d02-481f-b5a3-d4f0b851f1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:18:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-67e900f7-f824-443d-8ab8-9e68041b3505 tempest-SnapshotsActionsTest-452788111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66f846a4-2d02-481f-b5a3-d4f0b851f1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:18:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-67e900f7-f824-443d-8ab8-9e68041b3505 tempest-SnapshotsActionsTest-452788111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ec8b9dc-898b-4011-b5ac-ded50897d5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:18:00 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-67e900f7-f824-443d-8ab8-9e68041b3505 tempest-SnapshotsActionsTest-452788111 None] Volume 97ff669d-e3e6-44da-95b7-dad653e0cecc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97ff669d-e3e6-44da-95b7-dad653e0cecc', 'volume_size': 1} Jul 07 08:18:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-67e900f7-f824-443d-8ab8-9e68041b3505 tempest-SnapshotsActionsTest-452788111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:18:00 devstack sudo[93109]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-965dd9c5-5af5-41ae-833b-fa2dbb18b711 tempest-GroupSnapshotsTest-1158654987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb" returned: 0 in 0.682s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:00 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-965dd9c5-5af5-41ae-833b-fa2dbb18b711 tempest-GroupSnapshotsTest-1158654987 None] <== create_volume: return (1644ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:18:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-965dd9c5-5af5-41ae-833b-fa2dbb18b711 tempest-GroupSnapshotsTest-1158654987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.647s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:18:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-67e900f7-f824-443d-8ab8-9e68041b3505 tempest-SnapshotsActionsTest-452788111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.030s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:18:00 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-67e900f7-f824-443d-8ab8-9e68041b3505 tempest-SnapshotsActionsTest-452788111 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-616089730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97ff669d-e3e6-44da-95b7-dad653e0cecc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b2815a3c0e543fba5b8ba7693733378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:18:00Z,use_quota=True,user_id='4670fbc534e54b84bd1cde7f25ee2a82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:18:00 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-67e900f7-f824-443d-8ab8-9e68041b3505 tempest-SnapshotsActionsTest-452788111 None] Creating volume 97ff669d-e3e6-44da-95b7-dad653e0cecc {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:18:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-67e900f7-f824-443d-8ab8-9e68041b3505 tempest-SnapshotsActionsTest-452788111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:18:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-67e900f7-f824-443d-8ab8-9e68041b3505 tempest-SnapshotsActionsTest-452788111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:18:00 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-67e900f7-f824-443d-8ab8-9e68041b3505 tempest-SnapshotsActionsTest-452788111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:18:00 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-67e900f7-f824-443d-8ab8-9e68041b3505 tempest-SnapshotsActionsTest-452788111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:18:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-67e900f7-f824-443d-8ab8-9e68041b3505 tempest-SnapshotsActionsTest-452788111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:18:00 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-67e900f7-f824-443d-8ab8-9e68041b3505 tempest-SnapshotsActionsTest-452788111 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:18:00 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-67e900f7-f824-443d-8ab8-9e68041b3505 tempest-SnapshotsActionsTest-452788111 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:18:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-67e900f7-f824-443d-8ab8-9e68041b3505 tempest-SnapshotsActionsTest-452788111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:00 devstack sudo[93122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc 1073741824 Jul 07 08:18:00 devstack sudo[93122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-965dd9c5-5af5-41ae-833b-fa2dbb18b711 tempest-GroupSnapshotsTest-1158654987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0647402-cd91-4a9d-8ae4-f0a9752fb34b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:18:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-965dd9c5-5af5-41ae-833b-fa2dbb18b711 tempest-GroupSnapshotsTest-1158654987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (777adc7a-4e1e-405e-bf0d-0a89a5ef7c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:18:00 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-965dd9c5-5af5-41ae-833b-fa2dbb18b711 tempest-GroupSnapshotsTest-1158654987 None] Volume volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb (cc1926b8-75cc-4af9-bebf-a8395afac0bb): created successfully Jul 07 08:18:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-965dd9c5-5af5-41ae-833b-fa2dbb18b711 tempest-GroupSnapshotsTest-1158654987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (777adc7a-4e1e-405e-bf0d-0a89a5ef7c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:18:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-965dd9c5-5af5-41ae-833b-fa2dbb18b711 tempest-GroupSnapshotsTest-1158654987 None] Flow 'volume_create_manager' (23d8efa7-68f6-4739-8c1e-032265915245) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:18:00 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-965dd9c5-5af5-41ae-833b-fa2dbb18b711 tempest-GroupSnapshotsTest-1158654987 None] Created volume successfully. Jul 07 08:18:01 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-acde7263-2e53-4d04-8fcd-40b3875cbb63 tempest-GroupSnapshotsTest-1158654987 None] GroupSnapshot d2386110-b0be-4291-87f2-51da10a201a2: creating. Jul 07 08:18:01 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-acde7263-2e53-4d04-8fcd-40b3875cbb63 tempest-GroupSnapshotsTest-1158654987 None] Group snapshot d2386110-b0be-4291-87f2-51da10a201a2: creating. {{(pid=87199) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 07 08:18:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-acde7263-2e53-4d04-8fcd-40b3875cbb63 tempest-GroupSnapshotsTest-1158654987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:18:01 devstack sudo[93122]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-67e900f7-f824-443d-8ab8-9e68041b3505 tempest-SnapshotsActionsTest-452788111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc 1073741824" returned: 0 in 1.024s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-67e900f7-f824-443d-8ab8-9e68041b3505 tempest-SnapshotsActionsTest-452788111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:01 devstack sudo[93139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc Jul 07 08:18:01 devstack sudo[93139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:02 devstack sudo[93139]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-67e900f7-f824-443d-8ab8-9e68041b3505 tempest-SnapshotsActionsTest-452788111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc" returned: 0 in 0.768s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:02 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-67e900f7-f824-443d-8ab8-9e68041b3505 tempest-SnapshotsActionsTest-452788111 None] <== create_volume: return (1839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:18:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-67e900f7-f824-443d-8ab8-9e68041b3505 tempest-SnapshotsActionsTest-452788111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.841s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:18:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-acde7263-2e53-4d04-8fcd-40b3875cbb63 tempest-GroupSnapshotsTest-1158654987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.873s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:18:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-67e900f7-f824-443d-8ab8-9e68041b3505 tempest-SnapshotsActionsTest-452788111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ec8b9dc-898b-4011-b5ac-ded50897d5ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97ff669d-e3e6-44da-95b7-dad653e0cecc', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:18:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-67e900f7-f824-443d-8ab8-9e68041b3505 tempest-SnapshotsActionsTest-452788111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4160382c-410f-4a74-8b1f-b4db7f85341a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:18:02 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-acde7263-2e53-4d04-8fcd-40b3875cbb63 tempest-GroupSnapshotsTest-1158654987 None] Creating offline snapshot fa5ca960-bb30-4259-8a15-2f80f45a1699 of volume cc1926b8-75cc-4af9-bebf-a8395afac0bb {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:18:02 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-67e900f7-f824-443d-8ab8-9e68041b3505 tempest-SnapshotsActionsTest-452788111 None] Volume volume-97ff669d-e3e6-44da-95b7-dad653e0cecc (97ff669d-e3e6-44da-95b7-dad653e0cecc): created successfully Jul 07 08:18:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-67e900f7-f824-443d-8ab8-9e68041b3505 tempest-SnapshotsActionsTest-452788111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4160382c-410f-4a74-8b1f-b4db7f85341a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:18:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-67e900f7-f824-443d-8ab8-9e68041b3505 tempest-SnapshotsActionsTest-452788111 None] Flow 'volume_create_manager' (dc04a660-a8ea-4a7d-917c-db56b82220d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:18:02 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2c893b-5511-4af5-8077-42ce75614746]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:18:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-acde7263-2e53-4d04-8fcd-40b3875cbb63 tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:02 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-67e900f7-f824-443d-8ab8-9e68041b3505 tempest-SnapshotsActionsTest-452788111 None] Created volume successfully. Jul 07 08:18:02 devstack sudo[93142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb Jul 07 08:18:02 devstack sudo[93142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-02283e99-6f40-4462-8d31-9f15705f01ec tempest-SnapshotsActionsTest-452788111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:18:02 devstack sudo[93142]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-acde7263-2e53-4d04-8fcd-40b3875cbb63 tempest-GroupSnapshotsTest-1158654987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb" returned: 0 in 0.883s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-acde7263-2e53-4d04-8fcd-40b3875cbb63 tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb.fa5ca960-bb30-4259-8a15-2f80f45a1699 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:02 devstack sudo[93147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb.fa5ca960-bb30-4259-8a15-2f80f45a1699 1G Jul 07 08:18:02 devstack sudo[93147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:04 devstack sudo[93147]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-acde7263-2e53-4d04-8fcd-40b3875cbb63 tempest-GroupSnapshotsTest-1158654987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb.fa5ca960-bb30-4259-8a15-2f80f45a1699 1G" returned: 0 in 1.119s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-acde7263-2e53-4d04-8fcd-40b3875cbb63 tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb.fa5ca960-bb30-4259-8a15-2f80f45a1699 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:04 devstack sudo[93195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb.fa5ca960-bb30-4259-8a15-2f80f45a1699 Jul 07 08:18:04 devstack sudo[93195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:04 devstack sudo[93195]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-acde7263-2e53-4d04-8fcd-40b3875cbb63 tempest-GroupSnapshotsTest-1158654987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb.fa5ca960-bb30-4259-8a15-2f80f45a1699" returned: 0 in 0.842s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:04 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-acde7263-2e53-4d04-8fcd-40b3875cbb63 tempest-GroupSnapshotsTest-1158654987 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb.fa5ca960-bb30-4259-8a15-2f80f45a1699 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 08:18:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-acde7263-2e53-4d04-8fcd-40b3875cbb63 tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb.fa5ca960-bb30-4259-8a15-2f80f45a1699 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:04 devstack sudo[93206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb.fa5ca960-bb30-4259-8a15-2f80f45a1699 Jul 07 08:18:04 devstack sudo[93206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:05 devstack sudo[93206]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-acde7263-2e53-4d04-8fcd-40b3875cbb63 tempest-GroupSnapshotsTest-1158654987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb.fa5ca960-bb30-4259-8a15-2f80f45a1699" returned: 0 in 0.749s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-acde7263-2e53-4d04-8fcd-40b3875cbb63 tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:05 devstack sudo[93228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb.info Jul 07 08:18:05 devstack sudo[93228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:05 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:18:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:18:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:18:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:18:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:18:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:18:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:05 devstack sudo[93230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:18:05 devstack sudo[93230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:06 devstack sudo[93228]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-acde7263-2e53-4d04-8fcd-40b3875cbb63 tempest-GroupSnapshotsTest-1158654987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb.info" returned: 0 in 0.813s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:06 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-acde7263-2e53-4d04-8fcd-40b3875cbb63 tempest-GroupSnapshotsTest-1158654987 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 08:18:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-acde7263-2e53-4d04-8fcd-40b3875cbb63 tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:06 devstack sudo[93237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb.info Jul 07 08:18:06 devstack sudo[93237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:06 devstack sudo[93230]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.935s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:06 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:18:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running periodic task VolumeManager._thread_info {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:18:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] thread count: 8 {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 08:18:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] thread info: [<_MainThread(MainThread, started 133056092332160)>, , , , , , , ] {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 08:18:07 devstack sudo[93237]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-acde7263-2e53-4d04-8fcd-40b3875cbb63 tempest-GroupSnapshotsTest-1158654987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb.info" returned: 0 in 0.758s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-acde7263-2e53-4d04-8fcd-40b3875cbb63 tempest-GroupSnapshotsTest-1158654987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.291s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:18:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-02283e99-6f40-4462-8d31-9f15705f01ec tempest-SnapshotsActionsTest-452788111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.780s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:18:07 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=75,cinder:INSERT=21,cinder:UPDATE=93,cinder:DELETE=9 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:18:07 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-02283e99-6f40-4462-8d31-9f15705f01ec tempest-SnapshotsActionsTest-452788111 None] Creating offline snapshot 45a45194-0242-46c9-9b21-f0643a744cad of volume 97ff669d-e3e6-44da-95b7-dad653e0cecc {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:18:07 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3d5c0f-c6c1-4671-b9a2-45f2b0e0b640]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:18:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-02283e99-6f40-4462-8d31-9f15705f01ec tempest-SnapshotsActionsTest-452788111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:07 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-acde7263-2e53-4d04-8fcd-40b3875cbb63 tempest-GroupSnapshotsTest-1158654987 None] group_snapshot d2386110-b0be-4291-87f2-51da10a201a2: created successfully Jul 07 08:18:07 devstack sudo[93240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc Jul 07 08:18:07 devstack sudo[93240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:08 devstack sudo[93240]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-02283e99-6f40-4462-8d31-9f15705f01ec tempest-SnapshotsActionsTest-452788111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc" returned: 0 in 0.888s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-02283e99-6f40-4462-8d31-9f15705f01ec tempest-SnapshotsActionsTest-452788111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:08 devstack sudo[93246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad 1G Jul 07 08:18:08 devstack sudo[93246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:08 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:UPDATE=85,cinder:SELECT=83,cinder:INSERT=21,cinder:DELETE=3 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:18:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-82f97c24-2585-4161-8cf9-6a41f646434b tempest-GroupSnapshotsTest-1158654987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:18:09 devstack sudo[93246]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-02283e99-6f40-4462-8d31-9f15705f01ec tempest-SnapshotsActionsTest-452788111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad 1G" returned: 0 in 1.098s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-02283e99-6f40-4462-8d31-9f15705f01ec tempest-SnapshotsActionsTest-452788111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97ff669d-e3e6-44da-95b7-dad653e0cecc -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:09 devstack sudo[93255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97ff669d-e3e6-44da-95b7-dad653e0cecc -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad Jul 07 08:18:09 devstack sudo[93255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:10 devstack sudo[93255]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-02283e99-6f40-4462-8d31-9f15705f01ec tempest-SnapshotsActionsTest-452788111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97ff669d-e3e6-44da-95b7-dad653e0cecc -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad" returned: 0 in 0.783s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:10 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-02283e99-6f40-4462-8d31-9f15705f01ec tempest-SnapshotsActionsTest-452788111 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad is being set with open permissions: ugo+rw Jul 07 08:18:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-02283e99-6f40-4462-8d31-9f15705f01ec tempest-SnapshotsActionsTest-452788111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:10 devstack sudo[93261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad Jul 07 08:18:10 devstack sudo[93261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:10 devstack sudo[93261]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-02283e99-6f40-4462-8d31-9f15705f01ec tempest-SnapshotsActionsTest-452788111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad" returned: 0 in 0.637s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-02283e99-6f40-4462-8d31-9f15705f01ec tempest-SnapshotsActionsTest-452788111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:10 devstack sudo[93269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.info Jul 07 08:18:10 devstack sudo[93269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:11 devstack sudo[93269]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-02283e99-6f40-4462-8d31-9f15705f01ec tempest-SnapshotsActionsTest-452788111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.info" returned: 0 in 0.981s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:11 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-02283e99-6f40-4462-8d31-9f15705f01ec tempest-SnapshotsActionsTest-452788111 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.info is being set with open permissions: ugo+rw Jul 07 08:18:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-02283e99-6f40-4462-8d31-9f15705f01ec tempest-SnapshotsActionsTest-452788111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:11 devstack sudo[93289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.info Jul 07 08:18:11 devstack sudo[93289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:12 devstack sudo[93289]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-02283e99-6f40-4462-8d31-9f15705f01ec tempest-SnapshotsActionsTest-452788111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.info" returned: 0 in 0.785s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-02283e99-6f40-4462-8d31-9f15705f01ec tempest-SnapshotsActionsTest-452788111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.282s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:18:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-82f97c24-2585-4161-8cf9-6a41f646434b tempest-GroupSnapshotsTest-1158654987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.696s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:18:12 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-82f97c24-2585-4161-8cf9-6a41f646434b tempest-GroupSnapshotsTest-1158654987 None] Acquiring lock "cinder-quobyte-fa5ca960-bb30-4259-8a15-2f80f45a1699-43b82feb-a3fe-469c-b6c0-ae21c5ff6599" by "_create_volume_from_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:18:12 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-82f97c24-2585-4161-8cf9-6a41f646434b tempest-GroupSnapshotsTest-1158654987 None] Lock "cinder-quobyte-fa5ca960-bb30-4259-8a15-2f80f45a1699-43b82feb-a3fe-469c-b6c0-ae21c5ff6599" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:18:12 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-82f97c24-2585-4161-8cf9-6a41f646434b tempest-GroupSnapshotsTest-1158654987 None] Creating volume 43b82feb-a3fe-469c-b6c0-ae21c5ff6599 from snapshot fa5ca960-bb30-4259-8a15-2f80f45a1699 {{(pid=87199) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 08:18:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-82f97c24-2585-4161-8cf9-6a41f646434b tempest-GroupSnapshotsTest-1158654987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:18:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-82f97c24-2585-4161-8cf9-6a41f646434b tempest-GroupSnapshotsTest-1158654987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:18:12 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-82f97c24-2585-4161-8cf9-6a41f646434b tempest-GroupSnapshotsTest-1158654987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:18:12 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-82f97c24-2585-4161-8cf9-6a41f646434b tempest-GroupSnapshotsTest-1158654987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:18:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-82f97c24-2585-4161-8cf9-6a41f646434b tempest-GroupSnapshotsTest-1158654987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:18:12 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-82f97c24-2585-4161-8cf9-6a41f646434b tempest-GroupSnapshotsTest-1158654987 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:18:12 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-82f97c24-2585-4161-8cf9-6a41f646434b tempest-GroupSnapshotsTest-1158654987 None] Acquiring lock "cinder-quobyte-43b82feb-a3fe-469c-b6c0-ae21c5ff6599" by "_copy_volume_from_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:18:12 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-82f97c24-2585-4161-8cf9-6a41f646434b tempest-GroupSnapshotsTest-1158654987 None] Lock "cinder-quobyte-43b82feb-a3fe-469c-b6c0-ae21c5ff6599" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:18:12 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-82f97c24-2585-4161-8cf9-6a41f646434b tempest-GroupSnapshotsTest-1158654987 None] snapshot: fa5ca960-bb30-4259-8a15-2f80f45a1699, volume: 43b82feb-a3fe-469c-b6c0-ae21c5ff6599, {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 08:18:12 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-02283e99-6f40-4462-8d31-9f15705f01ec tempest-SnapshotsActionsTest-452788111 None] Create snapshot completed successfully Jul 07 08:18:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-82f97c24-2585-4161-8cf9-6a41f646434b tempest-GroupSnapshotsTest-1158654987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:18:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-82f97c24-2585-4161-8cf9-6a41f646434b tempest-GroupSnapshotsTest-1158654987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:18:12 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-82f97c24-2585-4161-8cf9-6a41f646434b tempest-GroupSnapshotsTest-1158654987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:18:12 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-82f97c24-2585-4161-8cf9-6a41f646434b tempest-GroupSnapshotsTest-1158654987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:18:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-82f97c24-2585-4161-8cf9-6a41f646434b tempest-GroupSnapshotsTest-1158654987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:18:12 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[82974e1a-8db9-42a7-a667-21dbc82dd422]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:18:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-82f97c24-2585-4161-8cf9-6a41f646434b tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb.fa5ca960-bb30-4259-8a15-2f80f45a1699 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:12 devstack sudo[93294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb.fa5ca960-bb30-4259-8a15-2f80f45a1699 Jul 07 08:18:12 devstack sudo[93294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:13 devstack sudo[93294]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-82f97c24-2585-4161-8cf9-6a41f646434b tempest-GroupSnapshotsTest-1158654987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb.fa5ca960-bb30-4259-8a15-2f80f45a1699" returned: 0 in 0.814s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-82f97c24-2585-4161-8cf9-6a41f646434b tempest-GroupSnapshotsTest-1158654987 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:18:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-82f97c24-2585-4161-8cf9-6a41f646434b tempest-GroupSnapshotsTest-1158654987 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 08:18:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-82f97c24-2585-4161-8cf9-6a41f646434b tempest-GroupSnapshotsTest-1158654987 None] Creating direct copy from snapshot {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 08:18:13 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c55047e-7dab-4953-b052-c1e0e30c9a72]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:18:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-82f97c24-2585-4161-8cf9-6a41f646434b tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8fba2ae0-caeb-4d26-b2e2-e2d06b5f8a6f tempest-SnapshotsActionsTest-452788111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:18:13 devstack sudo[93299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb Jul 07 08:18:13 devstack sudo[93299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:14 devstack sudo[93299]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-82f97c24-2585-4161-8cf9-6a41f646434b tempest-GroupSnapshotsTest-1158654987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb" returned: 0 in 0.863s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:14 devstack cinder-volume[87199]: DEBUG cinder.utils [None req-82f97c24-2585-4161-8cf9-6a41f646434b tempest-GroupSnapshotsTest-1158654987 None] Path /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-43b82feb-a3fe-469c-b6c0-ae21c5ff6599 not found in is_blk_device check {{(pid=87199) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 08:18:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-82f97c24-2585-4161-8cf9-6a41f646434b tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-43b82feb-a3fe-469c-b6c0-ae21c5ff6599 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:14 devstack sudo[93304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-43b82feb-a3fe-469c-b6c0-ae21c5ff6599 Jul 07 08:18:14 devstack sudo[93304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:20 devstack sudo[93304]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-82f97c24-2585-4161-8cf9-6a41f646434b tempest-GroupSnapshotsTest-1158654987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-43b82feb-a3fe-469c-b6c0-ae21c5ff6599" returned: 0 in 6.380s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:20 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9fc2980-70f4-4a1c-b690-4a6267552a41]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:18:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-82f97c24-2585-4161-8cf9-6a41f646434b tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:20 devstack sudo[93337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb Jul 07 08:18:20 devstack sudo[93337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:21 devstack sudo[93337]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-82f97c24-2585-4161-8cf9-6a41f646434b tempest-GroupSnapshotsTest-1158654987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb" returned: 0 in 0.972s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:21 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-82f97c24-2585-4161-8cf9-6a41f646434b tempest-GroupSnapshotsTest-1158654987 None] Image conversion details: src /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb, size 1024.00 MB, duration 6.38 sec, destination /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-43b82feb-a3fe-469c-b6c0-ae21c5ff6599 {{(pid=87199) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 08:18:21 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-82f97c24-2585-4161-8cf9-6a41f646434b tempest-GroupSnapshotsTest-1158654987 None] Converted 1024.00 MB image at 160.47 MB/s Jul 07 08:18:21 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-82f97c24-2585-4161-8cf9-6a41f646434b tempest-GroupSnapshotsTest-1158654987 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-43b82feb-a3fe-469c-b6c0-ae21c5ff6599 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 08:18:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-82f97c24-2585-4161-8cf9-6a41f646434b tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-43b82feb-a3fe-469c-b6c0-ae21c5ff6599 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:21 devstack sudo[93349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-43b82feb-a3fe-469c-b6c0-ae21c5ff6599 Jul 07 08:18:21 devstack sudo[93349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:22 devstack sudo[93349]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-82f97c24-2585-4161-8cf9-6a41f646434b tempest-GroupSnapshotsTest-1158654987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-43b82feb-a3fe-469c-b6c0-ae21c5ff6599" returned: 0 in 0.682s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:22 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-82f97c24-2585-4161-8cf9-6a41f646434b tempest-GroupSnapshotsTest-1158654987 None] Lock "cinder-quobyte-43b82feb-a3fe-469c-b6c0-ae21c5ff6599" released by "_copy_volume_from_snapshot" :: held 9.832s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:18:22 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-82f97c24-2585-4161-8cf9-6a41f646434b tempest-GroupSnapshotsTest-1158654987 None] Lock "cinder-quobyte-fa5ca960-bb30-4259-8a15-2f80f45a1699-43b82feb-a3fe-469c-b6c0-ae21c5ff6599" released by "_create_volume_from_snapshot" :: held 9.895s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:18:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-82f97c24-2585-4161-8cf9-6a41f646434b tempest-GroupSnapshotsTest-1158654987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.926s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:18:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8fba2ae0-caeb-4d26-b2e2-e2d06b5f8a6f tempest-SnapshotsActionsTest-452788111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.891s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:18:22 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-8fba2ae0-caeb-4d26-b2e2-e2d06b5f8a6f tempest-SnapshotsActionsTest-452788111 None] Creating offline snapshot 426ade0a-2f8c-4d64-99c7-d305b42576be of volume 97ff669d-e3e6-44da-95b7-dad653e0cecc {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:18:22 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[333e8598-f515-49c5-8873-cdc1ee49eeb1]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:18:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8fba2ae0-caeb-4d26-b2e2-e2d06b5f8a6f tempest-SnapshotsActionsTest-452788111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:22 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-82f97c24-2585-4161-8cf9-6a41f646434b tempest-GroupSnapshotsTest-1158654987 None] Create group from source-snapshot-d2386110-b0be-4291-87f2-51da10a201a2 completed successfully. Jul 07 08:18:22 devstack sudo[93352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad Jul 07 08:18:22 devstack sudo[93352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:23 devstack sudo[93352]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8fba2ae0-caeb-4d26-b2e2-e2d06b5f8a6f tempest-SnapshotsActionsTest-452788111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad" returned: 0 in 0.839s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-8fba2ae0-caeb-4d26-b2e2-e2d06b5f8a6f tempest-SnapshotsActionsTest-452788111 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97ff669d-e3e6-44da-95b7-dad653e0cecc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:18:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8fba2ae0-caeb-4d26-b2e2-e2d06b5f8a6f tempest-SnapshotsActionsTest-452788111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.426ade0a-2f8c-4d64-99c7-d305b42576be 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:23 devstack sudo[93360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.426ade0a-2f8c-4d64-99c7-d305b42576be 1G Jul 07 08:18:23 devstack sudo[93360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:23 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0fd18e03-ec6e-460d-bfe1-54d42c37b242 tempest-GroupSnapshotsTest-1158654987 None] Acquiring lock "cinder-quobyte-43b82feb-a3fe-469c-b6c0-ae21c5ff6599" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:18:23 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0fd18e03-ec6e-460d-bfe1-54d42c37b242 tempest-GroupSnapshotsTest-1158654987 None] Lock "cinder-quobyte-43b82feb-a3fe-469c-b6c0-ae21c5ff6599" acquired by "delete_volume" :: waited 0.017s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:18:23 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7c7c24-a69d-4419-98a3-315b3356f424]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:18:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0fd18e03-ec6e-460d-bfe1-54d42c37b242 tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-43b82feb-a3fe-469c-b6c0-ae21c5ff6599 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:23 devstack sudo[93362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-43b82feb-a3fe-469c-b6c0-ae21c5ff6599 Jul 07 08:18:23 devstack sudo[93362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:24 devstack sudo[93360]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8fba2ae0-caeb-4d26-b2e2-e2d06b5f8a6f tempest-SnapshotsActionsTest-452788111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.426ade0a-2f8c-4d64-99c7-d305b42576be 1G" returned: 0 in 0.829s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8fba2ae0-caeb-4d26-b2e2-e2d06b5f8a6f tempest-SnapshotsActionsTest-452788111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.426ade0a-2f8c-4d64-99c7-d305b42576be {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:24 devstack sudo[93368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.426ade0a-2f8c-4d64-99c7-d305b42576be Jul 07 08:18:24 devstack sudo[93368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:24 devstack sudo[93362]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0fd18e03-ec6e-460d-bfe1-54d42c37b242 tempest-GroupSnapshotsTest-1158654987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-43b82feb-a3fe-469c-b6c0-ae21c5ff6599" returned: 0 in 0.875s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0fd18e03-ec6e-460d-bfe1-54d42c37b242 tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-43b82feb-a3fe-469c-b6c0-ae21c5ff6599 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:24 devstack sudo[93408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-43b82feb-a3fe-469c-b6c0-ae21c5ff6599 Jul 07 08:18:24 devstack sudo[93408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:25 devstack sudo[93368]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8fba2ae0-caeb-4d26-b2e2-e2d06b5f8a6f tempest-SnapshotsActionsTest-452788111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.426ade0a-2f8c-4d64-99c7-d305b42576be" returned: 0 in 0.767s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:25 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-8fba2ae0-caeb-4d26-b2e2-e2d06b5f8a6f tempest-SnapshotsActionsTest-452788111 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.426ade0a-2f8c-4d64-99c7-d305b42576be is being set with open permissions: ugo+rw Jul 07 08:18:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8fba2ae0-caeb-4d26-b2e2-e2d06b5f8a6f tempest-SnapshotsActionsTest-452788111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.426ade0a-2f8c-4d64-99c7-d305b42576be {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:25 devstack sudo[93415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.426ade0a-2f8c-4d64-99c7-d305b42576be Jul 07 08:18:25 devstack sudo[93415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:25 devstack sudo[93408]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0fd18e03-ec6e-460d-bfe1-54d42c37b242 tempest-GroupSnapshotsTest-1158654987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-43b82feb-a3fe-469c-b6c0-ae21c5ff6599" returned: 0 in 0.754s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:25 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0fd18e03-ec6e-460d-bfe1-54d42c37b242 tempest-GroupSnapshotsTest-1158654987 None] Lock "cinder-quobyte-43b82feb-a3fe-469c-b6c0-ae21c5ff6599" released by "delete_volume" :: held 1.667s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:18:25 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-0fd18e03-ec6e-460d-bfe1-54d42c37b242 tempest-GroupSnapshotsTest-1158654987 None] Created reservations ['fe947911-7b41-406e-96cc-8ad166cf0b68'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:18:25 devstack cinder-volume[87199]: WARNING cinder.quota [None req-0fd18e03-ec6e-460d-bfe1-54d42c37b242 tempest-GroupSnapshotsTest-1158654987 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1783348194 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1783348194, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:18:25 devstack cinder-volume[87199]: WARNING cinder.quota [None req-0fd18e03-ec6e-460d-bfe1-54d42c37b242 tempest-GroupSnapshotsTest-1158654987 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1783348194 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1783348194, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:18:25 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-0fd18e03-ec6e-460d-bfe1-54d42c37b242 tempest-GroupSnapshotsTest-1158654987 None] Created reservations ['68115ca0-5f2e-4d5e-afe9-a3a4cae6322a', '8e543711-7a9e-4220-aa7b-b9ed26ee7aba', '155ec51b-c1d2-40fa-af15-e0dfb524fb9b', '1e78c59b-f805-415a-9d77-d0dcbfc9336e'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:18:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0fd18e03-ec6e-460d-bfe1-54d42c37b242 tempest-GroupSnapshotsTest-1158654987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:18:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0fd18e03-ec6e-460d-bfe1-54d42c37b242 tempest-GroupSnapshotsTest-1158654987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:18:25 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-0fd18e03-ec6e-460d-bfe1-54d42c37b242 tempest-GroupSnapshotsTest-1158654987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:18:25 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-0fd18e03-ec6e-460d-bfe1-54d42c37b242 tempest-GroupSnapshotsTest-1158654987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:18:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0fd18e03-ec6e-460d-bfe1-54d42c37b242 tempest-GroupSnapshotsTest-1158654987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:18:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0fd18e03-ec6e-460d-bfe1-54d42c37b242 tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:25 devstack sudo[93418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:18:25 devstack sudo[93418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:25 devstack sudo[93415]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8fba2ae0-caeb-4d26-b2e2-e2d06b5f8a6f tempest-SnapshotsActionsTest-452788111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.426ade0a-2f8c-4d64-99c7-d305b42576be" returned: 0 in 0.691s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8fba2ae0-caeb-4d26-b2e2-e2d06b5f8a6f tempest-SnapshotsActionsTest-452788111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.254s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:18:25 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-8fba2ae0-caeb-4d26-b2e2-e2d06b5f8a6f tempest-SnapshotsActionsTest-452788111 None] Create snapshot completed successfully Jul 07 08:18:26 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-5cfdc9c0-c94b-42e2-aaf9-28ead43870a4 tempest-GroupSnapshotsTest-1158654987 None] group_snapshot d2386110-b0be-4291-87f2-51da10a201a2: deleting Jul 07 08:18:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5cfdc9c0-c94b-42e2-aaf9-28ead43870a4 tempest-GroupSnapshotsTest-1158654987 None] group_snapshot d2386110-b0be-4291-87f2-51da10a201a2: deleting {{(pid=87199) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 07 08:18:26 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5cfdc9c0-c94b-42e2-aaf9-28ead43870a4 tempest-GroupSnapshotsTest-1158654987 None] Acquiring lock "cinder-quobyte-cc1926b8-75cc-4af9-bebf-a8395afac0bb" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:18:26 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5cfdc9c0-c94b-42e2-aaf9-28ead43870a4 tempest-GroupSnapshotsTest-1158654987 None] Lock "cinder-quobyte-cc1926b8-75cc-4af9-bebf-a8395afac0bb" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:18:26 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5cfdc9c0-c94b-42e2-aaf9-28ead43870a4 tempest-GroupSnapshotsTest-1158654987 None] Acquiring lock "cinder-quobyte-fa5ca960-bb30-4259-8a15-2f80f45a1699" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:18:26 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5cfdc9c0-c94b-42e2-aaf9-28ead43870a4 tempest-GroupSnapshotsTest-1158654987 None] Lock "cinder-quobyte-fa5ca960-bb30-4259-8a15-2f80f45a1699" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:18:26 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-5cfdc9c0-c94b-42e2-aaf9-28ead43870a4 tempest-GroupSnapshotsTest-1158654987 None] Deleting offline snapshot fa5ca960-bb30-4259-8a15-2f80f45a1699 of volume cc1926b8-75cc-4af9-bebf-a8395afac0bb {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:18:26 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-5cfdc9c0-c94b-42e2-aaf9-28ead43870a4 tempest-GroupSnapshotsTest-1158654987 None] snapshot_file for this snap is: volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb.fa5ca960-bb30-4259-8a15-2f80f45a1699 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:18:26 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[27229a38-aa97-4b11-89b6-6a2444d81bea]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:18:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5cfdc9c0-c94b-42e2-aaf9-28ead43870a4 tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb.fa5ca960-bb30-4259-8a15-2f80f45a1699 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:26 devstack sudo[93418]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0fd18e03-ec6e-460d-bfe1-54d42c37b242 tempest-GroupSnapshotsTest-1158654987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.726s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:26 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-0fd18e03-ec6e-460d-bfe1-54d42c37b242 tempest-GroupSnapshotsTest-1158654987 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:18:26 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-0fd18e03-ec6e-460d-bfe1-54d42c37b242 tempest-GroupSnapshotsTest-1158654987 None] Delete group completed successfully. Jul 07 08:18:26 devstack sudo[93422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb.fa5ca960-bb30-4259-8a15-2f80f45a1699 Jul 07 08:18:26 devstack sudo[93422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:26 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-aafccaf0-6d31-496b-bda6-0cc3c80430c9 tempest-SnapshotsActionsTest-1989405612 None] Acquiring lock "cinder-426ade0a-2f8c-4d64-99c7-d305b42576be-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:18:26 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-aafccaf0-6d31-496b-bda6-0cc3c80430c9 tempest-SnapshotsActionsTest-1989405612 None] Lock "cinder-426ade0a-2f8c-4d64-99c7-d305b42576be-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:18:26 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-aafccaf0-6d31-496b-bda6-0cc3c80430c9 tempest-SnapshotsActionsTest-1989405612 None] Acquiring lock "cinder-quobyte-97ff669d-e3e6-44da-95b7-dad653e0cecc" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:18:26 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-aafccaf0-6d31-496b-bda6-0cc3c80430c9 tempest-SnapshotsActionsTest-1989405612 None] Lock "cinder-quobyte-97ff669d-e3e6-44da-95b7-dad653e0cecc" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:18:26 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-aafccaf0-6d31-496b-bda6-0cc3c80430c9 tempest-SnapshotsActionsTest-1989405612 None] Acquiring lock "cinder-quobyte-426ade0a-2f8c-4d64-99c7-d305b42576be" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:18:26 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-aafccaf0-6d31-496b-bda6-0cc3c80430c9 tempest-SnapshotsActionsTest-1989405612 None] Lock "cinder-quobyte-426ade0a-2f8c-4d64-99c7-d305b42576be" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:18:26 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-aafccaf0-6d31-496b-bda6-0cc3c80430c9 tempest-SnapshotsActionsTest-1989405612 None] Deleting offline snapshot 426ade0a-2f8c-4d64-99c7-d305b42576be of volume 97ff669d-e3e6-44da-95b7-dad653e0cecc {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:18:26 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-aafccaf0-6d31-496b-bda6-0cc3c80430c9 tempest-SnapshotsActionsTest-1989405612 None] snapshot_file for this snap is: volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.426ade0a-2f8c-4d64-99c7-d305b42576be {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:18:26 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[beed62b9-640d-4a4c-9083-6ef05da0841c]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:18:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-aafccaf0-6d31-496b-bda6-0cc3c80430c9 tempest-SnapshotsActionsTest-1989405612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.426ade0a-2f8c-4d64-99c7-d305b42576be {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:26 devstack sudo[93424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.426ade0a-2f8c-4d64-99c7-d305b42576be Jul 07 08:18:26 devstack sudo[93424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:27 devstack sudo[93422]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5cfdc9c0-c94b-42e2-aaf9-28ead43870a4 tempest-GroupSnapshotsTest-1158654987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb.fa5ca960-bb30-4259-8a15-2f80f45a1699" returned: 0 in 0.866s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:27 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-5cfdc9c0-c94b-42e2-aaf9-28ead43870a4 tempest-GroupSnapshotsTest-1158654987 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:18:27 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9cd07c-9716-44d0-a6e3-7573505f109e]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:18:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5cfdc9c0-c94b-42e2-aaf9-28ead43870a4 tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:27 devstack sudo[93429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb Jul 07 08:18:27 devstack sudo[93429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:27 devstack sudo[93424]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-aafccaf0-6d31-496b-bda6-0cc3c80430c9 tempest-SnapshotsActionsTest-1989405612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.426ade0a-2f8c-4d64-99c7-d305b42576be" returned: 0 in 0.842s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:27 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-aafccaf0-6d31-496b-bda6-0cc3c80430c9 tempest-SnapshotsActionsTest-1989405612 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97ff669d-e3e6-44da-95b7-dad653e0cecc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:18:27 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72fcfad-4c8b-4aa4-ac18-917d8f36b4e3]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:18:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-aafccaf0-6d31-496b-bda6-0cc3c80430c9 tempest-SnapshotsActionsTest-1989405612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:27 devstack sudo[93434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad Jul 07 08:18:27 devstack sudo[93434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:27 devstack sudo[93429]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5cfdc9c0-c94b-42e2-aaf9-28ead43870a4 tempest-GroupSnapshotsTest-1158654987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb" returned: 0 in 0.884s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5cfdc9c0-c94b-42e2-aaf9-28ead43870a4 tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb.fa5ca960-bb30-4259-8a15-2f80f45a1699 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:28 devstack sudo[93440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb.fa5ca960-bb30-4259-8a15-2f80f45a1699 Jul 07 08:18:28 devstack sudo[93440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:28 devstack sudo[93434]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-aafccaf0-6d31-496b-bda6-0cc3c80430c9 tempest-SnapshotsActionsTest-1989405612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad" returned: 0 in 0.852s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:28 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-aafccaf0-6d31-496b-bda6-0cc3c80430c9 tempest-SnapshotsActionsTest-1989405612 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97ff669d-e3e6-44da-95b7-dad653e0cecc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:18:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-aafccaf0-6d31-496b-bda6-0cc3c80430c9 tempest-SnapshotsActionsTest-1989405612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.426ade0a-2f8c-4d64-99c7-d305b42576be {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:28 devstack sudo[93446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.426ade0a-2f8c-4d64-99c7-d305b42576be Jul 07 08:18:28 devstack sudo[93446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:28 devstack sudo[93440]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5cfdc9c0-c94b-42e2-aaf9-28ead43870a4 tempest-GroupSnapshotsTest-1158654987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb.fa5ca960-bb30-4259-8a15-2f80f45a1699" returned: 0 in 0.863s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5cfdc9c0-c94b-42e2-aaf9-28ead43870a4 tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb.fa5ca960-bb30-4259-8a15-2f80f45a1699 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:28 devstack sudo[93452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb.fa5ca960-bb30-4259-8a15-2f80f45a1699 Jul 07 08:18:28 devstack sudo[93452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:29 devstack sudo[93446]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-aafccaf0-6d31-496b-bda6-0cc3c80430c9 tempest-SnapshotsActionsTest-1989405612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.426ade0a-2f8c-4d64-99c7-d305b42576be" returned: 0 in 0.996s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-aafccaf0-6d31-496b-bda6-0cc3c80430c9 tempest-SnapshotsActionsTest-1989405612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.426ade0a-2f8c-4d64-99c7-d305b42576be {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:29 devstack sudo[93459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.426ade0a-2f8c-4d64-99c7-d305b42576be Jul 07 08:18:29 devstack sudo[93459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:29 devstack sudo[93452]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5cfdc9c0-c94b-42e2-aaf9-28ead43870a4 tempest-GroupSnapshotsTest-1158654987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb.fa5ca960-bb30-4259-8a15-2f80f45a1699" returned: 0 in 0.762s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:29 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5cfdc9c0-c94b-42e2-aaf9-28ead43870a4 tempest-GroupSnapshotsTest-1158654987 None] Lock "cinder-quobyte-fa5ca960-bb30-4259-8a15-2f80f45a1699" released by "_delete_snapshot" :: held 3.488s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:18:29 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5cfdc9c0-c94b-42e2-aaf9-28ead43870a4 tempest-GroupSnapshotsTest-1158654987 None] Lock "cinder-quobyte-cc1926b8-75cc-4af9-bebf-a8395afac0bb" released by "delete_snapshot" :: held 3.517s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:18:29 devstack cinder-volume[87199]: WARNING cinder.quota [None req-5cfdc9c0-c94b-42e2-aaf9-28ead43870a4 tempest-GroupSnapshotsTest-1158654987 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1783348194 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1783348194, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:18:29 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-5cfdc9c0-c94b-42e2-aaf9-28ead43870a4 tempest-GroupSnapshotsTest-1158654987 None] Created reservations ['9bdd18af-98d1-494f-8fd2-0e64bcd5cd76', '8926a50a-ceb8-4c6f-b0cb-c63b1d26ed94', 'c45fdbd9-4e67-4f83-b603-1a42d92a9cd8', '49baa2cb-059a-42ed-92f8-bd58a6531fb2'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:18:29 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-5cfdc9c0-c94b-42e2-aaf9-28ead43870a4 tempest-GroupSnapshotsTest-1158654987 None] group_snapshot d2386110-b0be-4291-87f2-51da10a201a2: deleted successfully Jul 07 08:18:30 devstack sudo[93459]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-aafccaf0-6d31-496b-bda6-0cc3c80430c9 tempest-SnapshotsActionsTest-1989405612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.426ade0a-2f8c-4d64-99c7-d305b42576be" returned: 0 in 0.839s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:30 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-aafccaf0-6d31-496b-bda6-0cc3c80430c9 tempest-SnapshotsActionsTest-1989405612 None] Lock "cinder-quobyte-426ade0a-2f8c-4d64-99c7-d305b42576be" released by "_delete_snapshot" :: held 3.665s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:18:30 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-aafccaf0-6d31-496b-bda6-0cc3c80430c9 tempest-SnapshotsActionsTest-1989405612 None] Lock "cinder-quobyte-97ff669d-e3e6-44da-95b7-dad653e0cecc" released by "delete_snapshot" :: held 3.696s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:18:30 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-aafccaf0-6d31-496b-bda6-0cc3c80430c9 tempest-SnapshotsActionsTest-1989405612 None] Created reservations ['798df118-6b1e-41f6-b7f2-3d77da1da98c', '39f31be6-063b-400d-ad85-c0e8116b668d', '5863cc94-be60-4e7a-8288-896756945ba3', '6f50207c-4cc3-4c0f-b121-e66c3763a6a4'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:18:30 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-aafccaf0-6d31-496b-bda6-0cc3c80430c9 tempest-SnapshotsActionsTest-1989405612 None] Delete snapshot completed successfully. Jul 07 08:18:30 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-aafccaf0-6d31-496b-bda6-0cc3c80430c9 tempest-SnapshotsActionsTest-1989405612 None] Lock "cinder-426ade0a-2f8c-4d64-99c7-d305b42576be-delete_snapshot" released by "delete_snapshot" :: held 3.906s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:18:30 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-bb910e79-cb92-4b67-858c-3a7b04b90d10 tempest-GroupSnapshotsTest-1158654987 None] Acquiring lock "cinder-quobyte-cc1926b8-75cc-4af9-bebf-a8395afac0bb" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:18:30 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-bb910e79-cb92-4b67-858c-3a7b04b90d10 tempest-GroupSnapshotsTest-1158654987 None] Lock "cinder-quobyte-cc1926b8-75cc-4af9-bebf-a8395afac0bb" acquired by "delete_volume" :: waited 0.023s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:18:30 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[653c7e3f-8892-4a9b-a411-6e28ff08bfce]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:18:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bb910e79-cb92-4b67-858c-3a7b04b90d10 tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:31 devstack sudo[93483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb Jul 07 08:18:31 devstack sudo[93483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f8ee6844-dadc-450f-82a8-1cd0374ab787 tempest-SnapshotsActionsTest-452788111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:18:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f8ee6844-dadc-450f-82a8-1cd0374ab787 tempest-SnapshotsActionsTest-452788111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:18:31 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-f8ee6844-dadc-450f-82a8-1cd0374ab787 tempest-SnapshotsActionsTest-452788111 None] Creating offline snapshot d827e54e-9601-47eb-bf7b-e30be9e55561 of volume 97ff669d-e3e6-44da-95b7-dad653e0cecc {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:18:31 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e2cc6c-bebe-4798-8b31-a5208a7be0da]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:18:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f8ee6844-dadc-450f-82a8-1cd0374ab787 tempest-SnapshotsActionsTest-452788111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:31 devstack sudo[93485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad Jul 07 08:18:31 devstack sudo[93485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:31 devstack sudo[93483]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bb910e79-cb92-4b67-858c-3a7b04b90d10 tempest-GroupSnapshotsTest-1158654987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb" returned: 0 in 0.833s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bb910e79-cb92-4b67-858c-3a7b04b90d10 tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:31 devstack sudo[93495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb Jul 07 08:18:31 devstack sudo[93495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:32 devstack sudo[93485]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f8ee6844-dadc-450f-82a8-1cd0374ab787 tempest-SnapshotsActionsTest-452788111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad" returned: 0 in 0.840s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:32 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-f8ee6844-dadc-450f-82a8-1cd0374ab787 tempest-SnapshotsActionsTest-452788111 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97ff669d-e3e6-44da-95b7-dad653e0cecc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:18:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f8ee6844-dadc-450f-82a8-1cd0374ab787 tempest-SnapshotsActionsTest-452788111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.d827e54e-9601-47eb-bf7b-e30be9e55561 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:32 devstack sudo[93505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.d827e54e-9601-47eb-bf7b-e30be9e55561 1G Jul 07 08:18:32 devstack sudo[93505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:32 devstack sudo[93495]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bb910e79-cb92-4b67-858c-3a7b04b90d10 tempest-GroupSnapshotsTest-1158654987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cc1926b8-75cc-4af9-bebf-a8395afac0bb" returned: 0 in 1.006s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:32 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-bb910e79-cb92-4b67-858c-3a7b04b90d10 tempest-GroupSnapshotsTest-1158654987 None] Lock "cinder-quobyte-cc1926b8-75cc-4af9-bebf-a8395afac0bb" released by "delete_volume" :: held 1.917s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:18:32 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-bb910e79-cb92-4b67-858c-3a7b04b90d10 tempest-GroupSnapshotsTest-1158654987 None] Created reservations ['fb360feb-4b23-4900-a0d9-2639a1973298'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:18:32 devstack cinder-volume[87199]: WARNING cinder.db.api [None req-bb910e79-cb92-4b67-858c-3a7b04b90d10 tempest-GroupSnapshotsTest-1158654987 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1783348194'] Jul 07 08:18:32 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-bb910e79-cb92-4b67-858c-3a7b04b90d10 tempest-GroupSnapshotsTest-1158654987 None] Created reservations ['c7183834-c6a0-4ee8-8554-db9dbf05b721', '37ff68b6-f32e-4bac-8969-e0c49a687ef3', '95995894-a395-42b7-a10c-38a66f46a096', 'cc025aeb-3e16-4f89-b7ab-c0873e52c295'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:18:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-bb910e79-cb92-4b67-858c-3a7b04b90d10 tempest-GroupSnapshotsTest-1158654987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:18:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-bb910e79-cb92-4b67-858c-3a7b04b90d10 tempest-GroupSnapshotsTest-1158654987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:18:33 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-bb910e79-cb92-4b67-858c-3a7b04b90d10 tempest-GroupSnapshotsTest-1158654987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:18:33 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-bb910e79-cb92-4b67-858c-3a7b04b90d10 tempest-GroupSnapshotsTest-1158654987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:18:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-bb910e79-cb92-4b67-858c-3a7b04b90d10 tempest-GroupSnapshotsTest-1158654987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:18:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bb910e79-cb92-4b67-858c-3a7b04b90d10 tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:33 devstack sudo[93524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:18:33 devstack sudo[93524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:33 devstack sudo[93505]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f8ee6844-dadc-450f-82a8-1cd0374ab787 tempest-SnapshotsActionsTest-452788111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.d827e54e-9601-47eb-bf7b-e30be9e55561 1G" returned: 0 in 1.368s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f8ee6844-dadc-450f-82a8-1cd0374ab787 tempest-SnapshotsActionsTest-452788111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.d827e54e-9601-47eb-bf7b-e30be9e55561 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:33 devstack sudo[93526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.d827e54e-9601-47eb-bf7b-e30be9e55561 Jul 07 08:18:33 devstack sudo[93526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:33 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-816d0f64-52cc-41d7-a60e-71b78b8637c6 tempest-GroupSnapshotsTest-1158654987 None] Group tempest-GroupSnapshotsTest-Group-280881925: creating Jul 07 08:18:34 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-816d0f64-52cc-41d7-a60e-71b78b8637c6 tempest-GroupSnapshotsTest-1158654987 None] Group tempest-GroupSnapshotsTest-Group-280881925: created successfully Jul 07 08:18:34 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-816d0f64-52cc-41d7-a60e-71b78b8637c6 tempest-GroupSnapshotsTest-1158654987 None] Create group completed successfully. Jul 07 08:18:34 devstack sudo[93524]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bb910e79-cb92-4b67-858c-3a7b04b90d10 tempest-GroupSnapshotsTest-1158654987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 1.005s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:34 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-bb910e79-cb92-4b67-858c-3a7b04b90d10 tempest-GroupSnapshotsTest-1158654987 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:18:34 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-bb910e79-cb92-4b67-858c-3a7b04b90d10 tempest-GroupSnapshotsTest-1158654987 None] Delete group completed successfully. Jul 07 08:18:34 devstack sudo[93526]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f8ee6844-dadc-450f-82a8-1cd0374ab787 tempest-SnapshotsActionsTest-452788111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.d827e54e-9601-47eb-bf7b-e30be9e55561" returned: 0 in 1.284s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:34 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-f8ee6844-dadc-450f-82a8-1cd0374ab787 tempest-SnapshotsActionsTest-452788111 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.d827e54e-9601-47eb-bf7b-e30be9e55561 is being set with open permissions: ugo+rw Jul 07 08:18:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f8ee6844-dadc-450f-82a8-1cd0374ab787 tempest-SnapshotsActionsTest-452788111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.d827e54e-9601-47eb-bf7b-e30be9e55561 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:34 devstack sudo[93577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.d827e54e-9601-47eb-bf7b-e30be9e55561 Jul 07 08:18:34 devstack sudo[93577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:35 devstack sudo[93577]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f8ee6844-dadc-450f-82a8-1cd0374ab787 tempest-SnapshotsActionsTest-452788111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.d827e54e-9601-47eb-bf7b-e30be9e55561" returned: 0 in 0.686s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f8ee6844-dadc-450f-82a8-1cd0374ab787 tempest-SnapshotsActionsTest-452788111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.311s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:18:35 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-a081978b-dc03-456f-b64b-fe1e88b8e56a tempest-GroupSnapshotsTest-1158654987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:18:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a081978b-dc03-456f-b64b-fe1e88b8e56a tempest-GroupSnapshotsTest-1158654987 None] Flow 'volume_create_manager' (e1832484-5a88-4795-b467-2e0399fcdc84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:18:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a081978b-dc03-456f-b64b-fe1e88b8e56a tempest-GroupSnapshotsTest-1158654987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60e8a5b0-0796-4270-abe6-3f550cd74707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:18:35 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-f8ee6844-dadc-450f-82a8-1cd0374ab787 tempest-SnapshotsActionsTest-452788111 None] Create snapshot completed successfully Jul 07 08:18:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a081978b-dc03-456f-b64b-fe1e88b8e56a tempest-GroupSnapshotsTest-1158654987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60e8a5b0-0796-4270-abe6-3f550cd74707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:18:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-979270232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b9939530-dca9-4fac-aa5d-9edf3a54ffdf,host='devstack@QuobyteHD#QuobyteHD',id=dede928f-876a-48aa-ac40-8cf59e385737,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='417afe6a9344432aa5cf82d0c0628928',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:18:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:18:36Z,use_quota=True,user_id='2b4f760dc5264853ae3787b174694b5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4168e221-8132-42c9-b386-333df7bce1a3),volume_type_id=4168e221-8132-42c9-b386-333df7bce1a3)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:18:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a081978b-dc03-456f-b64b-fe1e88b8e56a tempest-GroupSnapshotsTest-1158654987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cb4ce5b-93c8-480b-9783-7428519827f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:18:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a081978b-dc03-456f-b64b-fe1e88b8e56a tempest-GroupSnapshotsTest-1158654987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cb4ce5b-93c8-480b-9783-7428519827f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:18:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a081978b-dc03-456f-b64b-fe1e88b8e56a tempest-GroupSnapshotsTest-1158654987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c7c7529-707a-4dc8-afde-2a85b18bc02e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:18:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a081978b-dc03-456f-b64b-fe1e88b8e56a tempest-GroupSnapshotsTest-1158654987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c7c7529-707a-4dc8-afde-2a85b18bc02e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dede928f-876a-48aa-ac40-8cf59e385737', 'volume_name': 'volume-dede928f-876a-48aa-ac40-8cf59e385737', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:18:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a081978b-dc03-456f-b64b-fe1e88b8e56a tempest-GroupSnapshotsTest-1158654987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c334ec8-6103-426c-bf57-8adf99c3a863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:18:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a081978b-dc03-456f-b64b-fe1e88b8e56a tempest-GroupSnapshotsTest-1158654987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c334ec8-6103-426c-bf57-8adf99c3a863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:18:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a081978b-dc03-456f-b64b-fe1e88b8e56a tempest-GroupSnapshotsTest-1158654987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cbc20b5-696f-4306-98d3-d3c384aa2c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:18:35 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-a081978b-dc03-456f-b64b-fe1e88b8e56a tempest-GroupSnapshotsTest-1158654987 None] Volume dede928f-876a-48aa-ac40-8cf59e385737: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dede928f-876a-48aa-ac40-8cf59e385737', 'volume_size': 1} Jul 07 08:18:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a081978b-dc03-456f-b64b-fe1e88b8e56a tempest-GroupSnapshotsTest-1158654987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:18:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a081978b-dc03-456f-b64b-fe1e88b8e56a tempest-GroupSnapshotsTest-1158654987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:18:35 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a081978b-dc03-456f-b64b-fe1e88b8e56a tempest-GroupSnapshotsTest-1158654987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b9939530-dca9-4fac-aa5d-9edf3a54ffdf,created_at=2026-07-07T06:18:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-979270232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b9939530-dca9-4fac-aa5d-9edf3a54ffdf,host='devstack@QuobyteHD#QuobyteHD',id=dede928f-876a-48aa-ac40-8cf59e385737,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='417afe6a9344432aa5cf82d0c0628928',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:18:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:18:36Z,use_quota=True,user_id='2b4f760dc5264853ae3787b174694b5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4168e221-8132-42c9-b386-333df7bce1a3),volume_type_id=4168e221-8132-42c9-b386-333df7bce1a3)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:18:35 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-a081978b-dc03-456f-b64b-fe1e88b8e56a tempest-GroupSnapshotsTest-1158654987 None] Creating volume dede928f-876a-48aa-ac40-8cf59e385737 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:18:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a081978b-dc03-456f-b64b-fe1e88b8e56a tempest-GroupSnapshotsTest-1158654987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:18:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a081978b-dc03-456f-b64b-fe1e88b8e56a tempest-GroupSnapshotsTest-1158654987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:18:35 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a081978b-dc03-456f-b64b-fe1e88b8e56a tempest-GroupSnapshotsTest-1158654987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:18:35 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a081978b-dc03-456f-b64b-fe1e88b8e56a tempest-GroupSnapshotsTest-1158654987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:18:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a081978b-dc03-456f-b64b-fe1e88b8e56a tempest-GroupSnapshotsTest-1158654987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:18:35 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a081978b-dc03-456f-b64b-fe1e88b8e56a tempest-GroupSnapshotsTest-1158654987 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:18:35 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-a081978b-dc03-456f-b64b-fe1e88b8e56a tempest-GroupSnapshotsTest-1158654987 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:18:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a081978b-dc03-456f-b64b-fe1e88b8e56a tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-dede928f-876a-48aa-ac40-8cf59e385737 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:35 devstack sudo[93601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-dede928f-876a-48aa-ac40-8cf59e385737 1073741824 Jul 07 08:18:35 devstack sudo[93601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:36 devstack sudo[93601]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a081978b-dc03-456f-b64b-fe1e88b8e56a tempest-GroupSnapshotsTest-1158654987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-dede928f-876a-48aa-ac40-8cf59e385737 1073741824" returned: 0 in 0.959s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a081978b-dc03-456f-b64b-fe1e88b8e56a tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-dede928f-876a-48aa-ac40-8cf59e385737 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:36 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5adcee18-6a6c-4d6e-a44a-801779981f4d tempest-SnapshotsActionsTest-1989405612 None] Acquiring lock "cinder-d827e54e-9601-47eb-bf7b-e30be9e55561-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:18:36 devstack sudo[93610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-dede928f-876a-48aa-ac40-8cf59e385737 Jul 07 08:18:36 devstack sudo[93610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:36 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5adcee18-6a6c-4d6e-a44a-801779981f4d tempest-SnapshotsActionsTest-1989405612 None] Lock "cinder-d827e54e-9601-47eb-bf7b-e30be9e55561-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:18:36 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5adcee18-6a6c-4d6e-a44a-801779981f4d tempest-SnapshotsActionsTest-1989405612 None] Acquiring lock "cinder-quobyte-97ff669d-e3e6-44da-95b7-dad653e0cecc" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:18:36 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5adcee18-6a6c-4d6e-a44a-801779981f4d tempest-SnapshotsActionsTest-1989405612 None] Lock "cinder-quobyte-97ff669d-e3e6-44da-95b7-dad653e0cecc" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:18:36 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5adcee18-6a6c-4d6e-a44a-801779981f4d tempest-SnapshotsActionsTest-1989405612 None] Acquiring lock "cinder-quobyte-d827e54e-9601-47eb-bf7b-e30be9e55561" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:18:36 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5adcee18-6a6c-4d6e-a44a-801779981f4d tempest-SnapshotsActionsTest-1989405612 None] Lock "cinder-quobyte-d827e54e-9601-47eb-bf7b-e30be9e55561" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:18:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-5adcee18-6a6c-4d6e-a44a-801779981f4d tempest-SnapshotsActionsTest-1989405612 None] Deleting offline snapshot d827e54e-9601-47eb-bf7b-e30be9e55561 of volume 97ff669d-e3e6-44da-95b7-dad653e0cecc {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:18:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-5adcee18-6a6c-4d6e-a44a-801779981f4d tempest-SnapshotsActionsTest-1989405612 None] snapshot_file for this snap is: volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.d827e54e-9601-47eb-bf7b-e30be9e55561 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:18:36 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2788dae-1369-487f-8038-a70cf5b402d0]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:18:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5adcee18-6a6c-4d6e-a44a-801779981f4d tempest-SnapshotsActionsTest-1989405612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.d827e54e-9601-47eb-bf7b-e30be9e55561 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:37 devstack sudo[93612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.d827e54e-9601-47eb-bf7b-e30be9e55561 Jul 07 08:18:37 devstack sudo[93612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:37 devstack sudo[93610]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a081978b-dc03-456f-b64b-fe1e88b8e56a tempest-GroupSnapshotsTest-1158654987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-dede928f-876a-48aa-ac40-8cf59e385737" returned: 0 in 0.937s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:37 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a081978b-dc03-456f-b64b-fe1e88b8e56a tempest-GroupSnapshotsTest-1158654987 None] <== create_volume: return (1960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:18:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a081978b-dc03-456f-b64b-fe1e88b8e56a tempest-GroupSnapshotsTest-1158654987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.964s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:18:37 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a081978b-dc03-456f-b64b-fe1e88b8e56a tempest-GroupSnapshotsTest-1158654987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cbc20b5-696f-4306-98d3-d3c384aa2c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dede928f-876a-48aa-ac40-8cf59e385737', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:18:37 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a081978b-dc03-456f-b64b-fe1e88b8e56a tempest-GroupSnapshotsTest-1158654987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22a6b0cc-147e-4f35-9c74-6d2339823782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:18:37 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-a081978b-dc03-456f-b64b-fe1e88b8e56a tempest-GroupSnapshotsTest-1158654987 None] Volume volume-dede928f-876a-48aa-ac40-8cf59e385737 (dede928f-876a-48aa-ac40-8cf59e385737): created successfully Jul 07 08:18:37 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a081978b-dc03-456f-b64b-fe1e88b8e56a tempest-GroupSnapshotsTest-1158654987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22a6b0cc-147e-4f35-9c74-6d2339823782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:18:37 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a081978b-dc03-456f-b64b-fe1e88b8e56a tempest-GroupSnapshotsTest-1158654987 None] Flow 'volume_create_manager' (e1832484-5a88-4795-b467-2e0399fcdc84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:18:37 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-a081978b-dc03-456f-b64b-fe1e88b8e56a tempest-GroupSnapshotsTest-1158654987 None] Created volume successfully. Jul 07 08:18:38 devstack sudo[93612]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5adcee18-6a6c-4d6e-a44a-801779981f4d tempest-SnapshotsActionsTest-1989405612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.d827e54e-9601-47eb-bf7b-e30be9e55561" returned: 0 in 1.042s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:38 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-5adcee18-6a6c-4d6e-a44a-801779981f4d tempest-SnapshotsActionsTest-1989405612 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97ff669d-e3e6-44da-95b7-dad653e0cecc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:18:38 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b849ace-41cc-455a-a920-52aacd102e02]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:18:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5adcee18-6a6c-4d6e-a44a-801779981f4d tempest-SnapshotsActionsTest-1989405612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:38 devstack sudo[93619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad Jul 07 08:18:38 devstack sudo[93619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:39 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-d08d0f16-1c53-4afe-8d84-9e05321e8ccf tempest-GroupSnapshotsTest-1158654987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:18:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d08d0f16-1c53-4afe-8d84-9e05321e8ccf tempest-GroupSnapshotsTest-1158654987 None] Flow 'volume_create_manager' (bb32719a-9fa5-43b0-b050-2cc1ad65366a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:18:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d08d0f16-1c53-4afe-8d84-9e05321e8ccf tempest-GroupSnapshotsTest-1158654987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eb5b96f-db12-449b-bbd0-5176c3007cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:18:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d08d0f16-1c53-4afe-8d84-9e05321e8ccf tempest-GroupSnapshotsTest-1158654987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eb5b96f-db12-449b-bbd0-5176c3007cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1691297046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b9939530-dca9-4fac-aa5d-9edf3a54ffdf,host='devstack@QuobyteHD#QuobyteHD',id=22043851-7841-4526-861e-74b4b3f55d55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='417afe6a9344432aa5cf82d0c0628928',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:18:39Z,use_quota=True,user_id='2b4f760dc5264853ae3787b174694b5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4168e221-8132-42c9-b386-333df7bce1a3),volume_type_id=4168e221-8132-42c9-b386-333df7bce1a3)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:18:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d08d0f16-1c53-4afe-8d84-9e05321e8ccf tempest-GroupSnapshotsTest-1158654987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5849a9c2-c3f1-4e27-8998-207848039a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:18:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d08d0f16-1c53-4afe-8d84-9e05321e8ccf tempest-GroupSnapshotsTest-1158654987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5849a9c2-c3f1-4e27-8998-207848039a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:18:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d08d0f16-1c53-4afe-8d84-9e05321e8ccf tempest-GroupSnapshotsTest-1158654987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da111c03-2a9d-42a3-983c-a8f8003d8159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:18:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d08d0f16-1c53-4afe-8d84-9e05321e8ccf tempest-GroupSnapshotsTest-1158654987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da111c03-2a9d-42a3-983c-a8f8003d8159) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22043851-7841-4526-861e-74b4b3f55d55', 'volume_name': 'volume-22043851-7841-4526-861e-74b4b3f55d55', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:18:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d08d0f16-1c53-4afe-8d84-9e05321e8ccf tempest-GroupSnapshotsTest-1158654987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d2b82bc-d291-40cf-af49-9c349d244a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:18:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d08d0f16-1c53-4afe-8d84-9e05321e8ccf tempest-GroupSnapshotsTest-1158654987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d2b82bc-d291-40cf-af49-9c349d244a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:18:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d08d0f16-1c53-4afe-8d84-9e05321e8ccf tempest-GroupSnapshotsTest-1158654987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f055e77d-08ac-4d6f-8804-b359ec206813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:18:39 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-d08d0f16-1c53-4afe-8d84-9e05321e8ccf tempest-GroupSnapshotsTest-1158654987 None] Volume 22043851-7841-4526-861e-74b4b3f55d55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22043851-7841-4526-861e-74b4b3f55d55', 'volume_size': 1} Jul 07 08:18:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d08d0f16-1c53-4afe-8d84-9e05321e8ccf tempest-GroupSnapshotsTest-1158654987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:18:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d08d0f16-1c53-4afe-8d84-9e05321e8ccf tempest-GroupSnapshotsTest-1158654987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:18:39 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d08d0f16-1c53-4afe-8d84-9e05321e8ccf tempest-GroupSnapshotsTest-1158654987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b9939530-dca9-4fac-aa5d-9edf3a54ffdf,created_at=2026-07-07T06:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1691297046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b9939530-dca9-4fac-aa5d-9edf3a54ffdf,host='devstack@QuobyteHD#QuobyteHD',id=22043851-7841-4526-861e-74b4b3f55d55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='417afe6a9344432aa5cf82d0c0628928',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:18:39Z,use_quota=True,user_id='2b4f760dc5264853ae3787b174694b5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4168e221-8132-42c9-b386-333df7bce1a3),volume_type_id=4168e221-8132-42c9-b386-333df7bce1a3)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:18:39 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-d08d0f16-1c53-4afe-8d84-9e05321e8ccf tempest-GroupSnapshotsTest-1158654987 None] Creating volume 22043851-7841-4526-861e-74b4b3f55d55 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:18:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d08d0f16-1c53-4afe-8d84-9e05321e8ccf tempest-GroupSnapshotsTest-1158654987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:18:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d08d0f16-1c53-4afe-8d84-9e05321e8ccf tempest-GroupSnapshotsTest-1158654987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:18:39 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d08d0f16-1c53-4afe-8d84-9e05321e8ccf tempest-GroupSnapshotsTest-1158654987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:18:39 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d08d0f16-1c53-4afe-8d84-9e05321e8ccf tempest-GroupSnapshotsTest-1158654987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:18:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d08d0f16-1c53-4afe-8d84-9e05321e8ccf tempest-GroupSnapshotsTest-1158654987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:18:39 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d08d0f16-1c53-4afe-8d84-9e05321e8ccf tempest-GroupSnapshotsTest-1158654987 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:18:39 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-d08d0f16-1c53-4afe-8d84-9e05321e8ccf tempest-GroupSnapshotsTest-1158654987 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:18:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d08d0f16-1c53-4afe-8d84-9e05321e8ccf tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-22043851-7841-4526-861e-74b4b3f55d55 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:39 devstack sudo[93623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-22043851-7841-4526-861e-74b4b3f55d55 1073741824 Jul 07 08:18:39 devstack sudo[93623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:39 devstack sudo[93619]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5adcee18-6a6c-4d6e-a44a-801779981f4d tempest-SnapshotsActionsTest-1989405612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad" returned: 0 in 1.476s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:39 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-5adcee18-6a6c-4d6e-a44a-801779981f4d tempest-SnapshotsActionsTest-1989405612 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97ff669d-e3e6-44da-95b7-dad653e0cecc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:18:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5adcee18-6a6c-4d6e-a44a-801779981f4d tempest-SnapshotsActionsTest-1989405612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.d827e54e-9601-47eb-bf7b-e30be9e55561 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:39 devstack sudo[93626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.d827e54e-9601-47eb-bf7b-e30be9e55561 Jul 07 08:18:39 devstack sudo[93626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-65f52746-748b-498f-b747-e539b96d54ae tempest-AttachVolumeShelveTestJSON-1859139297 None] Acquiring lock "cinder-b08d6ff4-55a4-44e0-b858-3f9cf1d5a201-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:18:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-65f52746-748b-498f-b747-e539b96d54ae tempest-AttachVolumeShelveTestJSON-1859139297 None] Lock "cinder-b08d6ff4-55a4-44e0-b858-3f9cf1d5a201-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:18:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-65f52746-748b-498f-b747-e539b96d54ae tempest-AttachVolumeShelveTestJSON-1859139297 None] Acquiring lock "cinder-quobyte-b08d6ff4-55a4-44e0-b858-3f9cf1d5a201" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:18:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-65f52746-748b-498f-b747-e539b96d54ae tempest-AttachVolumeShelveTestJSON-1859139297 None] Lock "cinder-quobyte-b08d6ff4-55a4-44e0-b858-3f9cf1d5a201" acquired by "delete_volume" :: waited 0.037s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:18:40 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4fd890d-7535-4b5f-8487-24277bdd1afb]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:18:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-65f52746-748b-498f-b747-e539b96d54ae tempest-AttachVolumeShelveTestJSON-1859139297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b08d6ff4-55a4-44e0-b858-3f9cf1d5a201 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:40 devstack sudo[93631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b08d6ff4-55a4-44e0-b858-3f9cf1d5a201 Jul 07 08:18:40 devstack sudo[93631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:40 devstack sudo[93623]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d08d0f16-1c53-4afe-8d84-9e05321e8ccf tempest-GroupSnapshotsTest-1158654987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-22043851-7841-4526-861e-74b4b3f55d55 1073741824" returned: 0 in 1.483s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:40 devstack sudo[93626]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5adcee18-6a6c-4d6e-a44a-801779981f4d tempest-SnapshotsActionsTest-1989405612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.d827e54e-9601-47eb-bf7b-e30be9e55561" returned: 0 in 1.266s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d08d0f16-1c53-4afe-8d84-9e05321e8ccf tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-22043851-7841-4526-861e-74b4b3f55d55 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5adcee18-6a6c-4d6e-a44a-801779981f4d tempest-SnapshotsActionsTest-1989405612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.d827e54e-9601-47eb-bf7b-e30be9e55561 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:40 devstack sudo[93638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-22043851-7841-4526-861e-74b4b3f55d55 Jul 07 08:18:40 devstack sudo[93638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:40 devstack sudo[93640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.d827e54e-9601-47eb-bf7b-e30be9e55561 Jul 07 08:18:40 devstack sudo[93640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:41 devstack sudo[93631]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-65f52746-748b-498f-b747-e539b96d54ae tempest-AttachVolumeShelveTestJSON-1859139297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b08d6ff4-55a4-44e0-b858-3f9cf1d5a201" returned: 0 in 1.308s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-65f52746-748b-498f-b747-e539b96d54ae tempest-AttachVolumeShelveTestJSON-1859139297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b08d6ff4-55a4-44e0-b858-3f9cf1d5a201 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:41 devstack sudo[93647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b08d6ff4-55a4-44e0-b858-3f9cf1d5a201 Jul 07 08:18:41 devstack sudo[93647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:41 devstack sudo[93638]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d08d0f16-1c53-4afe-8d84-9e05321e8ccf tempest-GroupSnapshotsTest-1158654987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-22043851-7841-4526-861e-74b4b3f55d55" returned: 0 in 0.872s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:41 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d08d0f16-1c53-4afe-8d84-9e05321e8ccf tempest-GroupSnapshotsTest-1158654987 None] <== create_volume: return (2438ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:18:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d08d0f16-1c53-4afe-8d84-9e05321e8ccf tempest-GroupSnapshotsTest-1158654987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.446s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:18:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d08d0f16-1c53-4afe-8d84-9e05321e8ccf tempest-GroupSnapshotsTest-1158654987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f055e77d-08ac-4d6f-8804-b359ec206813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22043851-7841-4526-861e-74b4b3f55d55', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:18:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d08d0f16-1c53-4afe-8d84-9e05321e8ccf tempest-GroupSnapshotsTest-1158654987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (debf4a1b-0df2-4822-8171-da20f4ae5795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:18:41 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-d08d0f16-1c53-4afe-8d84-9e05321e8ccf tempest-GroupSnapshotsTest-1158654987 None] Volume volume-22043851-7841-4526-861e-74b4b3f55d55 (22043851-7841-4526-861e-74b4b3f55d55): created successfully Jul 07 08:18:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d08d0f16-1c53-4afe-8d84-9e05321e8ccf tempest-GroupSnapshotsTest-1158654987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (debf4a1b-0df2-4822-8171-da20f4ae5795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:18:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d08d0f16-1c53-4afe-8d84-9e05321e8ccf tempest-GroupSnapshotsTest-1158654987 None] Flow 'volume_create_manager' (bb32719a-9fa5-43b0-b050-2cc1ad65366a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:18:41 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-d08d0f16-1c53-4afe-8d84-9e05321e8ccf tempest-GroupSnapshotsTest-1158654987 None] Created volume successfully. Jul 07 08:18:41 devstack sudo[93640]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5adcee18-6a6c-4d6e-a44a-801779981f4d tempest-SnapshotsActionsTest-1989405612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.d827e54e-9601-47eb-bf7b-e30be9e55561" returned: 0 in 1.162s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:42 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5adcee18-6a6c-4d6e-a44a-801779981f4d tempest-SnapshotsActionsTest-1989405612 None] Lock "cinder-quobyte-d827e54e-9601-47eb-bf7b-e30be9e55561" released by "_delete_snapshot" :: held 5.102s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:18:42 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5adcee18-6a6c-4d6e-a44a-801779981f4d tempest-SnapshotsActionsTest-1989405612 None] Lock "cinder-quobyte-97ff669d-e3e6-44da-95b7-dad653e0cecc" released by "delete_snapshot" :: held 5.139s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:18:42 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-5cccda07-34ee-45bc-a9a5-9856fe493662 tempest-GroupSnapshotsTest-1158654987 None] Update group completed successfully. Jul 07 08:18:42 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-5adcee18-6a6c-4d6e-a44a-801779981f4d tempest-SnapshotsActionsTest-1989405612 None] Created reservations ['a8975cc2-fee0-4152-b721-ea159999bcbc', '1a4c7334-0254-4c68-9c82-34bd9470151e', 'a32488c5-d7c0-4e30-b51d-3e8ea89c747a', 'f325765c-c0e4-413a-90c2-62b9f0cfb2b7'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:18:42 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-5adcee18-6a6c-4d6e-a44a-801779981f4d tempest-SnapshotsActionsTest-1989405612 None] Delete snapshot completed successfully. Jul 07 08:18:42 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5adcee18-6a6c-4d6e-a44a-801779981f4d tempest-SnapshotsActionsTest-1989405612 None] Lock "cinder-d827e54e-9601-47eb-bf7b-e30be9e55561-delete_snapshot" released by "delete_snapshot" :: held 5.478s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:18:42 devstack sudo[93647]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-65f52746-748b-498f-b747-e539b96d54ae tempest-AttachVolumeShelveTestJSON-1859139297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b08d6ff4-55a4-44e0-b858-3f9cf1d5a201" returned: 0 in 0.948s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:42 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-65f52746-748b-498f-b747-e539b96d54ae tempest-AttachVolumeShelveTestJSON-1859139297 None] Lock "cinder-quobyte-b08d6ff4-55a4-44e0-b858-3f9cf1d5a201" released by "delete_volume" :: held 2.309s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:18:42 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-65f52746-748b-498f-b747-e539b96d54ae tempest-AttachVolumeShelveTestJSON-1859139297 None] Created reservations ['5c463b20-b403-48ee-9a5a-252626a8c9ef', '92d8b8b4-0eea-43a6-adab-8f77f2e9966f', 'd85f14f7-6fc9-459b-b6c0-75b1ee3168b7', '6bcba1b3-646b-4c22-bfe5-adcd387796f1'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:18:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-65f52746-748b-498f-b747-e539b96d54ae tempest-AttachVolumeShelveTestJSON-1859139297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:18:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-65f52746-748b-498f-b747-e539b96d54ae tempest-AttachVolumeShelveTestJSON-1859139297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:18:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-65f52746-748b-498f-b747-e539b96d54ae tempest-AttachVolumeShelveTestJSON-1859139297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:18:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-65f52746-748b-498f-b747-e539b96d54ae tempest-AttachVolumeShelveTestJSON-1859139297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:18:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-65f52746-748b-498f-b747-e539b96d54ae tempest-AttachVolumeShelveTestJSON-1859139297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:18:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-65f52746-748b-498f-b747-e539b96d54ae tempest-AttachVolumeShelveTestJSON-1859139297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:42 devstack sudo[93652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:18:42 devstack sudo[93652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:43 devstack sudo[93652]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-65f52746-748b-498f-b747-e539b96d54ae tempest-AttachVolumeShelveTestJSON-1859139297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.734s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:43 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-65f52746-748b-498f-b747-e539b96d54ae tempest-AttachVolumeShelveTestJSON-1859139297 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:18:43 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-65f52746-748b-498f-b747-e539b96d54ae tempest-AttachVolumeShelveTestJSON-1859139297 None] Deleted volume successfully. Jul 07 08:18:43 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-65f52746-748b-498f-b747-e539b96d54ae tempest-AttachVolumeShelveTestJSON-1859139297 None] Lock "cinder-b08d6ff4-55a4-44e0-b858-3f9cf1d5a201-delete_volume" released by "delete_volume" :: held 3.348s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:18:43 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-1f72e3ca-d0d6-46ae-b77a-8acc54ea0355 tempest-GroupSnapshotsTest-1158654987 None] Update group completed successfully. Jul 07 08:18:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-03a8027e-c26f-4001-80da-c4c9dd72cab2 tempest-SnapshotsActionsTest-452788111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:18:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-03a8027e-c26f-4001-80da-c4c9dd72cab2 tempest-SnapshotsActionsTest-452788111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:18:43 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-03a8027e-c26f-4001-80da-c4c9dd72cab2 tempest-SnapshotsActionsTest-452788111 None] Creating offline snapshot c7f1ecb5-b9a7-453b-bbc0-363595d884dc of volume 97ff669d-e3e6-44da-95b7-dad653e0cecc {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:18:43 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5ab6b4-ee63-4427-ac88-c40f587ea4ad]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:18:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-03a8027e-c26f-4001-80da-c4c9dd72cab2 tempest-SnapshotsActionsTest-452788111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:43 devstack sudo[93655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad Jul 07 08:18:43 devstack sudo[93655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:44 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-433cbf39-9f0a-43da-9a2c-205d5badb550 tempest-GroupSnapshotsTest-1158654987 None] Update group completed successfully. Jul 07 08:18:44 devstack sudo[93655]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-03a8027e-c26f-4001-80da-c4c9dd72cab2 tempest-SnapshotsActionsTest-452788111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad" returned: 0 in 1.047s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-03a8027e-c26f-4001-80da-c4c9dd72cab2 tempest-SnapshotsActionsTest-452788111 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97ff669d-e3e6-44da-95b7-dad653e0cecc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:18:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-03a8027e-c26f-4001-80da-c4c9dd72cab2 tempest-SnapshotsActionsTest-452788111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.c7f1ecb5-b9a7-453b-bbc0-363595d884dc 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:44 devstack sudo[93663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.c7f1ecb5-b9a7-453b-bbc0-363595d884dc 1G Jul 07 08:18:44 devstack sudo[93663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:45 devstack sudo[93663]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-03a8027e-c26f-4001-80da-c4c9dd72cab2 tempest-SnapshotsActionsTest-452788111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.c7f1ecb5-b9a7-453b-bbc0-363595d884dc 1G" returned: 0 in 0.987s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-03a8027e-c26f-4001-80da-c4c9dd72cab2 tempest-SnapshotsActionsTest-452788111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.c7f1ecb5-b9a7-453b-bbc0-363595d884dc {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:45 devstack sudo[93673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.c7f1ecb5-b9a7-453b-bbc0-363595d884dc Jul 07 08:18:45 devstack sudo[93673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:45 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-b86f6f79-598a-484f-866d-8454540b9e1f tempest-GroupSnapshotsTest-1158654987 None] Update group completed successfully. Jul 07 08:18:46 devstack sudo[93673]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-03a8027e-c26f-4001-80da-c4c9dd72cab2 tempest-SnapshotsActionsTest-452788111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.c7f1ecb5-b9a7-453b-bbc0-363595d884dc" returned: 0 in 0.833s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:46 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-03a8027e-c26f-4001-80da-c4c9dd72cab2 tempest-SnapshotsActionsTest-452788111 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.c7f1ecb5-b9a7-453b-bbc0-363595d884dc is being set with open permissions: ugo+rw Jul 07 08:18:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-03a8027e-c26f-4001-80da-c4c9dd72cab2 tempest-SnapshotsActionsTest-452788111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.c7f1ecb5-b9a7-453b-bbc0-363595d884dc {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:46 devstack sudo[93681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.c7f1ecb5-b9a7-453b-bbc0-363595d884dc Jul 07 08:18:46 devstack sudo[93681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:47 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-77fc3373-5537-472a-8115-a155b1c16d60 tempest-GroupSnapshotsTest-1158654987 None] GroupSnapshot f6e31a16-6ddb-4803-8e5f-25254c0be49d: creating. Jul 07 08:18:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-77fc3373-5537-472a-8115-a155b1c16d60 tempest-GroupSnapshotsTest-1158654987 None] Group snapshot f6e31a16-6ddb-4803-8e5f-25254c0be49d: creating. {{(pid=87199) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 07 08:18:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-77fc3373-5537-472a-8115-a155b1c16d60 tempest-GroupSnapshotsTest-1158654987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:18:47 devstack sudo[93681]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-03a8027e-c26f-4001-80da-c4c9dd72cab2 tempest-SnapshotsActionsTest-452788111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.c7f1ecb5-b9a7-453b-bbc0-363595d884dc" returned: 0 in 0.968s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-03a8027e-c26f-4001-80da-c4c9dd72cab2 tempest-SnapshotsActionsTest-452788111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.004s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:18:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-77fc3373-5537-472a-8115-a155b1c16d60 tempest-GroupSnapshotsTest-1158654987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.100s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:18:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-77fc3373-5537-472a-8115-a155b1c16d60 tempest-GroupSnapshotsTest-1158654987 None] Creating offline snapshot 0bd22501-c0fa-4e91-b881-d1f7a67c9d1f of volume dede928f-876a-48aa-ac40-8cf59e385737 {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:18:47 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-03a8027e-c26f-4001-80da-c4c9dd72cab2 tempest-SnapshotsActionsTest-452788111 None] Create snapshot completed successfully Jul 07 08:18:47 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[721fdd90-1bc4-41c3-a3bb-2ec6e6e42542]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:18:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-77fc3373-5537-472a-8115-a155b1c16d60 tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-dede928f-876a-48aa-ac40-8cf59e385737 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:47 devstack sudo[93684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-dede928f-876a-48aa-ac40-8cf59e385737 Jul 07 08:18:47 devstack sudo[93684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-aba0e77c-94fd-4672-854f-5d86c0170798 tempest-SnapshotsActionsTest-1989405612 None] Acquiring lock "cinder-c7f1ecb5-b9a7-453b-bbc0-363595d884dc-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:18:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-aba0e77c-94fd-4672-854f-5d86c0170798 tempest-SnapshotsActionsTest-1989405612 None] Lock "cinder-c7f1ecb5-b9a7-453b-bbc0-363595d884dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:18:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-aba0e77c-94fd-4672-854f-5d86c0170798 tempest-SnapshotsActionsTest-1989405612 None] Acquiring lock "cinder-quobyte-97ff669d-e3e6-44da-95b7-dad653e0cecc" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:18:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-aba0e77c-94fd-4672-854f-5d86c0170798 tempest-SnapshotsActionsTest-1989405612 None] Lock "cinder-quobyte-97ff669d-e3e6-44da-95b7-dad653e0cecc" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:18:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-aba0e77c-94fd-4672-854f-5d86c0170798 tempest-SnapshotsActionsTest-1989405612 None] Acquiring lock "cinder-quobyte-c7f1ecb5-b9a7-453b-bbc0-363595d884dc" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:18:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-aba0e77c-94fd-4672-854f-5d86c0170798 tempest-SnapshotsActionsTest-1989405612 None] Lock "cinder-quobyte-c7f1ecb5-b9a7-453b-bbc0-363595d884dc" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:18:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-aba0e77c-94fd-4672-854f-5d86c0170798 tempest-SnapshotsActionsTest-1989405612 None] Deleting offline snapshot c7f1ecb5-b9a7-453b-bbc0-363595d884dc of volume 97ff669d-e3e6-44da-95b7-dad653e0cecc {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:18:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-aba0e77c-94fd-4672-854f-5d86c0170798 tempest-SnapshotsActionsTest-1989405612 None] snapshot_file for this snap is: volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.c7f1ecb5-b9a7-453b-bbc0-363595d884dc {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:18:48 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1476ad3-2416-452b-8169-b4c92d186625]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:18:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-aba0e77c-94fd-4672-854f-5d86c0170798 tempest-SnapshotsActionsTest-1989405612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.c7f1ecb5-b9a7-453b-bbc0-363595d884dc {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:48 devstack sudo[93687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.c7f1ecb5-b9a7-453b-bbc0-363595d884dc Jul 07 08:18:48 devstack sudo[93687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:48 devstack sudo[93684]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-77fc3373-5537-472a-8115-a155b1c16d60 tempest-GroupSnapshotsTest-1158654987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-dede928f-876a-48aa-ac40-8cf59e385737" returned: 0 in 1.126s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-77fc3373-5537-472a-8115-a155b1c16d60 tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-dede928f-876a-48aa-ac40-8cf59e385737,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-dede928f-876a-48aa-ac40-8cf59e385737.0bd22501-c0fa-4e91-b881-d1f7a67c9d1f 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:48 devstack sudo[93692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-dede928f-876a-48aa-ac40-8cf59e385737,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-dede928f-876a-48aa-ac40-8cf59e385737.0bd22501-c0fa-4e91-b881-d1f7a67c9d1f 1G Jul 07 08:18:48 devstack sudo[93692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:49 devstack sudo[93687]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-aba0e77c-94fd-4672-854f-5d86c0170798 tempest-SnapshotsActionsTest-1989405612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.c7f1ecb5-b9a7-453b-bbc0-363595d884dc" returned: 0 in 1.099s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:49 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-aba0e77c-94fd-4672-854f-5d86c0170798 tempest-SnapshotsActionsTest-1989405612 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97ff669d-e3e6-44da-95b7-dad653e0cecc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:18:49 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5446d5-a524-4ff8-b479-27c1bbad1b40]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:18:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-aba0e77c-94fd-4672-854f-5d86c0170798 tempest-SnapshotsActionsTest-1989405612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:49 devstack sudo[93723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad Jul 07 08:18:49 devstack sudo[93723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:49 devstack sudo[93692]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-77fc3373-5537-472a-8115-a155b1c16d60 tempest-GroupSnapshotsTest-1158654987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-dede928f-876a-48aa-ac40-8cf59e385737,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-dede928f-876a-48aa-ac40-8cf59e385737.0bd22501-c0fa-4e91-b881-d1f7a67c9d1f 1G" returned: 0 in 0.988s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-77fc3373-5537-472a-8115-a155b1c16d60 tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dede928f-876a-48aa-ac40-8cf59e385737 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-dede928f-876a-48aa-ac40-8cf59e385737.0bd22501-c0fa-4e91-b881-d1f7a67c9d1f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:49 devstack sudo[93729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dede928f-876a-48aa-ac40-8cf59e385737 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-dede928f-876a-48aa-ac40-8cf59e385737.0bd22501-c0fa-4e91-b881-d1f7a67c9d1f Jul 07 08:18:49 devstack sudo[93729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:50 devstack sudo[93723]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-aba0e77c-94fd-4672-854f-5d86c0170798 tempest-SnapshotsActionsTest-1989405612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad" returned: 0 in 0.819s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:50 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-aba0e77c-94fd-4672-854f-5d86c0170798 tempest-SnapshotsActionsTest-1989405612 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97ff669d-e3e6-44da-95b7-dad653e0cecc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:18:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-aba0e77c-94fd-4672-854f-5d86c0170798 tempest-SnapshotsActionsTest-1989405612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.c7f1ecb5-b9a7-453b-bbc0-363595d884dc {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:50 devstack sudo[93734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.c7f1ecb5-b9a7-453b-bbc0-363595d884dc Jul 07 08:18:50 devstack sudo[93734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:50 devstack sudo[93729]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-77fc3373-5537-472a-8115-a155b1c16d60 tempest-GroupSnapshotsTest-1158654987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dede928f-876a-48aa-ac40-8cf59e385737 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-dede928f-876a-48aa-ac40-8cf59e385737.0bd22501-c0fa-4e91-b881-d1f7a67c9d1f" returned: 0 in 0.733s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:50 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-77fc3373-5537-472a-8115-a155b1c16d60 tempest-GroupSnapshotsTest-1158654987 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-dede928f-876a-48aa-ac40-8cf59e385737.0bd22501-c0fa-4e91-b881-d1f7a67c9d1f is being set with open permissions: ugo+rw: NotImplementedError Jul 07 08:18:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-77fc3373-5537-472a-8115-a155b1c16d60 tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-dede928f-876a-48aa-ac40-8cf59e385737.0bd22501-c0fa-4e91-b881-d1f7a67c9d1f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:50 devstack sudo[93740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-dede928f-876a-48aa-ac40-8cf59e385737.0bd22501-c0fa-4e91-b881-d1f7a67c9d1f Jul 07 08:18:50 devstack sudo[93740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:51 devstack sudo[93734]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-aba0e77c-94fd-4672-854f-5d86c0170798 tempest-SnapshotsActionsTest-1989405612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.c7f1ecb5-b9a7-453b-bbc0-363595d884dc" returned: 0 in 0.868s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-aba0e77c-94fd-4672-854f-5d86c0170798 tempest-SnapshotsActionsTest-1989405612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.c7f1ecb5-b9a7-453b-bbc0-363595d884dc {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:51 devstack sudo[93747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.c7f1ecb5-b9a7-453b-bbc0-363595d884dc Jul 07 08:18:51 devstack sudo[93747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:51 devstack sudo[93740]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-77fc3373-5537-472a-8115-a155b1c16d60 tempest-GroupSnapshotsTest-1158654987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-dede928f-876a-48aa-ac40-8cf59e385737.0bd22501-c0fa-4e91-b881-d1f7a67c9d1f" returned: 0 in 0.626s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-77fc3373-5537-472a-8115-a155b1c16d60 tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-dede928f-876a-48aa-ac40-8cf59e385737.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:51 devstack sudo[93749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-dede928f-876a-48aa-ac40-8cf59e385737.info Jul 07 08:18:51 devstack sudo[93749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:51 devstack sudo[93747]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-aba0e77c-94fd-4672-854f-5d86c0170798 tempest-SnapshotsActionsTest-1989405612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.c7f1ecb5-b9a7-453b-bbc0-363595d884dc" returned: 0 in 0.641s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:51 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-aba0e77c-94fd-4672-854f-5d86c0170798 tempest-SnapshotsActionsTest-1989405612 None] Lock "cinder-quobyte-c7f1ecb5-b9a7-453b-bbc0-363595d884dc" released by "_delete_snapshot" :: held 3.574s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:18:51 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-aba0e77c-94fd-4672-854f-5d86c0170798 tempest-SnapshotsActionsTest-1989405612 None] Lock "cinder-quobyte-97ff669d-e3e6-44da-95b7-dad653e0cecc" released by "delete_snapshot" :: held 3.625s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:18:51 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d94fece-b57c-4a64-b85d-12f9e9daacbf tempest-VolumesTestJSON-1572473642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:18:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8d94fece-b57c-4a64-b85d-12f9e9daacbf tempest-VolumesTestJSON-1572473642 None] Flow 'volume_create_manager' (34732def-eb89-48fd-bb22-44cb15c5a8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:18:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8d94fece-b57c-4a64-b85d-12f9e9daacbf tempest-VolumesTestJSON-1572473642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcc6a802-aa9e-4094-bd69-6b23d7773da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:18:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8d94fece-b57c-4a64-b85d-12f9e9daacbf tempest-VolumesTestJSON-1572473642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcc6a802-aa9e-4094-bd69-6b23d7773da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:18:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1083827682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68a4993a-0a7b-4bbe-8488-89b995338ad2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a690506ebbd6415e8f4a32df3064d780',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:18:52Z,use_quota=True,user_id='9fb3cd3f56484630a298c7db30b337d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:18:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8d94fece-b57c-4a64-b85d-12f9e9daacbf tempest-VolumesTestJSON-1572473642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (198449f3-5dc6-409b-855a-b42987d33862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:18:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8d94fece-b57c-4a64-b85d-12f9e9daacbf tempest-VolumesTestJSON-1572473642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (198449f3-5dc6-409b-855a-b42987d33862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:18:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8d94fece-b57c-4a64-b85d-12f9e9daacbf tempest-VolumesTestJSON-1572473642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fddaeaa-e7f7-47ad-9a7c-b262a0a4f3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:18:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8d94fece-b57c-4a64-b85d-12f9e9daacbf tempest-VolumesTestJSON-1572473642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fddaeaa-e7f7-47ad-9a7c-b262a0a4f3e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68a4993a-0a7b-4bbe-8488-89b995338ad2', 'volume_name': 'volume-68a4993a-0a7b-4bbe-8488-89b995338ad2', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:18:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8d94fece-b57c-4a64-b85d-12f9e9daacbf tempest-VolumesTestJSON-1572473642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d55f313-a463-4563-866a-793202cca6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:18:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8d94fece-b57c-4a64-b85d-12f9e9daacbf tempest-VolumesTestJSON-1572473642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d55f313-a463-4563-866a-793202cca6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:18:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8d94fece-b57c-4a64-b85d-12f9e9daacbf tempest-VolumesTestJSON-1572473642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45502808-78b7-49b6-8dd2-bea6f0a31dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:18:51 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-8d94fece-b57c-4a64-b85d-12f9e9daacbf tempest-VolumesTestJSON-1572473642 None] Volume 68a4993a-0a7b-4bbe-8488-89b995338ad2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68a4993a-0a7b-4bbe-8488-89b995338ad2', 'volume_size': 1} Jul 07 08:18:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8d94fece-b57c-4a64-b85d-12f9e9daacbf tempest-VolumesTestJSON-1572473642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:18:52 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-aba0e77c-94fd-4672-854f-5d86c0170798 tempest-SnapshotsActionsTest-1989405612 None] Created reservations ['d2f2e268-ac9a-4073-a44c-69e7651dd024', 'f172e222-80ed-4bfe-aa6e-7a987e4758f9', '8c1ebb9f-ffed-401a-8448-f316baa43b85', '369dead7-8802-416a-816f-421e468224e9'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:18:52 devstack sudo[93749]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-77fc3373-5537-472a-8115-a155b1c16d60 tempest-GroupSnapshotsTest-1158654987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-dede928f-876a-48aa-ac40-8cf59e385737.info" returned: 0 in 0.777s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:52 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-77fc3373-5537-472a-8115-a155b1c16d60 tempest-GroupSnapshotsTest-1158654987 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-dede928f-876a-48aa-ac40-8cf59e385737.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 08:18:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-77fc3373-5537-472a-8115-a155b1c16d60 tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-dede928f-876a-48aa-ac40-8cf59e385737.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:52 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-aba0e77c-94fd-4672-854f-5d86c0170798 tempest-SnapshotsActionsTest-1989405612 None] Delete snapshot completed successfully. Jul 07 08:18:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-aba0e77c-94fd-4672-854f-5d86c0170798 tempest-SnapshotsActionsTest-1989405612 None] Lock "cinder-c7f1ecb5-b9a7-453b-bbc0-363595d884dc-delete_snapshot" released by "delete_snapshot" :: held 3.859s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:18:52 devstack sudo[93753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-dede928f-876a-48aa-ac40-8cf59e385737.info Jul 07 08:18:52 devstack sudo[93753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:52 devstack sudo[93753]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-77fc3373-5537-472a-8115-a155b1c16d60 tempest-GroupSnapshotsTest-1158654987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-dede928f-876a-48aa-ac40-8cf59e385737.info" returned: 0 in 0.673s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-77fc3373-5537-472a-8115-a155b1c16d60 tempest-GroupSnapshotsTest-1158654987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.058s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:18:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-77fc3373-5537-472a-8115-a155b1c16d60 tempest-GroupSnapshotsTest-1158654987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:18:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-77fc3373-5537-472a-8115-a155b1c16d60 tempest-GroupSnapshotsTest-1158654987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:18:52 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-77fc3373-5537-472a-8115-a155b1c16d60 tempest-GroupSnapshotsTest-1158654987 None] Creating offline snapshot dc993a7b-8974-4729-a7f8-ba8c01dd01a5 of volume 22043851-7841-4526-861e-74b4b3f55d55 {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:18:52 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb49cbb-6a0b-48f0-b474-fbbdf0ca952d]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:18:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-77fc3373-5537-472a-8115-a155b1c16d60 tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-22043851-7841-4526-861e-74b4b3f55d55 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6baba575-12e3-4dc9-b308-6cefcc8cffa1 tempest-SnapshotsActionsTest-452788111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:18:52 devstack sudo[93756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-22043851-7841-4526-861e-74b4b3f55d55 Jul 07 08:18:52 devstack sudo[93756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:53 devstack sudo[93756]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-77fc3373-5537-472a-8115-a155b1c16d60 tempest-GroupSnapshotsTest-1158654987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-22043851-7841-4526-861e-74b4b3f55d55" returned: 0 in 0.725s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-77fc3373-5537-472a-8115-a155b1c16d60 tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-22043851-7841-4526-861e-74b4b3f55d55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-22043851-7841-4526-861e-74b4b3f55d55.dc993a7b-8974-4729-a7f8-ba8c01dd01a5 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:53 devstack sudo[93761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-22043851-7841-4526-861e-74b4b3f55d55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-22043851-7841-4526-861e-74b4b3f55d55.dc993a7b-8974-4729-a7f8-ba8c01dd01a5 1G Jul 07 08:18:53 devstack sudo[93761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:54 devstack sudo[93761]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-77fc3373-5537-472a-8115-a155b1c16d60 tempest-GroupSnapshotsTest-1158654987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-22043851-7841-4526-861e-74b4b3f55d55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-22043851-7841-4526-861e-74b4b3f55d55.dc993a7b-8974-4729-a7f8-ba8c01dd01a5 1G" returned: 0 in 0.780s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-77fc3373-5537-472a-8115-a155b1c16d60 tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22043851-7841-4526-861e-74b4b3f55d55 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-22043851-7841-4526-861e-74b4b3f55d55.dc993a7b-8974-4729-a7f8-ba8c01dd01a5 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:54 devstack sudo[93766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22043851-7841-4526-861e-74b4b3f55d55 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-22043851-7841-4526-861e-74b4b3f55d55.dc993a7b-8974-4729-a7f8-ba8c01dd01a5 Jul 07 08:18:54 devstack sudo[93766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:54 devstack sudo[93766]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-77fc3373-5537-472a-8115-a155b1c16d60 tempest-GroupSnapshotsTest-1158654987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22043851-7841-4526-861e-74b4b3f55d55 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-22043851-7841-4526-861e-74b4b3f55d55.dc993a7b-8974-4729-a7f8-ba8c01dd01a5" returned: 0 in 0.675s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:54 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-77fc3373-5537-472a-8115-a155b1c16d60 tempest-GroupSnapshotsTest-1158654987 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-22043851-7841-4526-861e-74b4b3f55d55.dc993a7b-8974-4729-a7f8-ba8c01dd01a5 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 08:18:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-77fc3373-5537-472a-8115-a155b1c16d60 tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-22043851-7841-4526-861e-74b4b3f55d55.dc993a7b-8974-4729-a7f8-ba8c01dd01a5 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:55 devstack sudo[93771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-22043851-7841-4526-861e-74b4b3f55d55.dc993a7b-8974-4729-a7f8-ba8c01dd01a5 Jul 07 08:18:55 devstack sudo[93771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:55 devstack sudo[93771]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-77fc3373-5537-472a-8115-a155b1c16d60 tempest-GroupSnapshotsTest-1158654987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-22043851-7841-4526-861e-74b4b3f55d55.dc993a7b-8974-4729-a7f8-ba8c01dd01a5" returned: 0 in 0.600s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-77fc3373-5537-472a-8115-a155b1c16d60 tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-22043851-7841-4526-861e-74b4b3f55d55.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:55 devstack sudo[93774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-22043851-7841-4526-861e-74b4b3f55d55.info Jul 07 08:18:55 devstack sudo[93774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:56 devstack sudo[93774]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-77fc3373-5537-472a-8115-a155b1c16d60 tempest-GroupSnapshotsTest-1158654987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-22043851-7841-4526-861e-74b4b3f55d55.info" returned: 0 in 0.617s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:56 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-77fc3373-5537-472a-8115-a155b1c16d60 tempest-GroupSnapshotsTest-1158654987 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-22043851-7841-4526-861e-74b4b3f55d55.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 08:18:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-77fc3373-5537-472a-8115-a155b1c16d60 tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-22043851-7841-4526-861e-74b4b3f55d55.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:56 devstack sudo[93777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-22043851-7841-4526-861e-74b4b3f55d55.info Jul 07 08:18:56 devstack sudo[93777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:56 devstack sudo[93777]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-77fc3373-5537-472a-8115-a155b1c16d60 tempest-GroupSnapshotsTest-1158654987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-22043851-7841-4526-861e-74b4b3f55d55.info" returned: 0 in 0.665s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-77fc3373-5537-472a-8115-a155b1c16d60 tempest-GroupSnapshotsTest-1158654987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.163s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:18:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8d94fece-b57c-4a64-b85d-12f9e9daacbf tempest-VolumesTestJSON-1572473642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.962s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:18:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8d94fece-b57c-4a64-b85d-12f9e9daacbf tempest-VolumesTestJSON-1572473642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:18:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1083827682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68a4993a-0a7b-4bbe-8488-89b995338ad2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a690506ebbd6415e8f4a32df3064d780',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:18:52Z,use_quota=True,user_id='9fb3cd3f56484630a298c7db30b337d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:18:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-8d94fece-b57c-4a64-b85d-12f9e9daacbf tempest-VolumesTestJSON-1572473642 None] Creating volume 68a4993a-0a7b-4bbe-8488-89b995338ad2 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:18:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8d94fece-b57c-4a64-b85d-12f9e9daacbf tempest-VolumesTestJSON-1572473642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:18:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8d94fece-b57c-4a64-b85d-12f9e9daacbf tempest-VolumesTestJSON-1572473642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:18:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8d94fece-b57c-4a64-b85d-12f9e9daacbf tempest-VolumesTestJSON-1572473642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:18:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8d94fece-b57c-4a64-b85d-12f9e9daacbf tempest-VolumesTestJSON-1572473642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:18:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8d94fece-b57c-4a64-b85d-12f9e9daacbf tempest-VolumesTestJSON-1572473642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:18:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8d94fece-b57c-4a64-b85d-12f9e9daacbf tempest-VolumesTestJSON-1572473642 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:18:56 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-8d94fece-b57c-4a64-b85d-12f9e9daacbf tempest-VolumesTestJSON-1572473642 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:18:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8d94fece-b57c-4a64-b85d-12f9e9daacbf tempest-VolumesTestJSON-1572473642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-68a4993a-0a7b-4bbe-8488-89b995338ad2 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:56 devstack sudo[93780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-68a4993a-0a7b-4bbe-8488-89b995338ad2 1073741824 Jul 07 08:18:56 devstack sudo[93780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:57 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-77fc3373-5537-472a-8115-a155b1c16d60 tempest-GroupSnapshotsTest-1158654987 None] group_snapshot f6e31a16-6ddb-4803-8e5f-25254c0be49d: created successfully Jul 07 08:18:57 devstack sudo[93780]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8d94fece-b57c-4a64-b85d-12f9e9daacbf tempest-VolumesTestJSON-1572473642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-68a4993a-0a7b-4bbe-8488-89b995338ad2 1073741824" returned: 0 in 0.891s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8d94fece-b57c-4a64-b85d-12f9e9daacbf tempest-VolumesTestJSON-1572473642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-68a4993a-0a7b-4bbe-8488-89b995338ad2 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:57 devstack sudo[93786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-68a4993a-0a7b-4bbe-8488-89b995338ad2 Jul 07 08:18:57 devstack sudo[93786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:58 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-943e9208-fd99-4ee5-9482-6e6e92835ae2 tempest-GroupSnapshotsTest-1158654987 None] group_snapshot f6e31a16-6ddb-4803-8e5f-25254c0be49d: deleting Jul 07 08:18:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-943e9208-fd99-4ee5-9482-6e6e92835ae2 tempest-GroupSnapshotsTest-1158654987 None] group_snapshot f6e31a16-6ddb-4803-8e5f-25254c0be49d: deleting {{(pid=87199) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 07 08:18:58 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-943e9208-fd99-4ee5-9482-6e6e92835ae2 tempest-GroupSnapshotsTest-1158654987 None] Acquiring lock "cinder-quobyte-dede928f-876a-48aa-ac40-8cf59e385737" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:18:58 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-943e9208-fd99-4ee5-9482-6e6e92835ae2 tempest-GroupSnapshotsTest-1158654987 None] Lock "cinder-quobyte-dede928f-876a-48aa-ac40-8cf59e385737" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:18:58 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-943e9208-fd99-4ee5-9482-6e6e92835ae2 tempest-GroupSnapshotsTest-1158654987 None] Acquiring lock "cinder-quobyte-0bd22501-c0fa-4e91-b881-d1f7a67c9d1f" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:18:58 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-943e9208-fd99-4ee5-9482-6e6e92835ae2 tempest-GroupSnapshotsTest-1158654987 None] Lock "cinder-quobyte-0bd22501-c0fa-4e91-b881-d1f7a67c9d1f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:18:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-943e9208-fd99-4ee5-9482-6e6e92835ae2 tempest-GroupSnapshotsTest-1158654987 None] Deleting offline snapshot 0bd22501-c0fa-4e91-b881-d1f7a67c9d1f of volume dede928f-876a-48aa-ac40-8cf59e385737 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:18:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-943e9208-fd99-4ee5-9482-6e6e92835ae2 tempest-GroupSnapshotsTest-1158654987 None] snapshot_file for this snap is: volume-dede928f-876a-48aa-ac40-8cf59e385737.0bd22501-c0fa-4e91-b881-d1f7a67c9d1f {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:18:58 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d332ff8-a34f-408a-ab01-f32154ddbaba]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:18:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-943e9208-fd99-4ee5-9482-6e6e92835ae2 tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-dede928f-876a-48aa-ac40-8cf59e385737.0bd22501-c0fa-4e91-b881-d1f7a67c9d1f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:58 devstack sudo[93788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-dede928f-876a-48aa-ac40-8cf59e385737.0bd22501-c0fa-4e91-b881-d1f7a67c9d1f Jul 07 08:18:58 devstack sudo[93788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:58 devstack sudo[93786]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8d94fece-b57c-4a64-b85d-12f9e9daacbf tempest-VolumesTestJSON-1572473642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-68a4993a-0a7b-4bbe-8488-89b995338ad2" returned: 0 in 0.644s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8d94fece-b57c-4a64-b85d-12f9e9daacbf tempest-VolumesTestJSON-1572473642 None] <== create_volume: return (1583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:18:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8d94fece-b57c-4a64-b85d-12f9e9daacbf tempest-VolumesTestJSON-1572473642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.586s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:18:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6baba575-12e3-4dc9-b308-6cefcc8cffa1 tempest-SnapshotsActionsTest-452788111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.695s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:18:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8d94fece-b57c-4a64-b85d-12f9e9daacbf tempest-VolumesTestJSON-1572473642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45502808-78b7-49b6-8dd2-bea6f0a31dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68a4993a-0a7b-4bbe-8488-89b995338ad2', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:18:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8d94fece-b57c-4a64-b85d-12f9e9daacbf tempest-VolumesTestJSON-1572473642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a93eda3e-2a8c-4a64-a9b8-8d0e97de287a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:18:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-6baba575-12e3-4dc9-b308-6cefcc8cffa1 tempest-SnapshotsActionsTest-452788111 None] Creating offline snapshot 5a46560e-a586-41f1-ba26-8f14d5715955 of volume 97ff669d-e3e6-44da-95b7-dad653e0cecc {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:18:58 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-8d94fece-b57c-4a64-b85d-12f9e9daacbf tempest-VolumesTestJSON-1572473642 None] Volume volume-68a4993a-0a7b-4bbe-8488-89b995338ad2 (68a4993a-0a7b-4bbe-8488-89b995338ad2): created successfully Jul 07 08:18:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8d94fece-b57c-4a64-b85d-12f9e9daacbf tempest-VolumesTestJSON-1572473642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a93eda3e-2a8c-4a64-a9b8-8d0e97de287a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:18:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8d94fece-b57c-4a64-b85d-12f9e9daacbf tempest-VolumesTestJSON-1572473642 None] Flow 'volume_create_manager' (34732def-eb89-48fd-bb22-44cb15c5a8a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:18:58 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[6688f849-2161-4d47-a277-7e3687c83fbd]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:18:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6baba575-12e3-4dc9-b308-6cefcc8cffa1 tempest-SnapshotsActionsTest-452788111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:58 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-8d94fece-b57c-4a64-b85d-12f9e9daacbf tempest-VolumesTestJSON-1572473642 None] Created volume successfully. Jul 07 08:18:58 devstack sudo[93791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad Jul 07 08:18:58 devstack sudo[93791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:59 devstack sudo[93788]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-943e9208-fd99-4ee5-9482-6e6e92835ae2 tempest-GroupSnapshotsTest-1158654987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-dede928f-876a-48aa-ac40-8cf59e385737.0bd22501-c0fa-4e91-b881-d1f7a67c9d1f" returned: 0 in 0.776s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:59 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-943e9208-fd99-4ee5-9482-6e6e92835ae2 tempest-GroupSnapshotsTest-1158654987 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dede928f-876a-48aa-ac40-8cf59e385737(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:18:59 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[546333fc-1aed-42fd-95e8-00f63bb8965c]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:18:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-943e9208-fd99-4ee5-9482-6e6e92835ae2 tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-dede928f-876a-48aa-ac40-8cf59e385737 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:59 devstack sudo[93797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-dede928f-876a-48aa-ac40-8cf59e385737 Jul 07 08:18:59 devstack sudo[93797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:59 devstack sudo[93791]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6baba575-12e3-4dc9-b308-6cefcc8cffa1 tempest-SnapshotsActionsTest-452788111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad" returned: 0 in 0.743s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:59 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-6baba575-12e3-4dc9-b308-6cefcc8cffa1 tempest-SnapshotsActionsTest-452788111 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97ff669d-e3e6-44da-95b7-dad653e0cecc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:18:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6baba575-12e3-4dc9-b308-6cefcc8cffa1 tempest-SnapshotsActionsTest-452788111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.5a46560e-a586-41f1-ba26-8f14d5715955 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:59 devstack sudo[93802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.5a46560e-a586-41f1-ba26-8f14d5715955 1G Jul 07 08:18:59 devstack sudo[93802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:59 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-02fcccc5-a6aa-4e38-8ffa-5db5d7efdcfe tempest-VolumesTestJSON-1572473642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:18:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-02fcccc5-a6aa-4e38-8ffa-5db5d7efdcfe tempest-VolumesTestJSON-1572473642 None] Flow 'volume_create_manager' (55cb6b41-35be-4fca-918a-bdf44621092d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:18:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-02fcccc5-a6aa-4e38-8ffa-5db5d7efdcfe tempest-VolumesTestJSON-1572473642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ed80f6c-0781-4c72-8cce-77f8b2e5fd7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:18:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-02fcccc5-a6aa-4e38-8ffa-5db5d7efdcfe tempest-VolumesTestJSON-1572473642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ed80f6c-0781-4c72-8cce-77f8b2e5fd7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:18:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-5049063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30540856-6b5e-4e2e-bedc-d18246bbd3fc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a690506ebbd6415e8f4a32df3064d780',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:19:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:19:00Z,use_quota=True,user_id='9fb3cd3f56484630a298c7db30b337d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:18:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-02fcccc5-a6aa-4e38-8ffa-5db5d7efdcfe tempest-VolumesTestJSON-1572473642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dec6c362-4a58-4254-9b6e-b83951e9645e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:18:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-02fcccc5-a6aa-4e38-8ffa-5db5d7efdcfe tempest-VolumesTestJSON-1572473642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dec6c362-4a58-4254-9b6e-b83951e9645e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:18:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-02fcccc5-a6aa-4e38-8ffa-5db5d7efdcfe tempest-VolumesTestJSON-1572473642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97da5c6d-f8d5-4dc7-8f44-09dc1f8d4e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:18:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-02fcccc5-a6aa-4e38-8ffa-5db5d7efdcfe tempest-VolumesTestJSON-1572473642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97da5c6d-f8d5-4dc7-8f44-09dc1f8d4e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30540856-6b5e-4e2e-bedc-d18246bbd3fc', 'volume_name': 'volume-30540856-6b5e-4e2e-bedc-d18246bbd3fc', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:18:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-02fcccc5-a6aa-4e38-8ffa-5db5d7efdcfe tempest-VolumesTestJSON-1572473642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae04b873-dabf-4bd8-9ddf-f85534a971d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:18:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-02fcccc5-a6aa-4e38-8ffa-5db5d7efdcfe tempest-VolumesTestJSON-1572473642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae04b873-dabf-4bd8-9ddf-f85534a971d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:18:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-02fcccc5-a6aa-4e38-8ffa-5db5d7efdcfe tempest-VolumesTestJSON-1572473642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b16d2e88-c128-4d6e-9205-7f36cc37ff7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:18:59 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-02fcccc5-a6aa-4e38-8ffa-5db5d7efdcfe tempest-VolumesTestJSON-1572473642 None] Volume 30540856-6b5e-4e2e-bedc-d18246bbd3fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30540856-6b5e-4e2e-bedc-d18246bbd3fc', 'volume_size': 1} Jul 07 08:18:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-02fcccc5-a6aa-4e38-8ffa-5db5d7efdcfe tempest-VolumesTestJSON-1572473642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:18:59 devstack sudo[93797]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-943e9208-fd99-4ee5-9482-6e6e92835ae2 tempest-GroupSnapshotsTest-1158654987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-dede928f-876a-48aa-ac40-8cf59e385737" returned: 0 in 0.871s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-943e9208-fd99-4ee5-9482-6e6e92835ae2 tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-dede928f-876a-48aa-ac40-8cf59e385737.0bd22501-c0fa-4e91-b881-d1f7a67c9d1f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:00 devstack sudo[93811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-dede928f-876a-48aa-ac40-8cf59e385737.0bd22501-c0fa-4e91-b881-d1f7a67c9d1f Jul 07 08:19:00 devstack sudo[93811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:00 devstack sudo[93802]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6baba575-12e3-4dc9-b308-6cefcc8cffa1 tempest-SnapshotsActionsTest-452788111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.5a46560e-a586-41f1-ba26-8f14d5715955 1G" returned: 0 in 0.898s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6baba575-12e3-4dc9-b308-6cefcc8cffa1 tempest-SnapshotsActionsTest-452788111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.5a46560e-a586-41f1-ba26-8f14d5715955 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:00 devstack sudo[93814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.5a46560e-a586-41f1-ba26-8f14d5715955 Jul 07 08:19:00 devstack sudo[93814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:00 devstack sudo[93811]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-943e9208-fd99-4ee5-9482-6e6e92835ae2 tempest-GroupSnapshotsTest-1158654987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-dede928f-876a-48aa-ac40-8cf59e385737.0bd22501-c0fa-4e91-b881-d1f7a67c9d1f" returned: 0 in 0.750s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-943e9208-fd99-4ee5-9482-6e6e92835ae2 tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-dede928f-876a-48aa-ac40-8cf59e385737.0bd22501-c0fa-4e91-b881-d1f7a67c9d1f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:00 devstack sudo[93821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-dede928f-876a-48aa-ac40-8cf59e385737.0bd22501-c0fa-4e91-b881-d1f7a67c9d1f Jul 07 08:19:00 devstack sudo[93821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:00 devstack sudo[93814]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6baba575-12e3-4dc9-b308-6cefcc8cffa1 tempest-SnapshotsActionsTest-452788111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.5a46560e-a586-41f1-ba26-8f14d5715955" returned: 0 in 0.682s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:00 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-6baba575-12e3-4dc9-b308-6cefcc8cffa1 tempest-SnapshotsActionsTest-452788111 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.5a46560e-a586-41f1-ba26-8f14d5715955 is being set with open permissions: ugo+rw Jul 07 08:19:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6baba575-12e3-4dc9-b308-6cefcc8cffa1 tempest-SnapshotsActionsTest-452788111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.5a46560e-a586-41f1-ba26-8f14d5715955 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:00 devstack sudo[93827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.5a46560e-a586-41f1-ba26-8f14d5715955 Jul 07 08:19:00 devstack sudo[93827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:01 devstack sudo[93821]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-943e9208-fd99-4ee5-9482-6e6e92835ae2 tempest-GroupSnapshotsTest-1158654987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-dede928f-876a-48aa-ac40-8cf59e385737.0bd22501-c0fa-4e91-b881-d1f7a67c9d1f" returned: 0 in 0.697s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:01 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-943e9208-fd99-4ee5-9482-6e6e92835ae2 tempest-GroupSnapshotsTest-1158654987 None] Lock "cinder-quobyte-0bd22501-c0fa-4e91-b881-d1f7a67c9d1f" released by "_delete_snapshot" :: held 3.212s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:19:01 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-943e9208-fd99-4ee5-9482-6e6e92835ae2 tempest-GroupSnapshotsTest-1158654987 None] Lock "cinder-quobyte-dede928f-876a-48aa-ac40-8cf59e385737" released by "delete_snapshot" :: held 3.238s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:19:01 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-943e9208-fd99-4ee5-9482-6e6e92835ae2 tempest-GroupSnapshotsTest-1158654987 None] Acquiring lock "cinder-quobyte-22043851-7841-4526-861e-74b4b3f55d55" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:19:01 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-943e9208-fd99-4ee5-9482-6e6e92835ae2 tempest-GroupSnapshotsTest-1158654987 None] Lock "cinder-quobyte-22043851-7841-4526-861e-74b4b3f55d55" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:19:01 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-943e9208-fd99-4ee5-9482-6e6e92835ae2 tempest-GroupSnapshotsTest-1158654987 None] Acquiring lock "cinder-quobyte-dc993a7b-8974-4729-a7f8-ba8c01dd01a5" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:19:01 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-943e9208-fd99-4ee5-9482-6e6e92835ae2 tempest-GroupSnapshotsTest-1158654987 None] Lock "cinder-quobyte-dc993a7b-8974-4729-a7f8-ba8c01dd01a5" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:19:01 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-943e9208-fd99-4ee5-9482-6e6e92835ae2 tempest-GroupSnapshotsTest-1158654987 None] Deleting offline snapshot dc993a7b-8974-4729-a7f8-ba8c01dd01a5 of volume 22043851-7841-4526-861e-74b4b3f55d55 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:19:01 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-943e9208-fd99-4ee5-9482-6e6e92835ae2 tempest-GroupSnapshotsTest-1158654987 None] snapshot_file for this snap is: volume-22043851-7841-4526-861e-74b4b3f55d55.dc993a7b-8974-4729-a7f8-ba8c01dd01a5 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:19:01 devstack sudo[93827]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:01 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[94deabdf-bf29-4144-8f71-dcf7a80d70ca]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:19:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-943e9208-fd99-4ee5-9482-6e6e92835ae2 tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-22043851-7841-4526-861e-74b4b3f55d55.dc993a7b-8974-4729-a7f8-ba8c01dd01a5 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6baba575-12e3-4dc9-b308-6cefcc8cffa1 tempest-SnapshotsActionsTest-452788111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.5a46560e-a586-41f1-ba26-8f14d5715955" returned: 0 in 0.686s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6baba575-12e3-4dc9-b308-6cefcc8cffa1 tempest-SnapshotsActionsTest-452788111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.153s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-02fcccc5-a6aa-4e38-8ffa-5db5d7efdcfe tempest-VolumesTestJSON-1572473642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.767s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:01 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-02fcccc5-a6aa-4e38-8ffa-5db5d7efdcfe tempest-VolumesTestJSON-1572473642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:18:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-5049063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30540856-6b5e-4e2e-bedc-d18246bbd3fc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a690506ebbd6415e8f4a32df3064d780',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:19:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:19:00Z,use_quota=True,user_id='9fb3cd3f56484630a298c7db30b337d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:19:01 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-02fcccc5-a6aa-4e38-8ffa-5db5d7efdcfe tempest-VolumesTestJSON-1572473642 None] Creating volume 30540856-6b5e-4e2e-bedc-d18246bbd3fc {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:19:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-02fcccc5-a6aa-4e38-8ffa-5db5d7efdcfe tempest-VolumesTestJSON-1572473642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-02fcccc5-a6aa-4e38-8ffa-5db5d7efdcfe tempest-VolumesTestJSON-1572473642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:01 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-02fcccc5-a6aa-4e38-8ffa-5db5d7efdcfe tempest-VolumesTestJSON-1572473642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:19:01 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-02fcccc5-a6aa-4e38-8ffa-5db5d7efdcfe tempest-VolumesTestJSON-1572473642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:19:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-02fcccc5-a6aa-4e38-8ffa-5db5d7efdcfe tempest-VolumesTestJSON-1572473642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:01 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-02fcccc5-a6aa-4e38-8ffa-5db5d7efdcfe tempest-VolumesTestJSON-1572473642 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:19:01 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-02fcccc5-a6aa-4e38-8ffa-5db5d7efdcfe tempest-VolumesTestJSON-1572473642 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:19:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-02fcccc5-a6aa-4e38-8ffa-5db5d7efdcfe tempest-VolumesTestJSON-1572473642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-30540856-6b5e-4e2e-bedc-d18246bbd3fc 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:01 devstack sudo[93836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-30540856-6b5e-4e2e-bedc-d18246bbd3fc 1073741824 Jul 07 08:19:01 devstack sudo[93836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:01 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-6baba575-12e3-4dc9-b308-6cefcc8cffa1 tempest-SnapshotsActionsTest-452788111 None] Create snapshot completed successfully Jul 07 08:19:01 devstack sudo[93835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-22043851-7841-4526-861e-74b4b3f55d55.dc993a7b-8974-4729-a7f8-ba8c01dd01a5 Jul 07 08:19:01 devstack sudo[93835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:01 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b0863c0-5243-4e1c-8e8c-7b47a2936154 tempest-AttachVolumeTestJSON-1669838508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:19:01 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8b0863c0-5243-4e1c-8e8c-7b47a2936154 tempest-AttachVolumeTestJSON-1669838508 None] Flow 'volume_create_manager' (01f8ef8a-c49c-456b-9c01-7ba5ff09904b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:19:01 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8b0863c0-5243-4e1c-8e8c-7b47a2936154 tempest-AttachVolumeTestJSON-1669838508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35e30b66-6d00-4c2c-ba21-4325f542b5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:01 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8b0863c0-5243-4e1c-8e8c-7b47a2936154 tempest-AttachVolumeTestJSON-1669838508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35e30b66-6d00-4c2c-ba21-4325f542b5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1606282963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b564ca67-15fa-4a97-9420-6868e009d50f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dece2e57fb847e191255e8956dcc583',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:19:02Z,use_quota=True,user_id='d580e0190dfb4020999f268cfcb2a74c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:01 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8b0863c0-5243-4e1c-8e8c-7b47a2936154 tempest-AttachVolumeTestJSON-1669838508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95292be2-1234-4511-98b7-079ecbb197ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:01 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8b0863c0-5243-4e1c-8e8c-7b47a2936154 tempest-AttachVolumeTestJSON-1669838508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95292be2-1234-4511-98b7-079ecbb197ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:01 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8b0863c0-5243-4e1c-8e8c-7b47a2936154 tempest-AttachVolumeTestJSON-1669838508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d2f9b0d-7724-4469-952e-30c277c0b5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:01 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8b0863c0-5243-4e1c-8e8c-7b47a2936154 tempest-AttachVolumeTestJSON-1669838508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d2f9b0d-7724-4469-952e-30c277c0b5af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b564ca67-15fa-4a97-9420-6868e009d50f', 'volume_name': 'volume-b564ca67-15fa-4a97-9420-6868e009d50f', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:01 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8b0863c0-5243-4e1c-8e8c-7b47a2936154 tempest-AttachVolumeTestJSON-1669838508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (944d2512-30df-4783-972d-cfaab66ed4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:01 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8b0863c0-5243-4e1c-8e8c-7b47a2936154 tempest-AttachVolumeTestJSON-1669838508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (944d2512-30df-4783-972d-cfaab66ed4b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:01 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8b0863c0-5243-4e1c-8e8c-7b47a2936154 tempest-AttachVolumeTestJSON-1669838508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca62b482-f0b8-406b-b72a-2c9c02f539a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:01 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-8b0863c0-5243-4e1c-8e8c-7b47a2936154 tempest-AttachVolumeTestJSON-1669838508 None] Volume b564ca67-15fa-4a97-9420-6868e009d50f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b564ca67-15fa-4a97-9420-6868e009d50f', 'volume_size': 1} Jul 07 08:19:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8b0863c0-5243-4e1c-8e8c-7b47a2936154 tempest-AttachVolumeTestJSON-1669838508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:02 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6e55b0a7-006b-4f25-bca4-25e2896f1b98 tempest-SnapshotsActionsTest-1989405612 None] Acquiring lock "cinder-5a46560e-a586-41f1-ba26-8f14d5715955-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:19:02 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6e55b0a7-006b-4f25-bca4-25e2896f1b98 tempest-SnapshotsActionsTest-1989405612 None] Lock "cinder-5a46560e-a586-41f1-ba26-8f14d5715955-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:19:02 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6e55b0a7-006b-4f25-bca4-25e2896f1b98 tempest-SnapshotsActionsTest-1989405612 None] Acquiring lock "cinder-quobyte-97ff669d-e3e6-44da-95b7-dad653e0cecc" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:19:02 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6e55b0a7-006b-4f25-bca4-25e2896f1b98 tempest-SnapshotsActionsTest-1989405612 None] Lock "cinder-quobyte-97ff669d-e3e6-44da-95b7-dad653e0cecc" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:19:02 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6e55b0a7-006b-4f25-bca4-25e2896f1b98 tempest-SnapshotsActionsTest-1989405612 None] Acquiring lock "cinder-quobyte-5a46560e-a586-41f1-ba26-8f14d5715955" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:19:02 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6e55b0a7-006b-4f25-bca4-25e2896f1b98 tempest-SnapshotsActionsTest-1989405612 None] Lock "cinder-quobyte-5a46560e-a586-41f1-ba26-8f14d5715955" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:19:02 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-6e55b0a7-006b-4f25-bca4-25e2896f1b98 tempest-SnapshotsActionsTest-1989405612 None] Deleting offline snapshot 5a46560e-a586-41f1-ba26-8f14d5715955 of volume 97ff669d-e3e6-44da-95b7-dad653e0cecc {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:19:02 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-6e55b0a7-006b-4f25-bca4-25e2896f1b98 tempest-SnapshotsActionsTest-1989405612 None] snapshot_file for this snap is: volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.5a46560e-a586-41f1-ba26-8f14d5715955 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:19:02 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4c7659-df33-4562-9131-876987430b67]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:19:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6e55b0a7-006b-4f25-bca4-25e2896f1b98 tempest-SnapshotsActionsTest-1989405612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.5a46560e-a586-41f1-ba26-8f14d5715955 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:02 devstack sudo[93835]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-943e9208-fd99-4ee5-9482-6e6e92835ae2 tempest-GroupSnapshotsTest-1158654987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-22043851-7841-4526-861e-74b4b3f55d55.dc993a7b-8974-4729-a7f8-ba8c01dd01a5" returned: 0 in 0.836s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:02 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-943e9208-fd99-4ee5-9482-6e6e92835ae2 tempest-GroupSnapshotsTest-1158654987 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22043851-7841-4526-861e-74b4b3f55d55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:19:02 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14a83fe-38dc-4d48-bb86-b7db00f99670]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:19:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-943e9208-fd99-4ee5-9482-6e6e92835ae2 tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-22043851-7841-4526-861e-74b4b3f55d55 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:02 devstack sudo[93845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.5a46560e-a586-41f1-ba26-8f14d5715955 Jul 07 08:19:02 devstack sudo[93845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:02 devstack sudo[93836]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-02fcccc5-a6aa-4e38-8ffa-5db5d7efdcfe tempest-VolumesTestJSON-1572473642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-30540856-6b5e-4e2e-bedc-d18246bbd3fc 1073741824" returned: 0 in 0.892s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:02 devstack sudo[93846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-22043851-7841-4526-861e-74b4b3f55d55 Jul 07 08:19:02 devstack sudo[93846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-02fcccc5-a6aa-4e38-8ffa-5db5d7efdcfe tempest-VolumesTestJSON-1572473642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-30540856-6b5e-4e2e-bedc-d18246bbd3fc {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:02 devstack sudo[93849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-30540856-6b5e-4e2e-bedc-d18246bbd3fc Jul 07 08:19:02 devstack sudo[93849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:03 devstack sudo[93845]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6e55b0a7-006b-4f25-bca4-25e2896f1b98 tempest-SnapshotsActionsTest-1989405612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.5a46560e-a586-41f1-ba26-8f14d5715955" returned: 0 in 0.848s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-6e55b0a7-006b-4f25-bca4-25e2896f1b98 tempest-SnapshotsActionsTest-1989405612 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97ff669d-e3e6-44da-95b7-dad653e0cecc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:19:03 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc1035f-0150-4f37-a501-c2952c3b16c1]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:19:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6e55b0a7-006b-4f25-bca4-25e2896f1b98 tempest-SnapshotsActionsTest-1989405612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:03 devstack sudo[93846]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-943e9208-fd99-4ee5-9482-6e6e92835ae2 tempest-GroupSnapshotsTest-1158654987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-22043851-7841-4526-861e-74b4b3f55d55" returned: 0 in 0.821s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-943e9208-fd99-4ee5-9482-6e6e92835ae2 tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-22043851-7841-4526-861e-74b4b3f55d55.dc993a7b-8974-4729-a7f8-ba8c01dd01a5 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:03 devstack sudo[93859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-22043851-7841-4526-861e-74b4b3f55d55.dc993a7b-8974-4729-a7f8-ba8c01dd01a5 Jul 07 08:19:03 devstack sudo[93859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:03 devstack sudo[93849]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-02fcccc5-a6aa-4e38-8ffa-5db5d7efdcfe tempest-VolumesTestJSON-1572473642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-30540856-6b5e-4e2e-bedc-d18246bbd3fc" returned: 0 in 0.743s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-02fcccc5-a6aa-4e38-8ffa-5db5d7efdcfe tempest-VolumesTestJSON-1572473642 None] <== create_volume: return (1686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:19:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-02fcccc5-a6aa-4e38-8ffa-5db5d7efdcfe tempest-VolumesTestJSON-1572473642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.689s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8b0863c0-5243-4e1c-8e8c-7b47a2936154 tempest-AttachVolumeTestJSON-1669838508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.434s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:03 devstack sudo[93858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad Jul 07 08:19:03 devstack sudo[93858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8b0863c0-5243-4e1c-8e8c-7b47a2936154 tempest-AttachVolumeTestJSON-1669838508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1606282963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b564ca67-15fa-4a97-9420-6868e009d50f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dece2e57fb847e191255e8956dcc583',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:19:02Z,use_quota=True,user_id='d580e0190dfb4020999f268cfcb2a74c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:19:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-8b0863c0-5243-4e1c-8e8c-7b47a2936154 tempest-AttachVolumeTestJSON-1669838508 None] Creating volume b564ca67-15fa-4a97-9420-6868e009d50f {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:19:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8b0863c0-5243-4e1c-8e8c-7b47a2936154 tempest-AttachVolumeTestJSON-1669838508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8b0863c0-5243-4e1c-8e8c-7b47a2936154 tempest-AttachVolumeTestJSON-1669838508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8b0863c0-5243-4e1c-8e8c-7b47a2936154 tempest-AttachVolumeTestJSON-1669838508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:19:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8b0863c0-5243-4e1c-8e8c-7b47a2936154 tempest-AttachVolumeTestJSON-1669838508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:19:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8b0863c0-5243-4e1c-8e8c-7b47a2936154 tempest-AttachVolumeTestJSON-1669838508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8b0863c0-5243-4e1c-8e8c-7b47a2936154 tempest-AttachVolumeTestJSON-1669838508 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:19:03 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-8b0863c0-5243-4e1c-8e8c-7b47a2936154 tempest-AttachVolumeTestJSON-1669838508 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:19:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8b0863c0-5243-4e1c-8e8c-7b47a2936154 tempest-AttachVolumeTestJSON-1669838508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b564ca67-15fa-4a97-9420-6868e009d50f 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-02fcccc5-a6aa-4e38-8ffa-5db5d7efdcfe tempest-VolumesTestJSON-1572473642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b16d2e88-c128-4d6e-9205-7f36cc37ff7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30540856-6b5e-4e2e-bedc-d18246bbd3fc', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-02fcccc5-a6aa-4e38-8ffa-5db5d7efdcfe tempest-VolumesTestJSON-1572473642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b0e42d0-2eaf-41a9-9994-e746357c9eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:03 devstack sudo[93862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b564ca67-15fa-4a97-9420-6868e009d50f 1073741824 Jul 07 08:19:03 devstack sudo[93862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:03 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-02fcccc5-a6aa-4e38-8ffa-5db5d7efdcfe tempest-VolumesTestJSON-1572473642 None] Volume volume-30540856-6b5e-4e2e-bedc-d18246bbd3fc (30540856-6b5e-4e2e-bedc-d18246bbd3fc): created successfully Jul 07 08:19:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-02fcccc5-a6aa-4e38-8ffa-5db5d7efdcfe tempest-VolumesTestJSON-1572473642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b0e42d0-2eaf-41a9-9994-e746357c9eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-02fcccc5-a6aa-4e38-8ffa-5db5d7efdcfe tempest-VolumesTestJSON-1572473642 None] Flow 'volume_create_manager' (55cb6b41-35be-4fca-918a-bdf44621092d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:19:03 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-02fcccc5-a6aa-4e38-8ffa-5db5d7efdcfe tempest-VolumesTestJSON-1572473642 None] Created volume successfully. Jul 07 08:19:04 devstack sudo[93859]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-943e9208-fd99-4ee5-9482-6e6e92835ae2 tempest-GroupSnapshotsTest-1158654987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-22043851-7841-4526-861e-74b4b3f55d55.dc993a7b-8974-4729-a7f8-ba8c01dd01a5" returned: 0 in 0.786s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-943e9208-fd99-4ee5-9482-6e6e92835ae2 tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-22043851-7841-4526-861e-74b4b3f55d55.dc993a7b-8974-4729-a7f8-ba8c01dd01a5 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:04 devstack sudo[93858]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6e55b0a7-006b-4f25-bca4-25e2896f1b98 tempest-SnapshotsActionsTest-1989405612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad" returned: 0 in 0.846s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-6e55b0a7-006b-4f25-bca4-25e2896f1b98 tempest-SnapshotsActionsTest-1989405612 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97ff669d-e3e6-44da-95b7-dad653e0cecc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:19:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6e55b0a7-006b-4f25-bca4-25e2896f1b98 tempest-SnapshotsActionsTest-1989405612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.5a46560e-a586-41f1-ba26-8f14d5715955 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:04 devstack sudo[93873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-22043851-7841-4526-861e-74b4b3f55d55.dc993a7b-8974-4729-a7f8-ba8c01dd01a5 Jul 07 08:19:04 devstack sudo[93873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:04 devstack sudo[93874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.5a46560e-a586-41f1-ba26-8f14d5715955 Jul 07 08:19:04 devstack sudo[93874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:04 devstack sudo[93862]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8b0863c0-5243-4e1c-8e8c-7b47a2936154 tempest-AttachVolumeTestJSON-1669838508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b564ca67-15fa-4a97-9420-6868e009d50f 1073741824" returned: 0 in 0.919s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8b0863c0-5243-4e1c-8e8c-7b47a2936154 tempest-AttachVolumeTestJSON-1669838508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b564ca67-15fa-4a97-9420-6868e009d50f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:04 devstack sudo[93877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b564ca67-15fa-4a97-9420-6868e009d50f Jul 07 08:19:04 devstack sudo[93877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:04 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-d42c7b2b-d7af-42d7-bc57-d2f3693e9ab8 tempest-VolumesTestJSON-1572473642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:19:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d42c7b2b-d7af-42d7-bc57-d2f3693e9ab8 tempest-VolumesTestJSON-1572473642 None] Flow 'volume_create_manager' (b63c1c8f-c496-4923-82f1-9bc04b657244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:19:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d42c7b2b-d7af-42d7-bc57-d2f3693e9ab8 tempest-VolumesTestJSON-1572473642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c688e8d-c776-4a6a-99b9-454805a70336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d42c7b2b-d7af-42d7-bc57-d2f3693e9ab8 tempest-VolumesTestJSON-1572473642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c688e8d-c776-4a6a-99b9-454805a70336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:19:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-697740489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87cd6611-0f8c-4aa5-b86d-653cf9fe7826,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a690506ebbd6415e8f4a32df3064d780',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:19:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:19:05Z,use_quota=True,user_id='9fb3cd3f56484630a298c7db30b337d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d42c7b2b-d7af-42d7-bc57-d2f3693e9ab8 tempest-VolumesTestJSON-1572473642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1af69b15-d277-4c39-84bf-9084c69c7508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d42c7b2b-d7af-42d7-bc57-d2f3693e9ab8 tempest-VolumesTestJSON-1572473642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1af69b15-d277-4c39-84bf-9084c69c7508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d42c7b2b-d7af-42d7-bc57-d2f3693e9ab8 tempest-VolumesTestJSON-1572473642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba44fa37-4686-449a-8c21-c63ab0850d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d42c7b2b-d7af-42d7-bc57-d2f3693e9ab8 tempest-VolumesTestJSON-1572473642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba44fa37-4686-449a-8c21-c63ab0850d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87cd6611-0f8c-4aa5-b86d-653cf9fe7826', 'volume_name': 'volume-87cd6611-0f8c-4aa5-b86d-653cf9fe7826', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d42c7b2b-d7af-42d7-bc57-d2f3693e9ab8 tempest-VolumesTestJSON-1572473642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52497a4e-ea3a-42e4-94ec-156cbc9d66ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d42c7b2b-d7af-42d7-bc57-d2f3693e9ab8 tempest-VolumesTestJSON-1572473642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52497a4e-ea3a-42e4-94ec-156cbc9d66ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d42c7b2b-d7af-42d7-bc57-d2f3693e9ab8 tempest-VolumesTestJSON-1572473642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ad7e256-7734-4e37-8d92-28140955457c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:04 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-d42c7b2b-d7af-42d7-bc57-d2f3693e9ab8 tempest-VolumesTestJSON-1572473642 None] Volume 87cd6611-0f8c-4aa5-b86d-653cf9fe7826: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87cd6611-0f8c-4aa5-b86d-653cf9fe7826', 'volume_size': 1} Jul 07 08:19:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d42c7b2b-d7af-42d7-bc57-d2f3693e9ab8 tempest-VolumesTestJSON-1572473642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:04 devstack sudo[93873]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-943e9208-fd99-4ee5-9482-6e6e92835ae2 tempest-GroupSnapshotsTest-1158654987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-22043851-7841-4526-861e-74b4b3f55d55.dc993a7b-8974-4729-a7f8-ba8c01dd01a5" returned: 0 in 0.864s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:04 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-943e9208-fd99-4ee5-9482-6e6e92835ae2 tempest-GroupSnapshotsTest-1158654987 None] Lock "cinder-quobyte-dc993a7b-8974-4729-a7f8-ba8c01dd01a5" released by "_delete_snapshot" :: held 3.439s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:19:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-943e9208-fd99-4ee5-9482-6e6e92835ae2 tempest-GroupSnapshotsTest-1158654987 None] Lock "cinder-quobyte-22043851-7841-4526-861e-74b4b3f55d55" released by "delete_snapshot" :: held 3.472s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:19:05 devstack sudo[93874]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6e55b0a7-006b-4f25-bca4-25e2896f1b98 tempest-SnapshotsActionsTest-1989405612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.5a46560e-a586-41f1-ba26-8f14d5715955" returned: 0 in 0.935s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6e55b0a7-006b-4f25-bca4-25e2896f1b98 tempest-SnapshotsActionsTest-1989405612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.5a46560e-a586-41f1-ba26-8f14d5715955 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:05 devstack sudo[93884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.5a46560e-a586-41f1-ba26-8f14d5715955 Jul 07 08:19:05 devstack sudo[93884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:05 devstack cinder-volume[87199]: WARNING cinder.quota [None req-943e9208-fd99-4ee5-9482-6e6e92835ae2 tempest-GroupSnapshotsTest-1158654987 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-587418651 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-587418651, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:19:05 devstack cinder-volume[87199]: WARNING cinder.quota [None req-943e9208-fd99-4ee5-9482-6e6e92835ae2 tempest-GroupSnapshotsTest-1158654987 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-587418651 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-587418651, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:19:05 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-943e9208-fd99-4ee5-9482-6e6e92835ae2 tempest-GroupSnapshotsTest-1158654987 None] Created reservations ['898b88e1-3964-4252-be85-caa4f8e91ece', '9984cbf0-ba70-4bc8-a683-681f3905a1b4', 'bba384ef-d047-4571-b598-d318fc213d63', 'af6be418-eb5d-41fc-8d85-e8280fb9ae1c'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:19:05 devstack sudo[93877]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8b0863c0-5243-4e1c-8e8c-7b47a2936154 tempest-AttachVolumeTestJSON-1669838508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b564ca67-15fa-4a97-9420-6868e009d50f" returned: 0 in 0.839s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8b0863c0-5243-4e1c-8e8c-7b47a2936154 tempest-AttachVolumeTestJSON-1669838508 None] <== create_volume: return (1807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:19:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8b0863c0-5243-4e1c-8e8c-7b47a2936154 tempest-AttachVolumeTestJSON-1669838508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.812s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d42c7b2b-d7af-42d7-bc57-d2f3693e9ab8 tempest-VolumesTestJSON-1572473642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.425s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d42c7b2b-d7af-42d7-bc57-d2f3693e9ab8 tempest-VolumesTestJSON-1572473642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:19:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-697740489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87cd6611-0f8c-4aa5-b86d-653cf9fe7826,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a690506ebbd6415e8f4a32df3064d780',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:19:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:19:05Z,use_quota=True,user_id='9fb3cd3f56484630a298c7db30b337d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:19:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-d42c7b2b-d7af-42d7-bc57-d2f3693e9ab8 tempest-VolumesTestJSON-1572473642 None] Creating volume 87cd6611-0f8c-4aa5-b86d-653cf9fe7826 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:19:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d42c7b2b-d7af-42d7-bc57-d2f3693e9ab8 tempest-VolumesTestJSON-1572473642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d42c7b2b-d7af-42d7-bc57-d2f3693e9ab8 tempest-VolumesTestJSON-1572473642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d42c7b2b-d7af-42d7-bc57-d2f3693e9ab8 tempest-VolumesTestJSON-1572473642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:19:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d42c7b2b-d7af-42d7-bc57-d2f3693e9ab8 tempest-VolumesTestJSON-1572473642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:19:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d42c7b2b-d7af-42d7-bc57-d2f3693e9ab8 tempest-VolumesTestJSON-1572473642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d42c7b2b-d7af-42d7-bc57-d2f3693e9ab8 tempest-VolumesTestJSON-1572473642 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:19:05 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-d42c7b2b-d7af-42d7-bc57-d2f3693e9ab8 tempest-VolumesTestJSON-1572473642 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:19:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d42c7b2b-d7af-42d7-bc57-d2f3693e9ab8 tempest-VolumesTestJSON-1572473642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87cd6611-0f8c-4aa5-b86d-653cf9fe7826 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:05 devstack sudo[93887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87cd6611-0f8c-4aa5-b86d-653cf9fe7826 1073741824 Jul 07 08:19:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8b0863c0-5243-4e1c-8e8c-7b47a2936154 tempest-AttachVolumeTestJSON-1669838508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca62b482-f0b8-406b-b72a-2c9c02f539a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b564ca67-15fa-4a97-9420-6868e009d50f', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:05 devstack sudo[93887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8b0863c0-5243-4e1c-8e8c-7b47a2936154 tempest-AttachVolumeTestJSON-1669838508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (195cce20-bbf1-4e64-a1d4-bfdf15c74a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:05 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-8b0863c0-5243-4e1c-8e8c-7b47a2936154 tempest-AttachVolumeTestJSON-1669838508 None] Volume volume-b564ca67-15fa-4a97-9420-6868e009d50f (b564ca67-15fa-4a97-9420-6868e009d50f): created successfully Jul 07 08:19:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8b0863c0-5243-4e1c-8e8c-7b47a2936154 tempest-AttachVolumeTestJSON-1669838508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (195cce20-bbf1-4e64-a1d4-bfdf15c74a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8b0863c0-5243-4e1c-8e8c-7b47a2936154 tempest-AttachVolumeTestJSON-1669838508 None] Flow 'volume_create_manager' (01f8ef8a-c49c-456b-9c01-7ba5ff09904b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:19:05 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-943e9208-fd99-4ee5-9482-6e6e92835ae2 tempest-GroupSnapshotsTest-1158654987 None] Created reservations ['4aa897ff-bf37-4482-aafd-48dabc9686fa', '087bb60b-c0b7-4719-8ad5-254fa6c132a8', '1b8ae85b-14f9-48c4-bd8d-678a6c4b574a', 'd33a0179-f0e0-474d-8c4e-1018529b6aa7'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:19:05 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-8b0863c0-5243-4e1c-8e8c-7b47a2936154 tempest-AttachVolumeTestJSON-1669838508 None] Created volume successfully. Jul 07 08:19:05 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-943e9208-fd99-4ee5-9482-6e6e92835ae2 tempest-GroupSnapshotsTest-1158654987 None] group_snapshot f6e31a16-6ddb-4803-8e5f-25254c0be49d: deleted successfully Jul 07 08:19:05 devstack sudo[93884]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6e55b0a7-006b-4f25-bca4-25e2896f1b98 tempest-SnapshotsActionsTest-1989405612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.5a46560e-a586-41f1-ba26-8f14d5715955" returned: 0 in 0.680s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6e55b0a7-006b-4f25-bca4-25e2896f1b98 tempest-SnapshotsActionsTest-1989405612 None] Lock "cinder-quobyte-5a46560e-a586-41f1-ba26-8f14d5715955" released by "_delete_snapshot" :: held 3.420s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:19:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6e55b0a7-006b-4f25-bca4-25e2896f1b98 tempest-SnapshotsActionsTest-1989405612 None] Lock "cinder-quobyte-97ff669d-e3e6-44da-95b7-dad653e0cecc" released by "delete_snapshot" :: held 3.445s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:19:05 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:19:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:19:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:19:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:05 devstack sudo[93893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:19:05 devstack sudo[93893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:05 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-6e55b0a7-006b-4f25-bca4-25e2896f1b98 tempest-SnapshotsActionsTest-1989405612 None] Created reservations ['490ae7bb-12f8-40e0-8a5a-06045aa14e96', '618fda9e-b601-42ed-a96e-1357b9b723c1', '4b6df553-33d1-43d4-9181-0204df3c55b4', '9cfdc49e-5ebb-4e69-8357-98b211bd5e8b'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:19:05 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-6e55b0a7-006b-4f25-bca4-25e2896f1b98 tempest-SnapshotsActionsTest-1989405612 None] Delete snapshot completed successfully. Jul 07 08:19:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6e55b0a7-006b-4f25-bca4-25e2896f1b98 tempest-SnapshotsActionsTest-1989405612 None] Lock "cinder-5a46560e-a586-41f1-ba26-8f14d5715955-delete_snapshot" released by "delete_snapshot" :: held 3.629s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:19:06 devstack sudo[93887]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d42c7b2b-d7af-42d7-bc57-d2f3693e9ab8 tempest-VolumesTestJSON-1572473642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87cd6611-0f8c-4aa5-b86d-653cf9fe7826 1073741824" returned: 0 in 0.952s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d42c7b2b-d7af-42d7-bc57-d2f3693e9ab8 tempest-VolumesTestJSON-1572473642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87cd6611-0f8c-4aa5-b86d-653cf9fe7826 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:06 devstack sudo[93900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87cd6611-0f8c-4aa5-b86d-653cf9fe7826 Jul 07 08:19:06 devstack sudo[93900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:06 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f057d1e0-20aa-47d9-8335-e757f9afe6da tempest-GroupSnapshotsTest-1158654987 None] Acquiring lock "cinder-quobyte-22043851-7841-4526-861e-74b4b3f55d55" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:19:06 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f057d1e0-20aa-47d9-8335-e757f9afe6da tempest-GroupSnapshotsTest-1158654987 None] Lock "cinder-quobyte-22043851-7841-4526-861e-74b4b3f55d55" acquired by "delete_volume" :: waited 0.017s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:19:06 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c94662b-f2ab-40d2-bf24-54997ea45a2d]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:19:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f057d1e0-20aa-47d9-8335-e757f9afe6da tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-22043851-7841-4526-861e-74b4b3f55d55 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:06 devstack sudo[93902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-22043851-7841-4526-861e-74b4b3f55d55 Jul 07 08:19:06 devstack sudo[93902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:06 devstack sudo[93893]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.793s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:06 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:19:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running periodic task VolumeManager._thread_info {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:19:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] thread count: 8 {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 08:19:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] thread info: [<_MainThread(MainThread, started 133056092332160)>, , , , , , , ] {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 08:19:06 devstack sudo[93900]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d42c7b2b-d7af-42d7-bc57-d2f3693e9ab8 tempest-VolumesTestJSON-1572473642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87cd6611-0f8c-4aa5-b86d-653cf9fe7826" returned: 0 in 0.725s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d42c7b2b-d7af-42d7-bc57-d2f3693e9ab8 tempest-VolumesTestJSON-1572473642 None] <== create_volume: return (1730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:19:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d42c7b2b-d7af-42d7-bc57-d2f3693e9ab8 tempest-VolumesTestJSON-1572473642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.733s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d42c7b2b-d7af-42d7-bc57-d2f3693e9ab8 tempest-VolumesTestJSON-1572473642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ad7e256-7734-4e37-8d92-28140955457c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87cd6611-0f8c-4aa5-b86d-653cf9fe7826', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d42c7b2b-d7af-42d7-bc57-d2f3693e9ab8 tempest-VolumesTestJSON-1572473642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deab1a2b-44aa-4aea-a397-1bd6c3ca3665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:06 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7de6a60e-7e9a-4e39-8d63-74ed034f0c02 tempest-SnapshotsActionsTest-452788111 None] Acquiring lock "cinder-45a45194-0242-46c9-9b21-f0643a744cad-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:19:06 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-d42c7b2b-d7af-42d7-bc57-d2f3693e9ab8 tempest-VolumesTestJSON-1572473642 None] Volume volume-87cd6611-0f8c-4aa5-b86d-653cf9fe7826 (87cd6611-0f8c-4aa5-b86d-653cf9fe7826): created successfully Jul 07 08:19:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d42c7b2b-d7af-42d7-bc57-d2f3693e9ab8 tempest-VolumesTestJSON-1572473642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deab1a2b-44aa-4aea-a397-1bd6c3ca3665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d42c7b2b-d7af-42d7-bc57-d2f3693e9ab8 tempest-VolumesTestJSON-1572473642 None] Flow 'volume_create_manager' (b63c1c8f-c496-4923-82f1-9bc04b657244) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:19:07 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-d42c7b2b-d7af-42d7-bc57-d2f3693e9ab8 tempest-VolumesTestJSON-1572473642 None] Created volume successfully. Jul 07 08:19:07 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7de6a60e-7e9a-4e39-8d63-74ed034f0c02 tempest-SnapshotsActionsTest-452788111 None] Lock "cinder-45a45194-0242-46c9-9b21-f0643a744cad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:19:07 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7de6a60e-7e9a-4e39-8d63-74ed034f0c02 tempest-SnapshotsActionsTest-452788111 None] Acquiring lock "cinder-quobyte-97ff669d-e3e6-44da-95b7-dad653e0cecc" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:19:07 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7de6a60e-7e9a-4e39-8d63-74ed034f0c02 tempest-SnapshotsActionsTest-452788111 None] Lock "cinder-quobyte-97ff669d-e3e6-44da-95b7-dad653e0cecc" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:19:07 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7de6a60e-7e9a-4e39-8d63-74ed034f0c02 tempest-SnapshotsActionsTest-452788111 None] Acquiring lock "cinder-quobyte-45a45194-0242-46c9-9b21-f0643a744cad" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:19:07 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7de6a60e-7e9a-4e39-8d63-74ed034f0c02 tempest-SnapshotsActionsTest-452788111 None] Lock "cinder-quobyte-45a45194-0242-46c9-9b21-f0643a744cad" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:19:07 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-7de6a60e-7e9a-4e39-8d63-74ed034f0c02 tempest-SnapshotsActionsTest-452788111 None] Deleting offline snapshot 45a45194-0242-46c9-9b21-f0643a744cad of volume 97ff669d-e3e6-44da-95b7-dad653e0cecc {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:19:07 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-7de6a60e-7e9a-4e39-8d63-74ed034f0c02 tempest-SnapshotsActionsTest-452788111 None] snapshot_file for this snap is: volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:19:07 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf0a1f3-4a0e-433c-8755-2cc2564fda58]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:19:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7de6a60e-7e9a-4e39-8d63-74ed034f0c02 tempest-SnapshotsActionsTest-452788111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:07 devstack sudo[93906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad Jul 07 08:19:07 devstack sudo[93906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:07 devstack sudo[93902]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f057d1e0-20aa-47d9-8335-e757f9afe6da tempest-GroupSnapshotsTest-1158654987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-22043851-7841-4526-861e-74b4b3f55d55" returned: 0 in 0.939s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f057d1e0-20aa-47d9-8335-e757f9afe6da tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-22043851-7841-4526-861e-74b4b3f55d55 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:07 devstack sudo[93911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-22043851-7841-4526-861e-74b4b3f55d55 Jul 07 08:19:07 devstack sudo[93911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:07 devstack sudo[93906]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7de6a60e-7e9a-4e39-8d63-74ed034f0c02 tempest-SnapshotsActionsTest-452788111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad" returned: 0 in 0.797s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:07 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-7de6a60e-7e9a-4e39-8d63-74ed034f0c02 tempest-SnapshotsActionsTest-452788111 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97ff669d-e3e6-44da-95b7-dad653e0cecc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:19:07 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7434ebb-dfdf-4217-91b4-7aa83968cf5b]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:19:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7de6a60e-7e9a-4e39-8d63-74ed034f0c02 tempest-SnapshotsActionsTest-452788111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:08 devstack sudo[93911]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f057d1e0-20aa-47d9-8335-e757f9afe6da tempest-GroupSnapshotsTest-1158654987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-22043851-7841-4526-861e-74b4b3f55d55" returned: 0 in 0.699s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:08 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f057d1e0-20aa-47d9-8335-e757f9afe6da tempest-GroupSnapshotsTest-1158654987 None] Lock "cinder-quobyte-22043851-7841-4526-861e-74b4b3f55d55" released by "delete_volume" :: held 1.710s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:19:08 devstack sudo[93917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc Jul 07 08:19:08 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f057d1e0-20aa-47d9-8335-e757f9afe6da tempest-GroupSnapshotsTest-1158654987 None] Acquiring lock "cinder-quobyte-dede928f-876a-48aa-ac40-8cf59e385737" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:19:08 devstack sudo[93917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:08 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f057d1e0-20aa-47d9-8335-e757f9afe6da tempest-GroupSnapshotsTest-1158654987 None] Lock "cinder-quobyte-dede928f-876a-48aa-ac40-8cf59e385737" acquired by "delete_volume" :: waited 0.025s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:19:08 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29ca860-86cf-4758-b836-9a4d96ac3a59]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:19:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f057d1e0-20aa-47d9-8335-e757f9afe6da tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-dede928f-876a-48aa-ac40-8cf59e385737 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:08 devstack sudo[93919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-dede928f-876a-48aa-ac40-8cf59e385737 Jul 07 08:19:08 devstack sudo[93919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:08 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-98b10b23-4e4b-4cfd-987a-05a8e8c0ca88 tempest-VolumesTestJSON-1572473642 None] Acquiring lock "cinder-87cd6611-0f8c-4aa5-b86d-653cf9fe7826-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:19:08 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-98b10b23-4e4b-4cfd-987a-05a8e8c0ca88 tempest-VolumesTestJSON-1572473642 None] Lock "cinder-87cd6611-0f8c-4aa5-b86d-653cf9fe7826-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:19:08 devstack sudo[93917]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7de6a60e-7e9a-4e39-8d63-74ed034f0c02 tempest-SnapshotsActionsTest-452788111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc" returned: 0 in 0.955s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7de6a60e-7e9a-4e39-8d63-74ed034f0c02 tempest-SnapshotsActionsTest-452788111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:08 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=105,cinder:UPDATE=96,cinder:INSERT=20,cinder:DELETE=5 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:19:08 devstack sudo[93926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad Jul 07 08:19:08 devstack sudo[93926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:08 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=110,cinder:INSERT=31,cinder:UPDATE=110,cinder:DELETE=7 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:19:08 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-98b10b23-4e4b-4cfd-987a-05a8e8c0ca88 tempest-VolumesTestJSON-1572473642 None] Acquiring lock "cinder-quobyte-87cd6611-0f8c-4aa5-b86d-653cf9fe7826" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:19:08 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-98b10b23-4e4b-4cfd-987a-05a8e8c0ca88 tempest-VolumesTestJSON-1572473642 None] Lock "cinder-quobyte-87cd6611-0f8c-4aa5-b86d-653cf9fe7826" acquired by "delete_volume" :: waited 0.022s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:19:08 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f84118f-e32b-4402-9951-0d9726d3b609]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:19:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-98b10b23-4e4b-4cfd-987a-05a8e8c0ca88 tempest-VolumesTestJSON-1572473642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87cd6611-0f8c-4aa5-b86d-653cf9fe7826 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:09 devstack sudo[93919]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f057d1e0-20aa-47d9-8335-e757f9afe6da tempest-GroupSnapshotsTest-1158654987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-dede928f-876a-48aa-ac40-8cf59e385737" returned: 0 in 0.908s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f057d1e0-20aa-47d9-8335-e757f9afe6da tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-dede928f-876a-48aa-ac40-8cf59e385737 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:09 devstack sudo[93931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-dede928f-876a-48aa-ac40-8cf59e385737 Jul 07 08:19:09 devstack sudo[93931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:09 devstack sudo[93930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87cd6611-0f8c-4aa5-b86d-653cf9fe7826 Jul 07 08:19:09 devstack sudo[93930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-b6266114-aabe-43de-92f7-852d36e0c71d req-abe0dbe1-d736-4739-94c3-eabeda504a74 tempest-AttachVolumeTestJSON-1669838508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-b6266114-aabe-43de-92f7-852d36e0c71d req-abe0dbe1-d736-4739-94c3-eabeda504a74 tempest-AttachVolumeTestJSON-1669838508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:09 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[cafd2f77-8d11-4baf-a1b7-54a7ffa38332]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:19:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-b6266114-aabe-43de-92f7-852d36e0c71d req-abe0dbe1-d736-4739-94c3-eabeda504a74 tempest-AttachVolumeTestJSON-1669838508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b564ca67-15fa-4a97-9420-6868e009d50f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:09 devstack sudo[93942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b564ca67-15fa-4a97-9420-6868e009d50f Jul 07 08:19:09 devstack sudo[93942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:09 devstack sudo[93931]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f057d1e0-20aa-47d9-8335-e757f9afe6da tempest-GroupSnapshotsTest-1158654987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-dede928f-876a-48aa-ac40-8cf59e385737" returned: 0 in 0.711s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:09 devstack sudo[93926]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7de6a60e-7e9a-4e39-8d63-74ed034f0c02 tempest-SnapshotsActionsTest-452788111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad" returned: 0 in 0.900s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7de6a60e-7e9a-4e39-8d63-74ed034f0c02 tempest-SnapshotsActionsTest-452788111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:09 devstack sudo[93930]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:09 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f057d1e0-20aa-47d9-8335-e757f9afe6da tempest-GroupSnapshotsTest-1158654987 None] Lock "cinder-quobyte-dede928f-876a-48aa-ac40-8cf59e385737" released by "delete_volume" :: held 1.717s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:19:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-98b10b23-4e4b-4cfd-987a-05a8e8c0ca88 tempest-VolumesTestJSON-1572473642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87cd6611-0f8c-4aa5-b86d-653cf9fe7826" returned: 0 in 0.833s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-98b10b23-4e4b-4cfd-987a-05a8e8c0ca88 tempest-VolumesTestJSON-1572473642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87cd6611-0f8c-4aa5-b86d-653cf9fe7826 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:09 devstack sudo[93951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad Jul 07 08:19:09 devstack sudo[93951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:09 devstack sudo[93952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87cd6611-0f8c-4aa5-b86d-653cf9fe7826 Jul 07 08:19:09 devstack sudo[93952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:09 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-f057d1e0-20aa-47d9-8335-e757f9afe6da tempest-GroupSnapshotsTest-1158654987 None] Created reservations ['11a65c02-7347-4759-a46b-668f1d5e19cc'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:19:09 devstack cinder-volume[87199]: WARNING cinder.quota [None req-f057d1e0-20aa-47d9-8335-e757f9afe6da tempest-GroupSnapshotsTest-1158654987 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-587418651 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-587418651, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:19:10 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-f057d1e0-20aa-47d9-8335-e757f9afe6da tempest-GroupSnapshotsTest-1158654987 None] Created reservations ['20cbb49a-9e32-48a0-b907-eebcc8daba85', '6657cf7a-a9f3-4e2b-9c81-851270c1df0e', '818211bf-daca-4ee0-9c62-f87421697846', '03889029-9348-4590-9f1b-b75bb2ed7865'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:19:10 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-f057d1e0-20aa-47d9-8335-e757f9afe6da tempest-GroupSnapshotsTest-1158654987 None] Created reservations ['9991b7c7-8953-47c4-b5eb-43e395665d54', 'ab0c8d48-eb28-416f-9981-ff94e7a0a418', '8e66332d-e862-4f3a-80d9-6e5f9ee05b6f', '0d27e68a-f577-46ed-b1be-acac2fd42288'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:19:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f057d1e0-20aa-47d9-8335-e757f9afe6da tempest-GroupSnapshotsTest-1158654987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f057d1e0-20aa-47d9-8335-e757f9afe6da tempest-GroupSnapshotsTest-1158654987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:10 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f057d1e0-20aa-47d9-8335-e757f9afe6da tempest-GroupSnapshotsTest-1158654987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:19:10 devstack sudo[93942]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:10 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f057d1e0-20aa-47d9-8335-e757f9afe6da tempest-GroupSnapshotsTest-1158654987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:19:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f057d1e0-20aa-47d9-8335-e757f9afe6da tempest-GroupSnapshotsTest-1158654987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f057d1e0-20aa-47d9-8335-e757f9afe6da tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-b6266114-aabe-43de-92f7-852d36e0c71d req-abe0dbe1-d736-4739-94c3-eabeda504a74 tempest-AttachVolumeTestJSON-1669838508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b564ca67-15fa-4a97-9420-6868e009d50f" returned: 0 in 0.954s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-b6266114-aabe-43de-92f7-852d36e0c71d req-abe0dbe1-d736-4739-94c3-eabeda504a74 tempest-AttachVolumeTestJSON-1669838508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.974s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:10 devstack sudo[93958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:19:10 devstack sudo[93958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:10 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-b6266114-aabe-43de-92f7-852d36e0c71d req-abe0dbe1-d736-4739-94c3-eabeda504a74 tempest-AttachVolumeTestJSON-1669838508 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b', 'name': 'volume-b564ca67-15fa-4a97-9420-6868e009d50f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e711894a-395f-4620-a1d6-1abe0c23f176', 'enforce_multipath': True} {{(pid=87199) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 08:19:10 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-b6266114-aabe-43de-92f7-852d36e0c71d req-abe0dbe1-d736-4739-94c3-eabeda504a74 tempest-AttachVolumeTestJSON-1669838508 None] attachment_update completed successfully. Jul 07 08:19:10 devstack sudo[93951]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7de6a60e-7e9a-4e39-8d63-74ed034f0c02 tempest-SnapshotsActionsTest-452788111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc.45a45194-0242-46c9-9b21-f0643a744cad" returned: 0 in 0.784s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:10 devstack sudo[93952]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-98b10b23-4e4b-4cfd-987a-05a8e8c0ca88 tempest-VolumesTestJSON-1572473642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87cd6611-0f8c-4aa5-b86d-653cf9fe7826" returned: 0 in 0.794s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:10 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7de6a60e-7e9a-4e39-8d63-74ed034f0c02 tempest-SnapshotsActionsTest-452788111 None] Lock "cinder-quobyte-45a45194-0242-46c9-9b21-f0643a744cad" released by "_delete_snapshot" :: held 3.553s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:19:10 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-98b10b23-4e4b-4cfd-987a-05a8e8c0ca88 tempest-VolumesTestJSON-1572473642 None] Lock "cinder-quobyte-87cd6611-0f8c-4aa5-b86d-653cf9fe7826" released by "delete_volume" :: held 1.672s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:19:10 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7de6a60e-7e9a-4e39-8d63-74ed034f0c02 tempest-SnapshotsActionsTest-452788111 None] Lock "cinder-quobyte-97ff669d-e3e6-44da-95b7-dad653e0cecc" released by "delete_snapshot" :: held 3.579s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:19:10 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-98b10b23-4e4b-4cfd-987a-05a8e8c0ca88 tempest-VolumesTestJSON-1572473642 None] Created reservations ['ea14b61d-8bbd-4eab-bbd0-811dc93aa9ab', 'dbe9ca41-ef87-46df-a29a-78720f2c71a1', '2275ca49-1abe-4fee-8128-3320a99cfea5', '77b8f38c-53c5-4434-b080-8893b379a319'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:19:10 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-7de6a60e-7e9a-4e39-8d63-74ed034f0c02 tempest-SnapshotsActionsTest-452788111 None] Created reservations ['46b9b659-01ad-4bf2-95bc-838c8f86b6ee', 'ba92fef9-fd8b-4ffd-9f97-f09eb29bde68', 'bec2b554-a913-46d6-91ea-5cd40505d2d4', '4557c344-28cf-4f41-8940-c02533104cd4'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:19:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-98b10b23-4e4b-4cfd-987a-05a8e8c0ca88 tempest-VolumesTestJSON-1572473642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-98b10b23-4e4b-4cfd-987a-05a8e8c0ca88 tempest-VolumesTestJSON-1572473642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:10 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-98b10b23-4e4b-4cfd-987a-05a8e8c0ca88 tempest-VolumesTestJSON-1572473642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:19:10 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-98b10b23-4e4b-4cfd-987a-05a8e8c0ca88 tempest-VolumesTestJSON-1572473642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:19:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-98b10b23-4e4b-4cfd-987a-05a8e8c0ca88 tempest-VolumesTestJSON-1572473642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-98b10b23-4e4b-4cfd-987a-05a8e8c0ca88 tempest-VolumesTestJSON-1572473642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:10 devstack sudo[93963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:19:10 devstack sudo[93963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:10 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-7de6a60e-7e9a-4e39-8d63-74ed034f0c02 tempest-SnapshotsActionsTest-452788111 None] Delete snapshot completed successfully. Jul 07 08:19:10 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7de6a60e-7e9a-4e39-8d63-74ed034f0c02 tempest-SnapshotsActionsTest-452788111 None] Lock "cinder-45a45194-0242-46c9-9b21-f0643a744cad-delete_snapshot" released by "delete_snapshot" :: held 3.799s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:19:11 devstack sudo[93958]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f057d1e0-20aa-47d9-8335-e757f9afe6da tempest-GroupSnapshotsTest-1158654987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.733s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:11 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-f057d1e0-20aa-47d9-8335-e757f9afe6da tempest-GroupSnapshotsTest-1158654987 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:19:11 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-f057d1e0-20aa-47d9-8335-e757f9afe6da tempest-GroupSnapshotsTest-1158654987 None] Delete group completed successfully. Jul 07 08:19:11 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7edd73f3-3285-4cc6-bd05-249b481b0dc1 tempest-VolumesTestJSON-1572473642 None] Acquiring lock "cinder-30540856-6b5e-4e2e-bedc-d18246bbd3fc-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:19:11 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7edd73f3-3285-4cc6-bd05-249b481b0dc1 tempest-VolumesTestJSON-1572473642 None] Lock "cinder-30540856-6b5e-4e2e-bedc-d18246bbd3fc-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:19:11 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7edd73f3-3285-4cc6-bd05-249b481b0dc1 tempest-VolumesTestJSON-1572473642 None] Acquiring lock "cinder-quobyte-30540856-6b5e-4e2e-bedc-d18246bbd3fc" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:19:11 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7edd73f3-3285-4cc6-bd05-249b481b0dc1 tempest-VolumesTestJSON-1572473642 None] Lock "cinder-quobyte-30540856-6b5e-4e2e-bedc-d18246bbd3fc" acquired by "delete_volume" :: waited 0.027s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:19:11 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1abf756-6af0-4eaf-9776-30b349a62749]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:19:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7edd73f3-3285-4cc6-bd05-249b481b0dc1 tempest-VolumesTestJSON-1572473642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-30540856-6b5e-4e2e-bedc-d18246bbd3fc {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:11 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6a2c1325-75cd-456c-8f56-38f2a4c9a92f tempest-SnapshotsActionsTest-452788111 None] Acquiring lock "cinder-97ff669d-e3e6-44da-95b7-dad653e0cecc-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:19:11 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6a2c1325-75cd-456c-8f56-38f2a4c9a92f tempest-SnapshotsActionsTest-452788111 None] Lock "cinder-97ff669d-e3e6-44da-95b7-dad653e0cecc-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:19:11 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6a2c1325-75cd-456c-8f56-38f2a4c9a92f tempest-SnapshotsActionsTest-452788111 None] Acquiring lock "cinder-quobyte-97ff669d-e3e6-44da-95b7-dad653e0cecc" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:19:11 devstack sudo[94034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-30540856-6b5e-4e2e-bedc-d18246bbd3fc Jul 07 08:19:11 devstack sudo[94034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:11 devstack sudo[93963]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:11 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6a2c1325-75cd-456c-8f56-38f2a4c9a92f tempest-SnapshotsActionsTest-452788111 None] Lock "cinder-quobyte-97ff669d-e3e6-44da-95b7-dad653e0cecc" acquired by "delete_volume" :: waited 0.016s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:19:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-98b10b23-4e4b-4cfd-987a-05a8e8c0ca88 tempest-VolumesTestJSON-1572473642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.850s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:11 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-98b10b23-4e4b-4cfd-987a-05a8e8c0ca88 tempest-VolumesTestJSON-1572473642 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:19:11 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-98b10b23-4e4b-4cfd-987a-05a8e8c0ca88 tempest-VolumesTestJSON-1572473642 None] Deleted volume successfully. Jul 07 08:19:11 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[341ca9cf-a284-4714-a339-e80b2c562991]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:19:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6a2c1325-75cd-456c-8f56-38f2a4c9a92f tempest-SnapshotsActionsTest-452788111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:11 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-98b10b23-4e4b-4cfd-987a-05a8e8c0ca88 tempest-VolumesTestJSON-1572473642 None] Lock "cinder-87cd6611-0f8c-4aa5-b86d-653cf9fe7826-delete_volume" released by "delete_volume" :: held 2.798s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:19:11 devstack sudo[94037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc Jul 07 08:19:11 devstack sudo[94037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:11 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-27c05fc8-20a8-43a7-998f-a15ca7cca62e tempest-GroupSnapshotsTest-1158654987 None] Group tempest-GroupSnapshotsTest-Group-696700284: creating Jul 07 08:19:11 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-27c05fc8-20a8-43a7-998f-a15ca7cca62e tempest-GroupSnapshotsTest-1158654987 None] Group tempest-GroupSnapshotsTest-Group-696700284: created successfully Jul 07 08:19:11 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-27c05fc8-20a8-43a7-998f-a15ca7cca62e tempest-GroupSnapshotsTest-1158654987 None] Create group completed successfully. Jul 07 08:19:12 devstack sudo[94034]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7edd73f3-3285-4cc6-bd05-249b481b0dc1 tempest-VolumesTestJSON-1572473642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-30540856-6b5e-4e2e-bedc-d18246bbd3fc" returned: 0 in 0.934s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7edd73f3-3285-4cc6-bd05-249b481b0dc1 tempest-VolumesTestJSON-1572473642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-30540856-6b5e-4e2e-bedc-d18246bbd3fc {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:12 devstack sudo[94356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-30540856-6b5e-4e2e-bedc-d18246bbd3fc Jul 07 08:19:12 devstack sudo[94356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:12 devstack sudo[94037]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6a2c1325-75cd-456c-8f56-38f2a4c9a92f tempest-SnapshotsActionsTest-452788111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc" returned: 0 in 0.938s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6a2c1325-75cd-456c-8f56-38f2a4c9a92f tempest-SnapshotsActionsTest-452788111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:12 devstack sudo[94361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc Jul 07 08:19:12 devstack sudo[94361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:12 devstack sudo[94356]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7edd73f3-3285-4cc6-bd05-249b481b0dc1 tempest-VolumesTestJSON-1572473642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-30540856-6b5e-4e2e-bedc-d18246bbd3fc" returned: 0 in 0.630s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:13 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7edd73f3-3285-4cc6-bd05-249b481b0dc1 tempest-VolumesTestJSON-1572473642 None] Lock "cinder-quobyte-30540856-6b5e-4e2e-bedc-d18246bbd3fc" released by "delete_volume" :: held 1.641s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:19:13 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-7edd73f3-3285-4cc6-bd05-249b481b0dc1 tempest-VolumesTestJSON-1572473642 None] Created reservations ['bbd2c0e4-391b-4d96-ac7f-85e9cfa99bd5', '03a9b8df-5521-4601-94c1-d72c47de67b6', 'a7d2538e-bc96-48bb-9ecf-cbd0eec3fd0d', '686ab2d2-9780-4486-9f63-0e6d638df4ba'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:19:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7edd73f3-3285-4cc6-bd05-249b481b0dc1 tempest-VolumesTestJSON-1572473642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7edd73f3-3285-4cc6-bd05-249b481b0dc1 tempest-VolumesTestJSON-1572473642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-7edd73f3-3285-4cc6-bd05-249b481b0dc1 tempest-VolumesTestJSON-1572473642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:19:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-7edd73f3-3285-4cc6-bd05-249b481b0dc1 tempest-VolumesTestJSON-1572473642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:19:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7edd73f3-3285-4cc6-bd05-249b481b0dc1 tempest-VolumesTestJSON-1572473642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7edd73f3-3285-4cc6-bd05-249b481b0dc1 tempest-VolumesTestJSON-1572473642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:13 devstack sudo[94364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:19:13 devstack sudo[94364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:13 devstack sudo[94361]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6a2c1325-75cd-456c-8f56-38f2a4c9a92f tempest-SnapshotsActionsTest-452788111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-97ff669d-e3e6-44da-95b7-dad653e0cecc" returned: 0 in 0.688s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:13 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6a2c1325-75cd-456c-8f56-38f2a4c9a92f tempest-SnapshotsActionsTest-452788111 None] Lock "cinder-quobyte-97ff669d-e3e6-44da-95b7-dad653e0cecc" released by "delete_volume" :: held 1.717s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:19:13 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-6a2c1325-75cd-456c-8f56-38f2a4c9a92f tempest-SnapshotsActionsTest-452788111 None] Created reservations ['5e765c5f-51a3-4c00-8652-eb97a1d1850f', '1819da4a-a616-4422-b41d-afabe9a54a9b', '5d856b98-e7e4-40e7-bf97-7a1b018fdc25', '2bced9a9-efaa-4c9a-822f-2c7e229097d8'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:19:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6a2c1325-75cd-456c-8f56-38f2a4c9a92f tempest-SnapshotsActionsTest-452788111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6a2c1325-75cd-456c-8f56-38f2a4c9a92f tempest-SnapshotsActionsTest-452788111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6a2c1325-75cd-456c-8f56-38f2a4c9a92f tempest-SnapshotsActionsTest-452788111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:19:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6a2c1325-75cd-456c-8f56-38f2a4c9a92f tempest-SnapshotsActionsTest-452788111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:19:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6a2c1325-75cd-456c-8f56-38f2a4c9a92f tempest-SnapshotsActionsTest-452788111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6a2c1325-75cd-456c-8f56-38f2a4c9a92f tempest-SnapshotsActionsTest-452788111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:13 devstack sudo[94367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:19:13 devstack sudo[94367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:13 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-29a5078c-42df-491d-94d3-a945ae50a971 tempest-GroupSnapshotsTest-1158654987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:19:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-29a5078c-42df-491d-94d3-a945ae50a971 tempest-GroupSnapshotsTest-1158654987 None] Flow 'volume_create_manager' (7b25b3f9-c603-4c31-be2a-18f220994090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:19:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-29a5078c-42df-491d-94d3-a945ae50a971 tempest-GroupSnapshotsTest-1158654987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1603792-d395-4be8-b660-55c378cdc56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-29a5078c-42df-491d-94d3-a945ae50a971 tempest-GroupSnapshotsTest-1158654987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1603792-d395-4be8-b660-55c378cdc56c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:19:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-375700613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=41b7423d-2fe8-49a9-9350-026a8d3dcccf,host='devstack@QuobyteHD#QuobyteHD',id=16663d93-4553-44d4-b7b5-690c4fce43bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='417afe6a9344432aa5cf82d0c0628928',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:19:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:19:13Z,use_quota=True,user_id='2b4f760dc5264853ae3787b174694b5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44c8640b-3f10-463f-a020-fe30f6a1d2d1),volume_type_id=44c8640b-3f10-463f-a020-fe30f6a1d2d1)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-29a5078c-42df-491d-94d3-a945ae50a971 tempest-GroupSnapshotsTest-1158654987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fad747c6-8c0b-4fdf-82b7-60777b23ac5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-29a5078c-42df-491d-94d3-a945ae50a971 tempest-GroupSnapshotsTest-1158654987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fad747c6-8c0b-4fdf-82b7-60777b23ac5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-29a5078c-42df-491d-94d3-a945ae50a971 tempest-GroupSnapshotsTest-1158654987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31c18a6a-cece-4643-a65b-a43729654225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-29a5078c-42df-491d-94d3-a945ae50a971 tempest-GroupSnapshotsTest-1158654987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31c18a6a-cece-4643-a65b-a43729654225) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16663d93-4553-44d4-b7b5-690c4fce43bd', 'volume_name': 'volume-16663d93-4553-44d4-b7b5-690c4fce43bd', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-29a5078c-42df-491d-94d3-a945ae50a971 tempest-GroupSnapshotsTest-1158654987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfb2ecf9-2c63-4970-84d5-e6a2a73017ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-29a5078c-42df-491d-94d3-a945ae50a971 tempest-GroupSnapshotsTest-1158654987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfb2ecf9-2c63-4970-84d5-e6a2a73017ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-29a5078c-42df-491d-94d3-a945ae50a971 tempest-GroupSnapshotsTest-1158654987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73192627-cef9-4e2e-8cc0-83087fa19d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:13 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-29a5078c-42df-491d-94d3-a945ae50a971 tempest-GroupSnapshotsTest-1158654987 None] Volume 16663d93-4553-44d4-b7b5-690c4fce43bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16663d93-4553-44d4-b7b5-690c4fce43bd', 'volume_size': 1} Jul 07 08:19:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-29a5078c-42df-491d-94d3-a945ae50a971 tempest-GroupSnapshotsTest-1158654987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-29a5078c-42df-491d-94d3-a945ae50a971 tempest-GroupSnapshotsTest-1158654987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-29a5078c-42df-491d-94d3-a945ae50a971 tempest-GroupSnapshotsTest-1158654987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=41b7423d-2fe8-49a9-9350-026a8d3dcccf,created_at=2026-07-07T06:19:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-375700613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=41b7423d-2fe8-49a9-9350-026a8d3dcccf,host='devstack@QuobyteHD#QuobyteHD',id=16663d93-4553-44d4-b7b5-690c4fce43bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='417afe6a9344432aa5cf82d0c0628928',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:19:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:19:13Z,use_quota=True,user_id='2b4f760dc5264853ae3787b174694b5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44c8640b-3f10-463f-a020-fe30f6a1d2d1),volume_type_id=44c8640b-3f10-463f-a020-fe30f6a1d2d1)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:19:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-29a5078c-42df-491d-94d3-a945ae50a971 tempest-GroupSnapshotsTest-1158654987 None] Creating volume 16663d93-4553-44d4-b7b5-690c4fce43bd {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:19:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-29a5078c-42df-491d-94d3-a945ae50a971 tempest-GroupSnapshotsTest-1158654987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-29a5078c-42df-491d-94d3-a945ae50a971 tempest-GroupSnapshotsTest-1158654987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-29a5078c-42df-491d-94d3-a945ae50a971 tempest-GroupSnapshotsTest-1158654987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:19:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-29a5078c-42df-491d-94d3-a945ae50a971 tempest-GroupSnapshotsTest-1158654987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:19:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-29a5078c-42df-491d-94d3-a945ae50a971 tempest-GroupSnapshotsTest-1158654987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-29a5078c-42df-491d-94d3-a945ae50a971 tempest-GroupSnapshotsTest-1158654987 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:19:13 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-29a5078c-42df-491d-94d3-a945ae50a971 tempest-GroupSnapshotsTest-1158654987 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:19:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-29a5078c-42df-491d-94d3-a945ae50a971 tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-16663d93-4553-44d4-b7b5-690c4fce43bd 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:13 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5c70e596-b68e-4b17-a5ad-591f3e1f5b17 tempest-VolumesTestJSON-1572473642 None] Acquiring lock "cinder-68a4993a-0a7b-4bbe-8488-89b995338ad2-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:19:13 devstack sudo[94369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-16663d93-4553-44d4-b7b5-690c4fce43bd 1073741824 Jul 07 08:19:13 devstack sudo[94369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:13 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5c70e596-b68e-4b17-a5ad-591f3e1f5b17 tempest-VolumesTestJSON-1572473642 None] Lock "cinder-68a4993a-0a7b-4bbe-8488-89b995338ad2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:19:13 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5c70e596-b68e-4b17-a5ad-591f3e1f5b17 tempest-VolumesTestJSON-1572473642 None] Acquiring lock "cinder-quobyte-68a4993a-0a7b-4bbe-8488-89b995338ad2" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:19:13 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5c70e596-b68e-4b17-a5ad-591f3e1f5b17 tempest-VolumesTestJSON-1572473642 None] Lock "cinder-quobyte-68a4993a-0a7b-4bbe-8488-89b995338ad2" acquired by "delete_volume" :: waited 0.035s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:19:13 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f53a54-a3f9-4d42-8d80-71d157ec6ec7]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:19:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5c70e596-b68e-4b17-a5ad-591f3e1f5b17 tempest-VolumesTestJSON-1572473642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-68a4993a-0a7b-4bbe-8488-89b995338ad2 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:14 devstack sudo[94371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-68a4993a-0a7b-4bbe-8488-89b995338ad2 Jul 07 08:19:14 devstack sudo[94371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:14 devstack sudo[94364]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7edd73f3-3285-4cc6-bd05-249b481b0dc1 tempest-VolumesTestJSON-1572473642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.994s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:14 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-7edd73f3-3285-4cc6-bd05-249b481b0dc1 tempest-VolumesTestJSON-1572473642 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:19:14 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-7edd73f3-3285-4cc6-bd05-249b481b0dc1 tempest-VolumesTestJSON-1572473642 None] Deleted volume successfully. Jul 07 08:19:14 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7edd73f3-3285-4cc6-bd05-249b481b0dc1 tempest-VolumesTestJSON-1572473642 None] Lock "cinder-30540856-6b5e-4e2e-bedc-d18246bbd3fc-delete_volume" released by "delete_volume" :: held 2.896s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:19:14 devstack sudo[94367]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6a2c1325-75cd-456c-8f56-38f2a4c9a92f tempest-SnapshotsActionsTest-452788111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.915s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:14 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-6a2c1325-75cd-456c-8f56-38f2a4c9a92f tempest-SnapshotsActionsTest-452788111 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:19:14 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-6a2c1325-75cd-456c-8f56-38f2a4c9a92f tempest-SnapshotsActionsTest-452788111 None] Deleted volume successfully. Jul 07 08:19:14 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6a2c1325-75cd-456c-8f56-38f2a4c9a92f tempest-SnapshotsActionsTest-452788111 None] Lock "cinder-97ff669d-e3e6-44da-95b7-dad653e0cecc-delete_volume" released by "delete_volume" :: held 2.853s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:19:14 devstack sudo[94371]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5c70e596-b68e-4b17-a5ad-591f3e1f5b17 tempest-VolumesTestJSON-1572473642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-68a4993a-0a7b-4bbe-8488-89b995338ad2" returned: 0 in 1.046s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5c70e596-b68e-4b17-a5ad-591f3e1f5b17 tempest-VolumesTestJSON-1572473642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-68a4993a-0a7b-4bbe-8488-89b995338ad2 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:14 devstack sudo[94369]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-29a5078c-42df-491d-94d3-a945ae50a971 tempest-GroupSnapshotsTest-1158654987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-16663d93-4553-44d4-b7b5-690c4fce43bd 1073741824" returned: 0 in 1.268s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:14 devstack sudo[94382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-68a4993a-0a7b-4bbe-8488-89b995338ad2 Jul 07 08:19:14 devstack sudo[94382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-29a5078c-42df-491d-94d3-a945ae50a971 tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-16663d93-4553-44d4-b7b5-690c4fce43bd {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:14 devstack sudo[94384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-16663d93-4553-44d4-b7b5-690c4fce43bd Jul 07 08:19:14 devstack sudo[94384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:15 devstack sudo[94384]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-29a5078c-42df-491d-94d3-a945ae50a971 tempest-GroupSnapshotsTest-1158654987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-16663d93-4553-44d4-b7b5-690c4fce43bd" returned: 0 in 0.677s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-29a5078c-42df-491d-94d3-a945ae50a971 tempest-GroupSnapshotsTest-1158654987 None] <== create_volume: return (2003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:19:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-29a5078c-42df-491d-94d3-a945ae50a971 tempest-GroupSnapshotsTest-1158654987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.013s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-29a5078c-42df-491d-94d3-a945ae50a971 tempest-GroupSnapshotsTest-1158654987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73192627-cef9-4e2e-8cc0-83087fa19d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16663d93-4553-44d4-b7b5-690c4fce43bd', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-29a5078c-42df-491d-94d3-a945ae50a971 tempest-GroupSnapshotsTest-1158654987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62514c6f-6ef5-4cb2-9909-cba30f641698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:15 devstack sudo[94382]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5c70e596-b68e-4b17-a5ad-591f3e1f5b17 tempest-VolumesTestJSON-1572473642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-68a4993a-0a7b-4bbe-8488-89b995338ad2" returned: 0 in 0.780s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:15 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-29a5078c-42df-491d-94d3-a945ae50a971 tempest-GroupSnapshotsTest-1158654987 None] Volume volume-16663d93-4553-44d4-b7b5-690c4fce43bd (16663d93-4553-44d4-b7b5-690c4fce43bd): created successfully Jul 07 08:19:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-29a5078c-42df-491d-94d3-a945ae50a971 tempest-GroupSnapshotsTest-1158654987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62514c6f-6ef5-4cb2-9909-cba30f641698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-29a5078c-42df-491d-94d3-a945ae50a971 tempest-GroupSnapshotsTest-1158654987 None] Flow 'volume_create_manager' (7b25b3f9-c603-4c31-be2a-18f220994090) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:19:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5c70e596-b68e-4b17-a5ad-591f3e1f5b17 tempest-VolumesTestJSON-1572473642 None] Lock "cinder-quobyte-68a4993a-0a7b-4bbe-8488-89b995338ad2" released by "delete_volume" :: held 1.930s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:19:15 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-29a5078c-42df-491d-94d3-a945ae50a971 tempest-GroupSnapshotsTest-1158654987 None] Created volume successfully. Jul 07 08:19:15 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-5c70e596-b68e-4b17-a5ad-591f3e1f5b17 tempest-VolumesTestJSON-1572473642 None] Created reservations ['3acfb09b-33ad-4ada-905f-cb899efd5004', 'cefd9255-1182-46ba-a716-a24a72552a83', 'd63f8625-724f-4ede-8624-33e6f52aad8d', '6770f79f-11c5-44f6-ac94-912f17e0492f'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:19:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-5c70e596-b68e-4b17-a5ad-591f3e1f5b17 tempest-VolumesTestJSON-1572473642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-5c70e596-b68e-4b17-a5ad-591f3e1f5b17 tempest-VolumesTestJSON-1572473642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-5c70e596-b68e-4b17-a5ad-591f3e1f5b17 tempest-VolumesTestJSON-1572473642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:19:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-5c70e596-b68e-4b17-a5ad-591f3e1f5b17 tempest-VolumesTestJSON-1572473642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:19:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-5c70e596-b68e-4b17-a5ad-591f3e1f5b17 tempest-VolumesTestJSON-1572473642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5c70e596-b68e-4b17-a5ad-591f3e1f5b17 tempest-VolumesTestJSON-1572473642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:15 devstack sudo[94388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:19:15 devstack sudo[94388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:16 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-01a0b6b4-8c16-4ccb-b966-7ee42b8da37a tempest-AttachVolumeTestJSON-1669838508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:19:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-01a0b6b4-8c16-4ccb-b966-7ee42b8da37a tempest-AttachVolumeTestJSON-1669838508 None] Flow 'volume_create_manager' (6abafdcd-ef52-45c3-bc5a-8433bef12155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:19:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-01a0b6b4-8c16-4ccb-b966-7ee42b8da37a tempest-AttachVolumeTestJSON-1669838508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (851f194e-fb89-4a25-a850-624d05431272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-01a0b6b4-8c16-4ccb-b966-7ee42b8da37a tempest-AttachVolumeTestJSON-1669838508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (851f194e-fb89-4a25-a850-624d05431272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-153892614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12708c7c-5787-4277-86f7-15f72b265be1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dece2e57fb847e191255e8956dcc583',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:19:16Z,use_quota=True,user_id='d580e0190dfb4020999f268cfcb2a74c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-01a0b6b4-8c16-4ccb-b966-7ee42b8da37a tempest-AttachVolumeTestJSON-1669838508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4270c66-f329-4fb5-b0d8-574ffd907ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-01a0b6b4-8c16-4ccb-b966-7ee42b8da37a tempest-AttachVolumeTestJSON-1669838508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4270c66-f329-4fb5-b0d8-574ffd907ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-01a0b6b4-8c16-4ccb-b966-7ee42b8da37a tempest-AttachVolumeTestJSON-1669838508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38b389ab-c755-4a6d-9958-a2e76938f690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-01a0b6b4-8c16-4ccb-b966-7ee42b8da37a tempest-AttachVolumeTestJSON-1669838508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38b389ab-c755-4a6d-9958-a2e76938f690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12708c7c-5787-4277-86f7-15f72b265be1', 'volume_name': 'volume-12708c7c-5787-4277-86f7-15f72b265be1', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-01a0b6b4-8c16-4ccb-b966-7ee42b8da37a tempest-AttachVolumeTestJSON-1669838508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5db62b0d-f27d-450b-af60-1b10903f26fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-01a0b6b4-8c16-4ccb-b966-7ee42b8da37a tempest-AttachVolumeTestJSON-1669838508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5db62b0d-f27d-450b-af60-1b10903f26fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-01a0b6b4-8c16-4ccb-b966-7ee42b8da37a tempest-AttachVolumeTestJSON-1669838508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b620fdb5-9200-43ae-a512-409259f3e93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:16 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-01a0b6b4-8c16-4ccb-b966-7ee42b8da37a tempest-AttachVolumeTestJSON-1669838508 None] Volume 12708c7c-5787-4277-86f7-15f72b265be1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12708c7c-5787-4277-86f7-15f72b265be1', 'volume_size': 1} Jul 07 08:19:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-01a0b6b4-8c16-4ccb-b966-7ee42b8da37a tempest-AttachVolumeTestJSON-1669838508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-01a0b6b4-8c16-4ccb-b966-7ee42b8da37a tempest-AttachVolumeTestJSON-1669838508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:16 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-01a0b6b4-8c16-4ccb-b966-7ee42b8da37a tempest-AttachVolumeTestJSON-1669838508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-153892614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12708c7c-5787-4277-86f7-15f72b265be1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dece2e57fb847e191255e8956dcc583',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:19:16Z,use_quota=True,user_id='d580e0190dfb4020999f268cfcb2a74c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:19:16 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-01a0b6b4-8c16-4ccb-b966-7ee42b8da37a tempest-AttachVolumeTestJSON-1669838508 None] Creating volume 12708c7c-5787-4277-86f7-15f72b265be1 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:19:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-01a0b6b4-8c16-4ccb-b966-7ee42b8da37a tempest-AttachVolumeTestJSON-1669838508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-01a0b6b4-8c16-4ccb-b966-7ee42b8da37a tempest-AttachVolumeTestJSON-1669838508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:16 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-01a0b6b4-8c16-4ccb-b966-7ee42b8da37a tempest-AttachVolumeTestJSON-1669838508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:19:16 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-01a0b6b4-8c16-4ccb-b966-7ee42b8da37a tempest-AttachVolumeTestJSON-1669838508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:19:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-01a0b6b4-8c16-4ccb-b966-7ee42b8da37a tempest-AttachVolumeTestJSON-1669838508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:16 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-01a0b6b4-8c16-4ccb-b966-7ee42b8da37a tempest-AttachVolumeTestJSON-1669838508 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:19:16 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-01a0b6b4-8c16-4ccb-b966-7ee42b8da37a tempest-AttachVolumeTestJSON-1669838508 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:19:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-01a0b6b4-8c16-4ccb-b966-7ee42b8da37a tempest-AttachVolumeTestJSON-1669838508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12708c7c-5787-4277-86f7-15f72b265be1 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:16 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-3a8b7054-ed88-4ecb-bfc8-b31f34f02957 tempest-GroupSnapshotsTest-1158654987 None] GroupSnapshot d0b3a3d3-775d-486c-8d83-677b000ec1e6: creating. Jul 07 08:19:16 devstack sudo[94390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12708c7c-5787-4277-86f7-15f72b265be1 1073741824 Jul 07 08:19:16 devstack sudo[94390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3a8b7054-ed88-4ecb-bfc8-b31f34f02957 tempest-GroupSnapshotsTest-1158654987 None] Group snapshot d0b3a3d3-775d-486c-8d83-677b000ec1e6: creating. {{(pid=87199) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 07 08:19:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3a8b7054-ed88-4ecb-bfc8-b31f34f02957 tempest-GroupSnapshotsTest-1158654987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:16 devstack sudo[94388]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5c70e596-b68e-4b17-a5ad-591f3e1f5b17 tempest-VolumesTestJSON-1572473642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.826s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:16 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-5c70e596-b68e-4b17-a5ad-591f3e1f5b17 tempest-VolumesTestJSON-1572473642 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:19:16 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-5c70e596-b68e-4b17-a5ad-591f3e1f5b17 tempest-VolumesTestJSON-1572473642 None] Deleted volume successfully. Jul 07 08:19:16 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5c70e596-b68e-4b17-a5ad-591f3e1f5b17 tempest-VolumesTestJSON-1572473642 None] Lock "cinder-68a4993a-0a7b-4bbe-8488-89b995338ad2-delete_volume" released by "delete_volume" :: held 3.143s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:19:17 devstack sudo[94390]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-01a0b6b4-8c16-4ccb-b966-7ee42b8da37a tempest-AttachVolumeTestJSON-1669838508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12708c7c-5787-4277-86f7-15f72b265be1 1073741824" returned: 0 in 0.973s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-01a0b6b4-8c16-4ccb-b966-7ee42b8da37a tempest-AttachVolumeTestJSON-1669838508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12708c7c-5787-4277-86f7-15f72b265be1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:17 devstack sudo[94397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12708c7c-5787-4277-86f7-15f72b265be1 Jul 07 08:19:17 devstack sudo[94397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:18 devstack sudo[94397]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-01a0b6b4-8c16-4ccb-b966-7ee42b8da37a tempest-AttachVolumeTestJSON-1669838508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12708c7c-5787-4277-86f7-15f72b265be1" returned: 0 in 0.715s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:18 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-01a0b6b4-8c16-4ccb-b966-7ee42b8da37a tempest-AttachVolumeTestJSON-1669838508 None] <== create_volume: return (1742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:19:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-01a0b6b4-8c16-4ccb-b966-7ee42b8da37a tempest-AttachVolumeTestJSON-1669838508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.745s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3a8b7054-ed88-4ecb-bfc8-b31f34f02957 tempest-GroupSnapshotsTest-1158654987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.682s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:18 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-3a8b7054-ed88-4ecb-bfc8-b31f34f02957 tempest-GroupSnapshotsTest-1158654987 None] Creating offline snapshot 501598b6-6467-4d1f-bb8e-41e96d4109c0 of volume 16663d93-4553-44d4-b7b5-690c4fce43bd {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:19:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-01a0b6b4-8c16-4ccb-b966-7ee42b8da37a tempest-AttachVolumeTestJSON-1669838508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b620fdb5-9200-43ae-a512-409259f3e93c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12708c7c-5787-4277-86f7-15f72b265be1', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-01a0b6b4-8c16-4ccb-b966-7ee42b8da37a tempest-AttachVolumeTestJSON-1669838508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (839b68f1-43bf-49d5-a0be-a5598777b70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:18 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea2869d-4693-4530-b9d2-543fe8bc8be1]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:19:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3a8b7054-ed88-4ecb-bfc8-b31f34f02957 tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-16663d93-4553-44d4-b7b5-690c4fce43bd {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:18 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-01a0b6b4-8c16-4ccb-b966-7ee42b8da37a tempest-AttachVolumeTestJSON-1669838508 None] Volume volume-12708c7c-5787-4277-86f7-15f72b265be1 (12708c7c-5787-4277-86f7-15f72b265be1): created successfully Jul 07 08:19:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-01a0b6b4-8c16-4ccb-b966-7ee42b8da37a tempest-AttachVolumeTestJSON-1669838508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (839b68f1-43bf-49d5-a0be-a5598777b70f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-01a0b6b4-8c16-4ccb-b966-7ee42b8da37a tempest-AttachVolumeTestJSON-1669838508 None] Flow 'volume_create_manager' (6abafdcd-ef52-45c3-bc5a-8433bef12155) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:19:18 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-01a0b6b4-8c16-4ccb-b966-7ee42b8da37a tempest-AttachVolumeTestJSON-1669838508 None] Created volume successfully. Jul 07 08:19:18 devstack sudo[94400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-16663d93-4553-44d4-b7b5-690c4fce43bd Jul 07 08:19:18 devstack sudo[94400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:19 devstack sudo[94400]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3a8b7054-ed88-4ecb-bfc8-b31f34f02957 tempest-GroupSnapshotsTest-1158654987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-16663d93-4553-44d4-b7b5-690c4fce43bd" returned: 0 in 0.876s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3a8b7054-ed88-4ecb-bfc8-b31f34f02957 tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-16663d93-4553-44d4-b7b5-690c4fce43bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-16663d93-4553-44d4-b7b5-690c4fce43bd.501598b6-6467-4d1f-bb8e-41e96d4109c0 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:19 devstack sudo[94405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-16663d93-4553-44d4-b7b5-690c4fce43bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-16663d93-4553-44d4-b7b5-690c4fce43bd.501598b6-6467-4d1f-bb8e-41e96d4109c0 1G Jul 07 08:19:19 devstack sudo[94405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:20 devstack sudo[94405]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3a8b7054-ed88-4ecb-bfc8-b31f34f02957 tempest-GroupSnapshotsTest-1158654987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-16663d93-4553-44d4-b7b5-690c4fce43bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-16663d93-4553-44d4-b7b5-690c4fce43bd.501598b6-6467-4d1f-bb8e-41e96d4109c0 1G" returned: 0 in 1.009s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3a8b7054-ed88-4ecb-bfc8-b31f34f02957 tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16663d93-4553-44d4-b7b5-690c4fce43bd -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-16663d93-4553-44d4-b7b5-690c4fce43bd.501598b6-6467-4d1f-bb8e-41e96d4109c0 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:20 devstack sudo[94414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16663d93-4553-44d4-b7b5-690c4fce43bd -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-16663d93-4553-44d4-b7b5-690c4fce43bd.501598b6-6467-4d1f-bb8e-41e96d4109c0 Jul 07 08:19:20 devstack sudo[94414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:20 devstack sudo[94414]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3a8b7054-ed88-4ecb-bfc8-b31f34f02957 tempest-GroupSnapshotsTest-1158654987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16663d93-4553-44d4-b7b5-690c4fce43bd -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-16663d93-4553-44d4-b7b5-690c4fce43bd.501598b6-6467-4d1f-bb8e-41e96d4109c0" returned: 0 in 0.767s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:20 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-3a8b7054-ed88-4ecb-bfc8-b31f34f02957 tempest-GroupSnapshotsTest-1158654987 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-16663d93-4553-44d4-b7b5-690c4fce43bd.501598b6-6467-4d1f-bb8e-41e96d4109c0 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 08:19:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3a8b7054-ed88-4ecb-bfc8-b31f34f02957 tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-16663d93-4553-44d4-b7b5-690c4fce43bd.501598b6-6467-4d1f-bb8e-41e96d4109c0 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:20 devstack sudo[94421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-16663d93-4553-44d4-b7b5-690c4fce43bd.501598b6-6467-4d1f-bb8e-41e96d4109c0 Jul 07 08:19:20 devstack sudo[94421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:21 devstack sudo[94421]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3a8b7054-ed88-4ecb-bfc8-b31f34f02957 tempest-GroupSnapshotsTest-1158654987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-16663d93-4553-44d4-b7b5-690c4fce43bd.501598b6-6467-4d1f-bb8e-41e96d4109c0" returned: 0 in 0.745s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3a8b7054-ed88-4ecb-bfc8-b31f34f02957 tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-16663d93-4553-44d4-b7b5-690c4fce43bd.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:21 devstack sudo[94424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-16663d93-4553-44d4-b7b5-690c4fce43bd.info Jul 07 08:19:21 devstack sudo[94424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:22 devstack sudo[94424]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3a8b7054-ed88-4ecb-bfc8-b31f34f02957 tempest-GroupSnapshotsTest-1158654987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-16663d93-4553-44d4-b7b5-690c4fce43bd.info" returned: 0 in 0.912s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:22 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-3a8b7054-ed88-4ecb-bfc8-b31f34f02957 tempest-GroupSnapshotsTest-1158654987 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-16663d93-4553-44d4-b7b5-690c4fce43bd.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 08:19:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3a8b7054-ed88-4ecb-bfc8-b31f34f02957 tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-16663d93-4553-44d4-b7b5-690c4fce43bd.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:22 devstack sudo[94428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-16663d93-4553-44d4-b7b5-690c4fce43bd.info Jul 07 08:19:22 devstack sudo[94428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-452e6371-ebf5-4930-a19a-3e6c17fb2314 req-86194108-adb1-4322-9999-9fc6e85c4849 tempest-AttachVolumeTestJSON-1669838508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:23 devstack sudo[94428]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3a8b7054-ed88-4ecb-bfc8-b31f34f02957 tempest-GroupSnapshotsTest-1158654987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-16663d93-4553-44d4-b7b5-690c4fce43bd.info" returned: 0 in 0.730s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3a8b7054-ed88-4ecb-bfc8-b31f34f02957 tempest-GroupSnapshotsTest-1158654987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.156s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-452e6371-ebf5-4930-a19a-3e6c17fb2314 req-86194108-adb1-4322-9999-9fc6e85c4849 tempest-AttachVolumeTestJSON-1669838508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.442s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:23 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[69db0f4a-51f3-4eca-aa65-a2485558a788]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:19:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-452e6371-ebf5-4930-a19a-3e6c17fb2314 req-86194108-adb1-4322-9999-9fc6e85c4849 tempest-AttachVolumeTestJSON-1669838508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12708c7c-5787-4277-86f7-15f72b265be1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:23 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-3a8b7054-ed88-4ecb-bfc8-b31f34f02957 tempest-GroupSnapshotsTest-1158654987 None] group_snapshot d0b3a3d3-775d-486c-8d83-677b000ec1e6: created successfully Jul 07 08:19:23 devstack sudo[94446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12708c7c-5787-4277-86f7-15f72b265be1 Jul 07 08:19:23 devstack sudo[94446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:24 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-0685cdf3-09cc-44ad-89eb-a9aa5ee6b571 tempest-GroupSnapshotsTest-1158654987 None] group_snapshot d0b3a3d3-775d-486c-8d83-677b000ec1e6: deleting Jul 07 08:19:24 devstack sudo[94446]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-452e6371-ebf5-4930-a19a-3e6c17fb2314 req-86194108-adb1-4322-9999-9fc6e85c4849 tempest-AttachVolumeTestJSON-1669838508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12708c7c-5787-4277-86f7-15f72b265be1" returned: 0 in 0.899s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-452e6371-ebf5-4930-a19a-3e6c17fb2314 req-86194108-adb1-4322-9999-9fc6e85c4849 tempest-AttachVolumeTestJSON-1669838508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.927s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-0685cdf3-09cc-44ad-89eb-a9aa5ee6b571 tempest-GroupSnapshotsTest-1158654987 None] group_snapshot d0b3a3d3-775d-486c-8d83-677b000ec1e6: deleting {{(pid=87199) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 07 08:19:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-452e6371-ebf5-4930-a19a-3e6c17fb2314 req-86194108-adb1-4322-9999-9fc6e85c4849 tempest-AttachVolumeTestJSON-1669838508 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b', 'name': 'volume-12708c7c-5787-4277-86f7-15f72b265be1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4ec8a3b1-b87b-4ab0-b5bd-71af77aeb10c', 'enforce_multipath': True} {{(pid=87199) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 08:19:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0685cdf3-09cc-44ad-89eb-a9aa5ee6b571 tempest-GroupSnapshotsTest-1158654987 None] Acquiring lock "cinder-quobyte-16663d93-4553-44d4-b7b5-690c4fce43bd" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:19:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0685cdf3-09cc-44ad-89eb-a9aa5ee6b571 tempest-GroupSnapshotsTest-1158654987 None] Lock "cinder-quobyte-16663d93-4553-44d4-b7b5-690c4fce43bd" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:19:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0685cdf3-09cc-44ad-89eb-a9aa5ee6b571 tempest-GroupSnapshotsTest-1158654987 None] Acquiring lock "cinder-quobyte-501598b6-6467-4d1f-bb8e-41e96d4109c0" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:19:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0685cdf3-09cc-44ad-89eb-a9aa5ee6b571 tempest-GroupSnapshotsTest-1158654987 None] Lock "cinder-quobyte-501598b6-6467-4d1f-bb8e-41e96d4109c0" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:19:24 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-0685cdf3-09cc-44ad-89eb-a9aa5ee6b571 tempest-GroupSnapshotsTest-1158654987 None] Deleting offline snapshot 501598b6-6467-4d1f-bb8e-41e96d4109c0 of volume 16663d93-4553-44d4-b7b5-690c4fce43bd {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:19:24 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-0685cdf3-09cc-44ad-89eb-a9aa5ee6b571 tempest-GroupSnapshotsTest-1158654987 None] snapshot_file for this snap is: volume-16663d93-4553-44d4-b7b5-690c4fce43bd.501598b6-6467-4d1f-bb8e-41e96d4109c0 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:19:24 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-452e6371-ebf5-4930-a19a-3e6c17fb2314 req-86194108-adb1-4322-9999-9fc6e85c4849 tempest-AttachVolumeTestJSON-1669838508 None] attachment_update completed successfully. Jul 07 08:19:24 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[0efd6358-5d41-4251-b037-90c5868bd0b4]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:19:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0685cdf3-09cc-44ad-89eb-a9aa5ee6b571 tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-16663d93-4553-44d4-b7b5-690c4fce43bd.501598b6-6467-4d1f-bb8e-41e96d4109c0 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:24 devstack sudo[94451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-16663d93-4553-44d4-b7b5-690c4fce43bd.501598b6-6467-4d1f-bb8e-41e96d4109c0 Jul 07 08:19:24 devstack sudo[94451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:25 devstack sudo[94451]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0685cdf3-09cc-44ad-89eb-a9aa5ee6b571 tempest-GroupSnapshotsTest-1158654987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-16663d93-4553-44d4-b7b5-690c4fce43bd.501598b6-6467-4d1f-bb8e-41e96d4109c0" returned: 0 in 0.969s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:25 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-0685cdf3-09cc-44ad-89eb-a9aa5ee6b571 tempest-GroupSnapshotsTest-1158654987 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16663d93-4553-44d4-b7b5-690c4fce43bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:19:25 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9016e7-a163-4b93-92b9-69d0aeb5e50e]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:19:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0685cdf3-09cc-44ad-89eb-a9aa5ee6b571 tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-16663d93-4553-44d4-b7b5-690c4fce43bd {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:25 devstack sudo[94490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-16663d93-4553-44d4-b7b5-690c4fce43bd Jul 07 08:19:25 devstack sudo[94490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:26 devstack sudo[94490]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0685cdf3-09cc-44ad-89eb-a9aa5ee6b571 tempest-GroupSnapshotsTest-1158654987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-16663d93-4553-44d4-b7b5-690c4fce43bd" returned: 0 in 0.943s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0685cdf3-09cc-44ad-89eb-a9aa5ee6b571 tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-16663d93-4553-44d4-b7b5-690c4fce43bd.501598b6-6467-4d1f-bb8e-41e96d4109c0 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:26 devstack sudo[94499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-16663d93-4553-44d4-b7b5-690c4fce43bd.501598b6-6467-4d1f-bb8e-41e96d4109c0 Jul 07 08:19:26 devstack sudo[94499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:27 devstack sudo[94499]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0685cdf3-09cc-44ad-89eb-a9aa5ee6b571 tempest-GroupSnapshotsTest-1158654987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-16663d93-4553-44d4-b7b5-690c4fce43bd.501598b6-6467-4d1f-bb8e-41e96d4109c0" returned: 0 in 0.900s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0685cdf3-09cc-44ad-89eb-a9aa5ee6b571 tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-16663d93-4553-44d4-b7b5-690c4fce43bd.501598b6-6467-4d1f-bb8e-41e96d4109c0 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:27 devstack sudo[94505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-16663d93-4553-44d4-b7b5-690c4fce43bd.501598b6-6467-4d1f-bb8e-41e96d4109c0 Jul 07 08:19:27 devstack sudo[94505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:28 devstack sudo[94505]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0685cdf3-09cc-44ad-89eb-a9aa5ee6b571 tempest-GroupSnapshotsTest-1158654987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-16663d93-4553-44d4-b7b5-690c4fce43bd.501598b6-6467-4d1f-bb8e-41e96d4109c0" returned: 0 in 0.726s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:28 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0685cdf3-09cc-44ad-89eb-a9aa5ee6b571 tempest-GroupSnapshotsTest-1158654987 None] Lock "cinder-quobyte-501598b6-6467-4d1f-bb8e-41e96d4109c0" released by "_delete_snapshot" :: held 3.695s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:19:28 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0685cdf3-09cc-44ad-89eb-a9aa5ee6b571 tempest-GroupSnapshotsTest-1158654987 None] Lock "cinder-quobyte-16663d93-4553-44d4-b7b5-690c4fce43bd" released by "delete_snapshot" :: held 3.734s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:19:28 devstack cinder-volume[87199]: WARNING cinder.quota [None req-0685cdf3-09cc-44ad-89eb-a9aa5ee6b571 tempest-GroupSnapshotsTest-1158654987 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-607273004 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-607273004, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:19:28 devstack cinder-volume[87199]: WARNING cinder.quota [None req-0685cdf3-09cc-44ad-89eb-a9aa5ee6b571 tempest-GroupSnapshotsTest-1158654987 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-607273004 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-607273004, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:19:28 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-0685cdf3-09cc-44ad-89eb-a9aa5ee6b571 tempest-GroupSnapshotsTest-1158654987 None] Created reservations ['1da8a137-760a-49e0-a81f-73045a6e6ffb', 'd922e49b-3354-4b39-8dd7-7d0c28745335', '50015866-92f3-4631-b885-3ad055446ae4', '3d32b370-8683-4539-b8d5-c68adc506e2e'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:19:28 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-0685cdf3-09cc-44ad-89eb-a9aa5ee6b571 tempest-GroupSnapshotsTest-1158654987 None] group_snapshot d0b3a3d3-775d-486c-8d83-677b000ec1e6: deleted successfully Jul 07 08:19:29 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-834e63e7-94bc-4d3e-8883-d716ef494262 tempest-GroupSnapshotsTest-1158654987 None] Acquiring lock "cinder-quobyte-16663d93-4553-44d4-b7b5-690c4fce43bd" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:19:29 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-834e63e7-94bc-4d3e-8883-d716ef494262 tempest-GroupSnapshotsTest-1158654987 None] Lock "cinder-quobyte-16663d93-4553-44d4-b7b5-690c4fce43bd" acquired by "delete_volume" :: waited 0.024s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:19:29 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d0ba04-be90-4e38-ab77-9cc3f0f29bca]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:19:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-834e63e7-94bc-4d3e-8883-d716ef494262 tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-16663d93-4553-44d4-b7b5-690c4fce43bd {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:29 devstack sudo[94508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-16663d93-4553-44d4-b7b5-690c4fce43bd Jul 07 08:19:29 devstack sudo[94508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:30 devstack sudo[94508]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-834e63e7-94bc-4d3e-8883-d716ef494262 tempest-GroupSnapshotsTest-1158654987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-16663d93-4553-44d4-b7b5-690c4fce43bd" returned: 0 in 0.972s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-834e63e7-94bc-4d3e-8883-d716ef494262 tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-16663d93-4553-44d4-b7b5-690c4fce43bd {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:30 devstack sudo[94515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-16663d93-4553-44d4-b7b5-690c4fce43bd Jul 07 08:19:30 devstack sudo[94515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:30 devstack sudo[94515]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-834e63e7-94bc-4d3e-8883-d716ef494262 tempest-GroupSnapshotsTest-1158654987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-16663d93-4553-44d4-b7b5-690c4fce43bd" returned: 0 in 0.710s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:30 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-834e63e7-94bc-4d3e-8883-d716ef494262 tempest-GroupSnapshotsTest-1158654987 None] Lock "cinder-quobyte-16663d93-4553-44d4-b7b5-690c4fce43bd" released by "delete_volume" :: held 1.772s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:19:31 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-834e63e7-94bc-4d3e-8883-d716ef494262 tempest-GroupSnapshotsTest-1158654987 None] Created reservations ['860b6646-50f1-4623-b900-64181a388070'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:19:31 devstack cinder-volume[87199]: WARNING cinder.quota [None req-834e63e7-94bc-4d3e-8883-d716ef494262 tempest-GroupSnapshotsTest-1158654987 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-607273004 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-607273004, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:19:31 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-834e63e7-94bc-4d3e-8883-d716ef494262 tempest-GroupSnapshotsTest-1158654987 None] Created reservations ['50cd0ff2-46f3-43d8-b458-6face4dc29f4', '8c6e7aca-d2ce-445f-8796-492bea225da4', 'f113c78e-0680-43d5-b650-4b8bc6e1095a', '30d7763f-db48-4f11-8b81-843b85e6a5b8'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:19:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-834e63e7-94bc-4d3e-8883-d716ef494262 tempest-GroupSnapshotsTest-1158654987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-834e63e7-94bc-4d3e-8883-d716ef494262 tempest-GroupSnapshotsTest-1158654987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:31 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-834e63e7-94bc-4d3e-8883-d716ef494262 tempest-GroupSnapshotsTest-1158654987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:19:31 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-834e63e7-94bc-4d3e-8883-d716ef494262 tempest-GroupSnapshotsTest-1158654987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:19:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-834e63e7-94bc-4d3e-8883-d716ef494262 tempest-GroupSnapshotsTest-1158654987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-834e63e7-94bc-4d3e-8883-d716ef494262 tempest-GroupSnapshotsTest-1158654987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:31 devstack sudo[94545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:19:31 devstack sudo[94545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:31 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-39373403-c4dc-4ce5-9515-cfb3b06f180d req-21d4091a-1146-471d-9a82-2c51acca17df tempest-AttachVolumeTestJSON-1669838508 None] Terminate volume connection completed successfully. Jul 07 08:19:31 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-39373403-c4dc-4ce5-9515-cfb3b06f180d req-21d4091a-1146-471d-9a82-2c51acca17df tempest-AttachVolumeTestJSON-1669838508 None] Deleting attachment e711894a-395f-4620-a1d6-1abe0c23f176. {{(pid=87199) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 08:19:31 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e03ea57-bba2-4427-9122-4fd49c2a5366 tempest-VolumeTypesAccessTest-2022335227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:19:31 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3e03ea57-bba2-4427-9122-4fd49c2a5366 tempest-VolumeTypesAccessTest-2022335227 None] Flow 'volume_create_manager' (31ceac97-4f1e-4b1c-8197-d08dad319652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:19:31 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3e03ea57-bba2-4427-9122-4fd49c2a5366 tempest-VolumeTypesAccessTest-2022335227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d04bd639-6632-40c3-8799-3f869a48b70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3e03ea57-bba2-4427-9122-4fd49c2a5366 tempest-VolumeTypesAccessTest-2022335227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d04bd639-6632-40c3-8799-3f869a48b70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-669806504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5cb7cb0-25be-43a3-999c-50939b91e51f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1efc1718f9f4374ad17eec086b3e884',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:19:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:19:32Z,use_quota=True,user_id='a930ebc754134af88f3f2937b4be5240',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(baa2208b-2be1-47ea-aaa9-9001e6dc8390),volume_type_id=baa2208b-2be1-47ea-aaa9-9001e6dc8390)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3e03ea57-bba2-4427-9122-4fd49c2a5366 tempest-VolumeTypesAccessTest-2022335227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cbb56b0-2d0b-48c7-bf41-d664b65bf87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3e03ea57-bba2-4427-9122-4fd49c2a5366 tempest-VolumeTypesAccessTest-2022335227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cbb56b0-2d0b-48c7-bf41-d664b65bf87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3e03ea57-bba2-4427-9122-4fd49c2a5366 tempest-VolumeTypesAccessTest-2022335227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a14769d-5cd6-4f72-a856-db6eadf6d40e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3e03ea57-bba2-4427-9122-4fd49c2a5366 tempest-VolumeTypesAccessTest-2022335227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a14769d-5cd6-4f72-a856-db6eadf6d40e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5cb7cb0-25be-43a3-999c-50939b91e51f', 'volume_name': 'volume-f5cb7cb0-25be-43a3-999c-50939b91e51f', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3e03ea57-bba2-4427-9122-4fd49c2a5366 tempest-VolumeTypesAccessTest-2022335227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02992e57-a605-4d3a-bd19-10f602bbe9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3e03ea57-bba2-4427-9122-4fd49c2a5366 tempest-VolumeTypesAccessTest-2022335227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02992e57-a605-4d3a-bd19-10f602bbe9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3e03ea57-bba2-4427-9122-4fd49c2a5366 tempest-VolumeTypesAccessTest-2022335227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93aaf89c-b408-498f-b11f-a45602f00f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:32 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-3e03ea57-bba2-4427-9122-4fd49c2a5366 tempest-VolumeTypesAccessTest-2022335227 None] Volume f5cb7cb0-25be-43a3-999c-50939b91e51f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5cb7cb0-25be-43a3-999c-50939b91e51f', 'volume_size': 1} Jul 07 08:19:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3e03ea57-bba2-4427-9122-4fd49c2a5366 tempest-VolumeTypesAccessTest-2022335227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3e03ea57-bba2-4427-9122-4fd49c2a5366 tempest-VolumeTypesAccessTest-2022335227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:32 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-3e03ea57-bba2-4427-9122-4fd49c2a5366 tempest-VolumeTypesAccessTest-2022335227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-669806504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5cb7cb0-25be-43a3-999c-50939b91e51f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1efc1718f9f4374ad17eec086b3e884',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:19:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:19:32Z,use_quota=True,user_id='a930ebc754134af88f3f2937b4be5240',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(baa2208b-2be1-47ea-aaa9-9001e6dc8390),volume_type_id=baa2208b-2be1-47ea-aaa9-9001e6dc8390)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:19:32 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-3e03ea57-bba2-4427-9122-4fd49c2a5366 tempest-VolumeTypesAccessTest-2022335227 None] Creating volume f5cb7cb0-25be-43a3-999c-50939b91e51f {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:19:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3e03ea57-bba2-4427-9122-4fd49c2a5366 tempest-VolumeTypesAccessTest-2022335227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3e03ea57-bba2-4427-9122-4fd49c2a5366 tempest-VolumeTypesAccessTest-2022335227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:32 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-3e03ea57-bba2-4427-9122-4fd49c2a5366 tempest-VolumeTypesAccessTest-2022335227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:19:32 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-3e03ea57-bba2-4427-9122-4fd49c2a5366 tempest-VolumeTypesAccessTest-2022335227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:19:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3e03ea57-bba2-4427-9122-4fd49c2a5366 tempest-VolumeTypesAccessTest-2022335227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:32 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-3e03ea57-bba2-4427-9122-4fd49c2a5366 tempest-VolumeTypesAccessTest-2022335227 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:19:32 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-3e03ea57-bba2-4427-9122-4fd49c2a5366 tempest-VolumeTypesAccessTest-2022335227 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:19:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3e03ea57-bba2-4427-9122-4fd49c2a5366 tempest-VolumeTypesAccessTest-2022335227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f5cb7cb0-25be-43a3-999c-50939b91e51f 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:32 devstack sudo[94548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f5cb7cb0-25be-43a3-999c-50939b91e51f 1073741824 Jul 07 08:19:32 devstack sudo[94548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:32 devstack sudo[94545]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-834e63e7-94bc-4d3e-8883-d716ef494262 tempest-GroupSnapshotsTest-1158654987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.934s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:32 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-834e63e7-94bc-4d3e-8883-d716ef494262 tempest-GroupSnapshotsTest-1158654987 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:19:32 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-834e63e7-94bc-4d3e-8883-d716ef494262 tempest-GroupSnapshotsTest-1158654987 None] Delete group completed successfully. Jul 07 08:19:33 devstack sudo[94548]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3e03ea57-bba2-4427-9122-4fd49c2a5366 tempest-VolumeTypesAccessTest-2022335227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f5cb7cb0-25be-43a3-999c-50939b91e51f 1073741824" returned: 0 in 1.048s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3e03ea57-bba2-4427-9122-4fd49c2a5366 tempest-VolumeTypesAccessTest-2022335227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f5cb7cb0-25be-43a3-999c-50939b91e51f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:33 devstack sudo[94554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f5cb7cb0-25be-43a3-999c-50939b91e51f Jul 07 08:19:33 devstack sudo[94554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:33 devstack sudo[94554]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3e03ea57-bba2-4427-9122-4fd49c2a5366 tempest-VolumeTypesAccessTest-2022335227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f5cb7cb0-25be-43a3-999c-50939b91e51f" returned: 0 in 0.747s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:33 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-3e03ea57-bba2-4427-9122-4fd49c2a5366 tempest-VolumeTypesAccessTest-2022335227 None] <== create_volume: return (1863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:19:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3e03ea57-bba2-4427-9122-4fd49c2a5366 tempest-VolumeTypesAccessTest-2022335227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.866s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3e03ea57-bba2-4427-9122-4fd49c2a5366 tempest-VolumeTypesAccessTest-2022335227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93aaf89c-b408-498f-b11f-a45602f00f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5cb7cb0-25be-43a3-999c-50939b91e51f', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3e03ea57-bba2-4427-9122-4fd49c2a5366 tempest-VolumeTypesAccessTest-2022335227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd34474c-527d-4f80-b511-4ea67a84c531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:33 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-3e03ea57-bba2-4427-9122-4fd49c2a5366 tempest-VolumeTypesAccessTest-2022335227 None] Volume volume-f5cb7cb0-25be-43a3-999c-50939b91e51f (f5cb7cb0-25be-43a3-999c-50939b91e51f): created successfully Jul 07 08:19:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3e03ea57-bba2-4427-9122-4fd49c2a5366 tempest-VolumeTypesAccessTest-2022335227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd34474c-527d-4f80-b511-4ea67a84c531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3e03ea57-bba2-4427-9122-4fd49c2a5366 tempest-VolumeTypesAccessTest-2022335227 None] Flow 'volume_create_manager' (31ceac97-4f1e-4b1c-8197-d08dad319652) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:19:34 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-3e03ea57-bba2-4427-9122-4fd49c2a5366 tempest-VolumeTypesAccessTest-2022335227 None] Created volume successfully. Jul 07 08:19:34 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-0114a7da-46d2-4dad-8c19-df4982f71f9b req-41152d9c-a8d4-47ca-8a17-4659c03369b5 tempest-AttachVolumeTestJSON-1669838508 None] Terminate volume connection completed successfully. Jul 07 08:19:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-0114a7da-46d2-4dad-8c19-df4982f71f9b req-41152d9c-a8d4-47ca-8a17-4659c03369b5 tempest-AttachVolumeTestJSON-1669838508 None] Deleting attachment 4ec8a3b1-b87b-4ab0-b5bd-71af77aeb10c. {{(pid=87199) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 08:19:35 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a6623e27-bf8a-4fae-91c0-b42875c72684 tempest-VolumeTypesAccessTest-2022335227 None] Acquiring lock "cinder-f5cb7cb0-25be-43a3-999c-50939b91e51f-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:19:35 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a6623e27-bf8a-4fae-91c0-b42875c72684 tempest-VolumeTypesAccessTest-2022335227 None] Lock "cinder-f5cb7cb0-25be-43a3-999c-50939b91e51f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:19:35 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a6623e27-bf8a-4fae-91c0-b42875c72684 tempest-VolumeTypesAccessTest-2022335227 None] Acquiring lock "cinder-quobyte-f5cb7cb0-25be-43a3-999c-50939b91e51f" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:19:35 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a6623e27-bf8a-4fae-91c0-b42875c72684 tempest-VolumeTypesAccessTest-2022335227 None] Lock "cinder-quobyte-f5cb7cb0-25be-43a3-999c-50939b91e51f" acquired by "delete_volume" :: waited 0.030s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:19:35 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e9724f-72d4-41f0-aebf-c0d630eeef2e]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:19:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a6623e27-bf8a-4fae-91c0-b42875c72684 tempest-VolumeTypesAccessTest-2022335227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f5cb7cb0-25be-43a3-999c-50939b91e51f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:35 devstack sudo[94560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f5cb7cb0-25be-43a3-999c-50939b91e51f Jul 07 08:19:35 devstack sudo[94560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:36 devstack sudo[94560]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a6623e27-bf8a-4fae-91c0-b42875c72684 tempest-VolumeTypesAccessTest-2022335227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f5cb7cb0-25be-43a3-999c-50939b91e51f" returned: 0 in 0.824s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a6623e27-bf8a-4fae-91c0-b42875c72684 tempest-VolumeTypesAccessTest-2022335227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f5cb7cb0-25be-43a3-999c-50939b91e51f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:36 devstack sudo[94565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f5cb7cb0-25be-43a3-999c-50939b91e51f Jul 07 08:19:36 devstack sudo[94565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:37 devstack sudo[94565]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a6623e27-bf8a-4fae-91c0-b42875c72684 tempest-VolumeTypesAccessTest-2022335227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f5cb7cb0-25be-43a3-999c-50939b91e51f" returned: 0 in 1.191s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:37 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a6623e27-bf8a-4fae-91c0-b42875c72684 tempest-VolumeTypesAccessTest-2022335227 None] Lock "cinder-quobyte-f5cb7cb0-25be-43a3-999c-50939b91e51f" released by "delete_volume" :: held 2.069s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:19:37 devstack cinder-volume[87199]: WARNING cinder.quota [None req-a6623e27-bf8a-4fae-91c0-b42875c72684 tempest-VolumeTypesAccessTest-2022335227 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-2092604384 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-2092604384, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:19:37 devstack cinder-volume[87199]: WARNING cinder.quota [None req-a6623e27-bf8a-4fae-91c0-b42875c72684 tempest-VolumeTypesAccessTest-2022335227 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-2092604384 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-2092604384, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:19:37 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-a6623e27-bf8a-4fae-91c0-b42875c72684 tempest-VolumeTypesAccessTest-2022335227 None] Created reservations ['5943ba33-8b9f-4adb-84ad-edd7a38c9536', 'f415d210-5aca-437b-8571-26a2a193ac48', '58a917a9-e0de-4d45-bdf9-6e7530887723', 'f3874867-00a0-401e-9487-faab4a5d43ee'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:19:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a6623e27-bf8a-4fae-91c0-b42875c72684 tempest-VolumeTypesAccessTest-2022335227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a6623e27-bf8a-4fae-91c0-b42875c72684 tempest-VolumeTypesAccessTest-2022335227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:37 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a6623e27-bf8a-4fae-91c0-b42875c72684 tempest-VolumeTypesAccessTest-2022335227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:19:37 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a6623e27-bf8a-4fae-91c0-b42875c72684 tempest-VolumeTypesAccessTest-2022335227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:19:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a6623e27-bf8a-4fae-91c0-b42875c72684 tempest-VolumeTypesAccessTest-2022335227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a6623e27-bf8a-4fae-91c0-b42875c72684 tempest-VolumeTypesAccessTest-2022335227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:37 devstack sudo[94568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:19:37 devstack sudo[94568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:38 devstack sudo[94568]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a6623e27-bf8a-4fae-91c0-b42875c72684 tempest-VolumeTypesAccessTest-2022335227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.749s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:38 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-a6623e27-bf8a-4fae-91c0-b42875c72684 tempest-VolumeTypesAccessTest-2022335227 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:19:38 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-a6623e27-bf8a-4fae-91c0-b42875c72684 tempest-VolumeTypesAccessTest-2022335227 None] Deleted volume successfully. Jul 07 08:19:38 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a6623e27-bf8a-4fae-91c0-b42875c72684 tempest-VolumeTypesAccessTest-2022335227 None] Lock "cinder-f5cb7cb0-25be-43a3-999c-50939b91e51f-delete_volume" released by "delete_volume" :: held 3.155s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:19:44 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-f13ede0d-cdae-473a-be9b-0dc02c692bd0 tempest-VolumeQuotasAdminTestJSON-1496714528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:19:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f13ede0d-cdae-473a-be9b-0dc02c692bd0 tempest-VolumeQuotasAdminTestJSON-1496714528 None] Flow 'volume_create_manager' (6d88445a-ccf4-4996-899a-fabc16a5025b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:19:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f13ede0d-cdae-473a-be9b-0dc02c692bd0 tempest-VolumeQuotasAdminTestJSON-1496714528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c02c76c3-40b5-4502-b7d4-324a012d5b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f13ede0d-cdae-473a-be9b-0dc02c692bd0 tempest-VolumeQuotasAdminTestJSON-1496714528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c02c76c3-40b5-4502-b7d4-324a012d5b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-676814039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02a63cb2-8fcc-4801-9d7f-3a381bd5b04d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc2fa13679c84ff8b036db976825734a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:19:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:19:45Z,use_quota=True,user_id='bc93358a08c9490b8ca171934862f1c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f13ede0d-cdae-473a-be9b-0dc02c692bd0 tempest-VolumeQuotasAdminTestJSON-1496714528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec335476-845b-402f-a51f-c867e75efb04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f13ede0d-cdae-473a-be9b-0dc02c692bd0 tempest-VolumeQuotasAdminTestJSON-1496714528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec335476-845b-402f-a51f-c867e75efb04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f13ede0d-cdae-473a-be9b-0dc02c692bd0 tempest-VolumeQuotasAdminTestJSON-1496714528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8f2172e-0b4d-4371-bab1-a8c2f8735955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f13ede0d-cdae-473a-be9b-0dc02c692bd0 tempest-VolumeQuotasAdminTestJSON-1496714528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8f2172e-0b4d-4371-bab1-a8c2f8735955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02a63cb2-8fcc-4801-9d7f-3a381bd5b04d', 'volume_name': 'volume-02a63cb2-8fcc-4801-9d7f-3a381bd5b04d', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f13ede0d-cdae-473a-be9b-0dc02c692bd0 tempest-VolumeQuotasAdminTestJSON-1496714528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bb650fb-d99f-423f-8725-c431b2e15fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f13ede0d-cdae-473a-be9b-0dc02c692bd0 tempest-VolumeQuotasAdminTestJSON-1496714528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bb650fb-d99f-423f-8725-c431b2e15fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f13ede0d-cdae-473a-be9b-0dc02c692bd0 tempest-VolumeQuotasAdminTestJSON-1496714528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6c17a41-f883-4469-8aa3-7b4cdebc1aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:45 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-f13ede0d-cdae-473a-be9b-0dc02c692bd0 tempest-VolumeQuotasAdminTestJSON-1496714528 None] Volume 02a63cb2-8fcc-4801-9d7f-3a381bd5b04d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02a63cb2-8fcc-4801-9d7f-3a381bd5b04d', 'volume_size': 1} Jul 07 08:19:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f13ede0d-cdae-473a-be9b-0dc02c692bd0 tempest-VolumeQuotasAdminTestJSON-1496714528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f13ede0d-cdae-473a-be9b-0dc02c692bd0 tempest-VolumeQuotasAdminTestJSON-1496714528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:45 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f13ede0d-cdae-473a-be9b-0dc02c692bd0 tempest-VolumeQuotasAdminTestJSON-1496714528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-676814039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02a63cb2-8fcc-4801-9d7f-3a381bd5b04d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc2fa13679c84ff8b036db976825734a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:19:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:19:45Z,use_quota=True,user_id='bc93358a08c9490b8ca171934862f1c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:19:45 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-f13ede0d-cdae-473a-be9b-0dc02c692bd0 tempest-VolumeQuotasAdminTestJSON-1496714528 None] Creating volume 02a63cb2-8fcc-4801-9d7f-3a381bd5b04d {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:19:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f13ede0d-cdae-473a-be9b-0dc02c692bd0 tempest-VolumeQuotasAdminTestJSON-1496714528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f13ede0d-cdae-473a-be9b-0dc02c692bd0 tempest-VolumeQuotasAdminTestJSON-1496714528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:45 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f13ede0d-cdae-473a-be9b-0dc02c692bd0 tempest-VolumeQuotasAdminTestJSON-1496714528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:19:45 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f13ede0d-cdae-473a-be9b-0dc02c692bd0 tempest-VolumeQuotasAdminTestJSON-1496714528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:19:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f13ede0d-cdae-473a-be9b-0dc02c692bd0 tempest-VolumeQuotasAdminTestJSON-1496714528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:45 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f13ede0d-cdae-473a-be9b-0dc02c692bd0 tempest-VolumeQuotasAdminTestJSON-1496714528 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:19:45 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-f13ede0d-cdae-473a-be9b-0dc02c692bd0 tempest-VolumeQuotasAdminTestJSON-1496714528 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:19:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f13ede0d-cdae-473a-be9b-0dc02c692bd0 tempest-VolumeQuotasAdminTestJSON-1496714528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-02a63cb2-8fcc-4801-9d7f-3a381bd5b04d 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:45 devstack sudo[94597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-02a63cb2-8fcc-4801-9d7f-3a381bd5b04d 1073741824 Jul 07 08:19:45 devstack sudo[94597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:45 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-1ed90b24-6beb-4498-b773-64b3f6a9144d tempest-GroupsV320Test-1318617363 None] Group tempest-GroupsV320Test-Group-1343317773: creating Jul 07 08:19:45 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-1ed90b24-6beb-4498-b773-64b3f6a9144d tempest-GroupsV320Test-1318617363 None] Group tempest-GroupsV320Test-Group-1343317773: created successfully Jul 07 08:19:45 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-1ed90b24-6beb-4498-b773-64b3f6a9144d tempest-GroupsV320Test-1318617363 None] Create group completed successfully. Jul 07 08:19:46 devstack sudo[94597]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f13ede0d-cdae-473a-be9b-0dc02c692bd0 tempest-VolumeQuotasAdminTestJSON-1496714528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-02a63cb2-8fcc-4801-9d7f-3a381bd5b04d 1073741824" returned: 0 in 1.030s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f13ede0d-cdae-473a-be9b-0dc02c692bd0 tempest-VolumeQuotasAdminTestJSON-1496714528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-02a63cb2-8fcc-4801-9d7f-3a381bd5b04d {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:46 devstack sudo[94609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-02a63cb2-8fcc-4801-9d7f-3a381bd5b04d Jul 07 08:19:46 devstack sudo[94609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ad0ce486-51e9-4e31-bad0-d877e3d25866 tempest-AttachVolumeTestJSON-1669838508 None] Acquiring lock "cinder-12708c7c-5787-4277-86f7-15f72b265be1-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:19:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ad0ce486-51e9-4e31-bad0-d877e3d25866 tempest-AttachVolumeTestJSON-1669838508 None] Lock "cinder-12708c7c-5787-4277-86f7-15f72b265be1-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:19:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ad0ce486-51e9-4e31-bad0-d877e3d25866 tempest-AttachVolumeTestJSON-1669838508 None] Acquiring lock "cinder-quobyte-12708c7c-5787-4277-86f7-15f72b265be1" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:19:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ad0ce486-51e9-4e31-bad0-d877e3d25866 tempest-AttachVolumeTestJSON-1669838508 None] Lock "cinder-quobyte-12708c7c-5787-4277-86f7-15f72b265be1" acquired by "delete_volume" :: waited 0.018s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:19:46 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3ce961-d8dc-4cb5-a853-3eef7fd69667]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:19:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ad0ce486-51e9-4e31-bad0-d877e3d25866 tempest-AttachVolumeTestJSON-1669838508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12708c7c-5787-4277-86f7-15f72b265be1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:46 devstack sudo[94611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12708c7c-5787-4277-86f7-15f72b265be1 Jul 07 08:19:46 devstack sudo[94611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:46 devstack sudo[94609]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f13ede0d-cdae-473a-be9b-0dc02c692bd0 tempest-VolumeQuotasAdminTestJSON-1496714528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-02a63cb2-8fcc-4801-9d7f-3a381bd5b04d" returned: 0 in 0.667s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:46 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f13ede0d-cdae-473a-be9b-0dc02c692bd0 tempest-VolumeQuotasAdminTestJSON-1496714528 None] <== create_volume: return (1765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:19:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f13ede0d-cdae-473a-be9b-0dc02c692bd0 tempest-VolumeQuotasAdminTestJSON-1496714528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.768s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f13ede0d-cdae-473a-be9b-0dc02c692bd0 tempest-VolumeQuotasAdminTestJSON-1496714528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6c17a41-f883-4469-8aa3-7b4cdebc1aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02a63cb2-8fcc-4801-9d7f-3a381bd5b04d', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f13ede0d-cdae-473a-be9b-0dc02c692bd0 tempest-VolumeQuotasAdminTestJSON-1496714528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a857f56-5487-475b-8e4b-9e3702405787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:46 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-f13ede0d-cdae-473a-be9b-0dc02c692bd0 tempest-VolumeQuotasAdminTestJSON-1496714528 None] Volume volume-02a63cb2-8fcc-4801-9d7f-3a381bd5b04d (02a63cb2-8fcc-4801-9d7f-3a381bd5b04d): created successfully Jul 07 08:19:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f13ede0d-cdae-473a-be9b-0dc02c692bd0 tempest-VolumeQuotasAdminTestJSON-1496714528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a857f56-5487-475b-8e4b-9e3702405787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f13ede0d-cdae-473a-be9b-0dc02c692bd0 tempest-VolumeQuotasAdminTestJSON-1496714528 None] Flow 'volume_create_manager' (6d88445a-ccf4-4996-899a-fabc16a5025b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:19:46 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-f13ede0d-cdae-473a-be9b-0dc02c692bd0 tempest-VolumeQuotasAdminTestJSON-1496714528 None] Created volume successfully. Jul 07 08:19:47 devstack sudo[94611]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ad0ce486-51e9-4e31-bad0-d877e3d25866 tempest-AttachVolumeTestJSON-1669838508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12708c7c-5787-4277-86f7-15f72b265be1" returned: 0 in 0.809s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ad0ce486-51e9-4e31-bad0-d877e3d25866 tempest-AttachVolumeTestJSON-1669838508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12708c7c-5787-4277-86f7-15f72b265be1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:47 devstack sudo[94617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12708c7c-5787-4277-86f7-15f72b265be1 Jul 07 08:19:47 devstack sudo[94617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:47 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-20b63b1d-c375-4d40-82bc-415c144e81ab tempest-VolumeQuotasAdminTestJSON-1496714528 None] Acquiring lock "cinder-02a63cb2-8fcc-4801-9d7f-3a381bd5b04d-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:19:47 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-20b63b1d-c375-4d40-82bc-415c144e81ab tempest-VolumeQuotasAdminTestJSON-1496714528 None] Lock "cinder-02a63cb2-8fcc-4801-9d7f-3a381bd5b04d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:19:47 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-20b63b1d-c375-4d40-82bc-415c144e81ab tempest-VolumeQuotasAdminTestJSON-1496714528 None] Acquiring lock "cinder-quobyte-02a63cb2-8fcc-4801-9d7f-3a381bd5b04d" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:19:47 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-20b63b1d-c375-4d40-82bc-415c144e81ab tempest-VolumeQuotasAdminTestJSON-1496714528 None] Lock "cinder-quobyte-02a63cb2-8fcc-4801-9d7f-3a381bd5b04d" acquired by "delete_volume" :: waited 0.027s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:19:47 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bfc4b70-c451-4237-b09c-bc0d31dba67e]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:19:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-20b63b1d-c375-4d40-82bc-415c144e81ab tempest-VolumeQuotasAdminTestJSON-1496714528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-02a63cb2-8fcc-4801-9d7f-3a381bd5b04d {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:47 devstack sudo[94619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-02a63cb2-8fcc-4801-9d7f-3a381bd5b04d Jul 07 08:19:47 devstack sudo[94619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:47 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-256f8786-9cb9-4ed6-aaef-5ebb3553bea8 tempest-GroupsV320Test-1318617363 None] Created reservations ['d54a9e77-fabe-4486-bd3c-c0ec5670ded4'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:19:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-256f8786-9cb9-4ed6-aaef-5ebb3553bea8 tempest-GroupsV320Test-1318617363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-256f8786-9cb9-4ed6-aaef-5ebb3553bea8 tempest-GroupsV320Test-1318617363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-256f8786-9cb9-4ed6-aaef-5ebb3553bea8 tempest-GroupsV320Test-1318617363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:19:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-256f8786-9cb9-4ed6-aaef-5ebb3553bea8 tempest-GroupsV320Test-1318617363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:19:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-256f8786-9cb9-4ed6-aaef-5ebb3553bea8 tempest-GroupsV320Test-1318617363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-256f8786-9cb9-4ed6-aaef-5ebb3553bea8 tempest-GroupsV320Test-1318617363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:47 devstack sudo[94621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:19:47 devstack sudo[94621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:47 devstack sudo[94617]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ad0ce486-51e9-4e31-bad0-d877e3d25866 tempest-AttachVolumeTestJSON-1669838508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12708c7c-5787-4277-86f7-15f72b265be1" returned: 0 in 0.781s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:47 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ad0ce486-51e9-4e31-bad0-d877e3d25866 tempest-AttachVolumeTestJSON-1669838508 None] Lock "cinder-quobyte-12708c7c-5787-4277-86f7-15f72b265be1" released by "delete_volume" :: held 1.645s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:19:47 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-ad0ce486-51e9-4e31-bad0-d877e3d25866 tempest-AttachVolumeTestJSON-1669838508 None] Created reservations ['95bc26fd-f78e-4822-b5b6-1d7d84c954dd', '2e592e5b-cef5-4e2d-a5ae-0c43f1091880', '4534b545-3f09-49c9-b4d3-26ba4c393ef2', 'e7cbb5d3-1c83-41bf-87cf-4e294e8558c4'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:19:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad0ce486-51e9-4e31-bad0-d877e3d25866 tempest-AttachVolumeTestJSON-1669838508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad0ce486-51e9-4e31-bad0-d877e3d25866 tempest-AttachVolumeTestJSON-1669838508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ad0ce486-51e9-4e31-bad0-d877e3d25866 tempest-AttachVolumeTestJSON-1669838508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:19:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ad0ce486-51e9-4e31-bad0-d877e3d25866 tempest-AttachVolumeTestJSON-1669838508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:19:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad0ce486-51e9-4e31-bad0-d877e3d25866 tempest-AttachVolumeTestJSON-1669838508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ad0ce486-51e9-4e31-bad0-d877e3d25866 tempest-AttachVolumeTestJSON-1669838508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:48 devstack sudo[94624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:19:48 devstack sudo[94624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:48 devstack sudo[94619]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-20b63b1d-c375-4d40-82bc-415c144e81ab tempest-VolumeQuotasAdminTestJSON-1496714528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-02a63cb2-8fcc-4801-9d7f-3a381bd5b04d" returned: 0 in 0.953s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-20b63b1d-c375-4d40-82bc-415c144e81ab tempest-VolumeQuotasAdminTestJSON-1496714528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-02a63cb2-8fcc-4801-9d7f-3a381bd5b04d {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:48 devstack sudo[94629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-02a63cb2-8fcc-4801-9d7f-3a381bd5b04d Jul 07 08:19:48 devstack sudo[94629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-bbca5b41-2052-47ab-8dd8-abeccfb7f14f tempest-AttachVolumeTestJSON-1669838508 None] Acquiring lock "cinder-b564ca67-15fa-4a97-9420-6868e009d50f-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:19:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-bbca5b41-2052-47ab-8dd8-abeccfb7f14f tempest-AttachVolumeTestJSON-1669838508 None] Lock "cinder-b564ca67-15fa-4a97-9420-6868e009d50f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:19:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-bbca5b41-2052-47ab-8dd8-abeccfb7f14f tempest-AttachVolumeTestJSON-1669838508 None] Acquiring lock "cinder-quobyte-b564ca67-15fa-4a97-9420-6868e009d50f" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:19:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-bbca5b41-2052-47ab-8dd8-abeccfb7f14f tempest-AttachVolumeTestJSON-1669838508 None] Lock "cinder-quobyte-b564ca67-15fa-4a97-9420-6868e009d50f" acquired by "delete_volume" :: waited 0.037s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:19:48 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd493b6-c771-4bc7-81b4-22af648af4d5]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:19:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bbca5b41-2052-47ab-8dd8-abeccfb7f14f tempest-AttachVolumeTestJSON-1669838508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b564ca67-15fa-4a97-9420-6868e009d50f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:48 devstack sudo[94621]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-256f8786-9cb9-4ed6-aaef-5ebb3553bea8 tempest-GroupsV320Test-1318617363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 1.050s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:48 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-256f8786-9cb9-4ed6-aaef-5ebb3553bea8 tempest-GroupsV320Test-1318617363 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:19:48 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-256f8786-9cb9-4ed6-aaef-5ebb3553bea8 tempest-GroupsV320Test-1318617363 None] Delete group completed successfully. Jul 07 08:19:48 devstack sudo[94632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b564ca67-15fa-4a97-9420-6868e009d50f Jul 07 08:19:48 devstack sudo[94632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:49 devstack sudo[94624]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ad0ce486-51e9-4e31-bad0-d877e3d25866 tempest-AttachVolumeTestJSON-1669838508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 1.025s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:49 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ad0ce486-51e9-4e31-bad0-d877e3d25866 tempest-AttachVolumeTestJSON-1669838508 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:19:49 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-ad0ce486-51e9-4e31-bad0-d877e3d25866 tempest-AttachVolumeTestJSON-1669838508 None] Deleted volume successfully. Jul 07 08:19:49 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ad0ce486-51e9-4e31-bad0-d877e3d25866 tempest-AttachVolumeTestJSON-1669838508 None] Lock "cinder-12708c7c-5787-4277-86f7-15f72b265be1-delete_volume" released by "delete_volume" :: held 2.941s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:19:49 devstack sudo[94629]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-20b63b1d-c375-4d40-82bc-415c144e81ab tempest-VolumeQuotasAdminTestJSON-1496714528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-02a63cb2-8fcc-4801-9d7f-3a381bd5b04d" returned: 0 in 1.007s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:49 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-20b63b1d-c375-4d40-82bc-415c144e81ab tempest-VolumeQuotasAdminTestJSON-1496714528 None] Lock "cinder-quobyte-02a63cb2-8fcc-4801-9d7f-3a381bd5b04d" released by "delete_volume" :: held 2.026s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:19:49 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-20b63b1d-c375-4d40-82bc-415c144e81ab tempest-VolumeQuotasAdminTestJSON-1496714528 None] Created reservations ['bfbde4c3-7ea0-4ed4-922e-cbc36057464b', '0b3fe0be-261c-422d-8a0c-ce19cd007a2f', '88874c3f-7345-4870-bf1b-122e3ca7c8c1', 'ffc5f551-9a5a-43e7-9bf0-5af757d9387b'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:19:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-20b63b1d-c375-4d40-82bc-415c144e81ab tempest-VolumeQuotasAdminTestJSON-1496714528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-20b63b1d-c375-4d40-82bc-415c144e81ab tempest-VolumeQuotasAdminTestJSON-1496714528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:49 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-20b63b1d-c375-4d40-82bc-415c144e81ab tempest-VolumeQuotasAdminTestJSON-1496714528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:19:49 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-20b63b1d-c375-4d40-82bc-415c144e81ab tempest-VolumeQuotasAdminTestJSON-1496714528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:19:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-20b63b1d-c375-4d40-82bc-415c144e81ab tempest-VolumeQuotasAdminTestJSON-1496714528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-20b63b1d-c375-4d40-82bc-415c144e81ab tempest-VolumeQuotasAdminTestJSON-1496714528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:49 devstack sudo[94636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:19:49 devstack sudo[94636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:49 devstack sudo[94632]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bbca5b41-2052-47ab-8dd8-abeccfb7f14f tempest-AttachVolumeTestJSON-1669838508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b564ca67-15fa-4a97-9420-6868e009d50f" returned: 0 in 1.132s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bbca5b41-2052-47ab-8dd8-abeccfb7f14f tempest-AttachVolumeTestJSON-1669838508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b564ca67-15fa-4a97-9420-6868e009d50f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:49 devstack sudo[94642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b564ca67-15fa-4a97-9420-6868e009d50f Jul 07 08:19:49 devstack sudo[94642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:50 devstack sudo[94636]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-20b63b1d-c375-4d40-82bc-415c144e81ab tempest-VolumeQuotasAdminTestJSON-1496714528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.897s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:50 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-20b63b1d-c375-4d40-82bc-415c144e81ab tempest-VolumeQuotasAdminTestJSON-1496714528 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:19:50 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-20b63b1d-c375-4d40-82bc-415c144e81ab tempest-VolumeQuotasAdminTestJSON-1496714528 None] Deleted volume successfully. Jul 07 08:19:50 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-20b63b1d-c375-4d40-82bc-415c144e81ab tempest-VolumeQuotasAdminTestJSON-1496714528 None] Lock "cinder-02a63cb2-8fcc-4801-9d7f-3a381bd5b04d-delete_volume" released by "delete_volume" :: held 3.230s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:19:50 devstack sudo[94642]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bbca5b41-2052-47ab-8dd8-abeccfb7f14f tempest-AttachVolumeTestJSON-1669838508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b564ca67-15fa-4a97-9420-6868e009d50f" returned: 0 in 0.755s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:50 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-bbca5b41-2052-47ab-8dd8-abeccfb7f14f tempest-AttachVolumeTestJSON-1669838508 None] Lock "cinder-quobyte-b564ca67-15fa-4a97-9420-6868e009d50f" released by "delete_volume" :: held 1.955s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:19:50 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-bbca5b41-2052-47ab-8dd8-abeccfb7f14f tempest-AttachVolumeTestJSON-1669838508 None] Created reservations ['bd5b6fbc-6e5b-4baa-b8c9-dccf09eb830d', '6309645c-2365-4f88-baab-9fe7e533af74', '235c654d-ff2e-4b91-8c3a-90f173643e54', '9b58e7dd-3d1e-417c-9f5c-03feebfe6a0e'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:19:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-bbca5b41-2052-47ab-8dd8-abeccfb7f14f tempest-AttachVolumeTestJSON-1669838508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-bbca5b41-2052-47ab-8dd8-abeccfb7f14f tempest-AttachVolumeTestJSON-1669838508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:50 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-bbca5b41-2052-47ab-8dd8-abeccfb7f14f tempest-AttachVolumeTestJSON-1669838508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:19:50 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-bbca5b41-2052-47ab-8dd8-abeccfb7f14f tempest-AttachVolumeTestJSON-1669838508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:19:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-bbca5b41-2052-47ab-8dd8-abeccfb7f14f tempest-AttachVolumeTestJSON-1669838508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bbca5b41-2052-47ab-8dd8-abeccfb7f14f tempest-AttachVolumeTestJSON-1669838508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:50 devstack sudo[94647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:19:50 devstack sudo[94647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:51 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-09384cbc-3e42-408d-9a7c-c58cab8aa9ac tempest-VolumeQuotasAdminTestJSON-1496714528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:19:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-09384cbc-3e42-408d-9a7c-c58cab8aa9ac tempest-VolumeQuotasAdminTestJSON-1496714528 None] Flow 'volume_create_manager' (d91c0103-c479-4cae-9a19-5e287be874eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:19:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-09384cbc-3e42-408d-9a7c-c58cab8aa9ac tempest-VolumeQuotasAdminTestJSON-1496714528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ff26640-6192-40bf-bfbf-105a246ebf90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-09384cbc-3e42-408d-9a7c-c58cab8aa9ac tempest-VolumeQuotasAdminTestJSON-1496714528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ff26640-6192-40bf-bfbf-105a246ebf90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:19:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1496637258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0f62752-b422-43e3-94a8-eaa59d79f8b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc2fa13679c84ff8b036db976825734a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:19:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:19:51Z,use_quota=True,user_id='bc93358a08c9490b8ca171934862f1c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-09384cbc-3e42-408d-9a7c-c58cab8aa9ac tempest-VolumeQuotasAdminTestJSON-1496714528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d32cc96f-9733-44c8-a210-6b8fd5b57911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-09384cbc-3e42-408d-9a7c-c58cab8aa9ac tempest-VolumeQuotasAdminTestJSON-1496714528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d32cc96f-9733-44c8-a210-6b8fd5b57911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-09384cbc-3e42-408d-9a7c-c58cab8aa9ac tempest-VolumeQuotasAdminTestJSON-1496714528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9206c306-5e3c-469a-9e34-449c2ca88ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-09384cbc-3e42-408d-9a7c-c58cab8aa9ac tempest-VolumeQuotasAdminTestJSON-1496714528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9206c306-5e3c-469a-9e34-449c2ca88ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0f62752-b422-43e3-94a8-eaa59d79f8b2', 'volume_name': 'volume-b0f62752-b422-43e3-94a8-eaa59d79f8b2', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-09384cbc-3e42-408d-9a7c-c58cab8aa9ac tempest-VolumeQuotasAdminTestJSON-1496714528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88768b20-5629-4c2b-9c86-8c94fff313e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-09384cbc-3e42-408d-9a7c-c58cab8aa9ac tempest-VolumeQuotasAdminTestJSON-1496714528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88768b20-5629-4c2b-9c86-8c94fff313e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-09384cbc-3e42-408d-9a7c-c58cab8aa9ac tempest-VolumeQuotasAdminTestJSON-1496714528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e71f4b3-ee2a-4300-b93f-5b0402ba16d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:51 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-09384cbc-3e42-408d-9a7c-c58cab8aa9ac tempest-VolumeQuotasAdminTestJSON-1496714528 None] Volume b0f62752-b422-43e3-94a8-eaa59d79f8b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0f62752-b422-43e3-94a8-eaa59d79f8b2', 'volume_size': 1} Jul 07 08:19:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-09384cbc-3e42-408d-9a7c-c58cab8aa9ac tempest-VolumeQuotasAdminTestJSON-1496714528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-09384cbc-3e42-408d-9a7c-c58cab8aa9ac tempest-VolumeQuotasAdminTestJSON-1496714528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:51 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-09384cbc-3e42-408d-9a7c-c58cab8aa9ac tempest-VolumeQuotasAdminTestJSON-1496714528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:19:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1496637258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0f62752-b422-43e3-94a8-eaa59d79f8b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc2fa13679c84ff8b036db976825734a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:19:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:19:51Z,use_quota=True,user_id='bc93358a08c9490b8ca171934862f1c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:19:51 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-09384cbc-3e42-408d-9a7c-c58cab8aa9ac tempest-VolumeQuotasAdminTestJSON-1496714528 None] Creating volume b0f62752-b422-43e3-94a8-eaa59d79f8b2 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:19:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-09384cbc-3e42-408d-9a7c-c58cab8aa9ac tempest-VolumeQuotasAdminTestJSON-1496714528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-09384cbc-3e42-408d-9a7c-c58cab8aa9ac tempest-VolumeQuotasAdminTestJSON-1496714528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:51 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-09384cbc-3e42-408d-9a7c-c58cab8aa9ac tempest-VolumeQuotasAdminTestJSON-1496714528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:19:51 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-09384cbc-3e42-408d-9a7c-c58cab8aa9ac tempest-VolumeQuotasAdminTestJSON-1496714528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:19:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-09384cbc-3e42-408d-9a7c-c58cab8aa9ac tempest-VolumeQuotasAdminTestJSON-1496714528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:51 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-09384cbc-3e42-408d-9a7c-c58cab8aa9ac tempest-VolumeQuotasAdminTestJSON-1496714528 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:19:51 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-09384cbc-3e42-408d-9a7c-c58cab8aa9ac tempest-VolumeQuotasAdminTestJSON-1496714528 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:19:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-09384cbc-3e42-408d-9a7c-c58cab8aa9ac tempest-VolumeQuotasAdminTestJSON-1496714528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b0f62752-b422-43e3-94a8-eaa59d79f8b2 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:51 devstack sudo[94649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b0f62752-b422-43e3-94a8-eaa59d79f8b2 1073741824 Jul 07 08:19:51 devstack sudo[94649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:51 devstack sudo[94647]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bbca5b41-2052-47ab-8dd8-abeccfb7f14f tempest-AttachVolumeTestJSON-1669838508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.885s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:51 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-bbca5b41-2052-47ab-8dd8-abeccfb7f14f tempest-AttachVolumeTestJSON-1669838508 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:19:51 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-bbca5b41-2052-47ab-8dd8-abeccfb7f14f tempest-AttachVolumeTestJSON-1669838508 None] Deleted volume successfully. Jul 07 08:19:51 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-bbca5b41-2052-47ab-8dd8-abeccfb7f14f tempest-AttachVolumeTestJSON-1669838508 None] Lock "cinder-b564ca67-15fa-4a97-9420-6868e009d50f-delete_volume" released by "delete_volume" :: held 3.275s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:19:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-355113b1-e8b1-495f-914b-498751493880 tempest-AttachVolumeTestJSON-1669838508 None] Acquiring lock "cinder-61b57946-83d4-4109-a18a-c1c7ba193ff0-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:19:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-355113b1-e8b1-495f-914b-498751493880 tempest-AttachVolumeTestJSON-1669838508 None] Lock "cinder-61b57946-83d4-4109-a18a-c1c7ba193ff0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:19:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-355113b1-e8b1-495f-914b-498751493880 tempest-AttachVolumeTestJSON-1669838508 None] Acquiring lock "cinder-quobyte-61b57946-83d4-4109-a18a-c1c7ba193ff0" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:19:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-355113b1-e8b1-495f-914b-498751493880 tempest-AttachVolumeTestJSON-1669838508 None] Lock "cinder-quobyte-61b57946-83d4-4109-a18a-c1c7ba193ff0" acquired by "delete_volume" :: waited 0.035s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:19:52 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7e4a5f-07f2-44d9-8130-aae9855797ad]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:19:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-355113b1-e8b1-495f-914b-498751493880 tempest-AttachVolumeTestJSON-1669838508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61b57946-83d4-4109-a18a-c1c7ba193ff0 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:52 devstack sudo[94655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61b57946-83d4-4109-a18a-c1c7ba193ff0 Jul 07 08:19:52 devstack sudo[94655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:52 devstack sudo[94649]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-09384cbc-3e42-408d-9a7c-c58cab8aa9ac tempest-VolumeQuotasAdminTestJSON-1496714528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b0f62752-b422-43e3-94a8-eaa59d79f8b2 1073741824" returned: 0 in 1.127s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-09384cbc-3e42-408d-9a7c-c58cab8aa9ac tempest-VolumeQuotasAdminTestJSON-1496714528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b0f62752-b422-43e3-94a8-eaa59d79f8b2 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:52 devstack sudo[94658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b0f62752-b422-43e3-94a8-eaa59d79f8b2 Jul 07 08:19:52 devstack sudo[94658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:53 devstack sudo[94655]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-355113b1-e8b1-495f-914b-498751493880 tempest-AttachVolumeTestJSON-1669838508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61b57946-83d4-4109-a18a-c1c7ba193ff0" returned: 0 in 0.928s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-355113b1-e8b1-495f-914b-498751493880 tempest-AttachVolumeTestJSON-1669838508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61b57946-83d4-4109-a18a-c1c7ba193ff0 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:53 devstack sudo[94664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61b57946-83d4-4109-a18a-c1c7ba193ff0 Jul 07 08:19:53 devstack sudo[94664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:53 devstack sudo[94658]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-09384cbc-3e42-408d-9a7c-c58cab8aa9ac tempest-VolumeQuotasAdminTestJSON-1496714528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b0f62752-b422-43e3-94a8-eaa59d79f8b2" returned: 0 in 0.808s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:53 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-09384cbc-3e42-408d-9a7c-c58cab8aa9ac tempest-VolumeQuotasAdminTestJSON-1496714528 None] <== create_volume: return (1992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:19:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-09384cbc-3e42-408d-9a7c-c58cab8aa9ac tempest-VolumeQuotasAdminTestJSON-1496714528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.995s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:53 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-09384cbc-3e42-408d-9a7c-c58cab8aa9ac tempest-VolumeQuotasAdminTestJSON-1496714528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e71f4b3-ee2a-4300-b93f-5b0402ba16d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0f62752-b422-43e3-94a8-eaa59d79f8b2', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:53 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-09384cbc-3e42-408d-9a7c-c58cab8aa9ac tempest-VolumeQuotasAdminTestJSON-1496714528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf79f9d4-d9f5-46c4-86c1-598ff7a87c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:53 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-09384cbc-3e42-408d-9a7c-c58cab8aa9ac tempest-VolumeQuotasAdminTestJSON-1496714528 None] Volume volume-b0f62752-b422-43e3-94a8-eaa59d79f8b2 (b0f62752-b422-43e3-94a8-eaa59d79f8b2): created successfully Jul 07 08:19:53 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-09384cbc-3e42-408d-9a7c-c58cab8aa9ac tempest-VolumeQuotasAdminTestJSON-1496714528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf79f9d4-d9f5-46c4-86c1-598ff7a87c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:53 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-09384cbc-3e42-408d-9a7c-c58cab8aa9ac tempest-VolumeQuotasAdminTestJSON-1496714528 None] Flow 'volume_create_manager' (d91c0103-c479-4cae-9a19-5e287be874eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:19:53 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-09384cbc-3e42-408d-9a7c-c58cab8aa9ac tempest-VolumeQuotasAdminTestJSON-1496714528 None] Created volume successfully. Jul 07 08:19:53 devstack sudo[94664]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-355113b1-e8b1-495f-914b-498751493880 tempest-AttachVolumeTestJSON-1669838508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61b57946-83d4-4109-a18a-c1c7ba193ff0" returned: 0 in 0.764s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:53 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-355113b1-e8b1-495f-914b-498751493880 tempest-AttachVolumeTestJSON-1669838508 None] Lock "cinder-quobyte-61b57946-83d4-4109-a18a-c1c7ba193ff0" released by "delete_volume" :: held 1.751s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:19:53 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-355113b1-e8b1-495f-914b-498751493880 tempest-AttachVolumeTestJSON-1669838508 None] Created reservations ['8ba6a57a-2263-4cfc-a67c-f31abdb42264', 'e4123f42-fb61-4cd2-ad41-ab2ae08c2313', '1dbfd238-32d8-40f0-a0f6-478ffd60d09f', '32609a3b-603c-420e-a6ef-6d096b408ae8'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:19:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-355113b1-e8b1-495f-914b-498751493880 tempest-AttachVolumeTestJSON-1669838508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-355113b1-e8b1-495f-914b-498751493880 tempest-AttachVolumeTestJSON-1669838508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:53 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-355113b1-e8b1-495f-914b-498751493880 tempest-AttachVolumeTestJSON-1669838508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:19:53 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-355113b1-e8b1-495f-914b-498751493880 tempest-AttachVolumeTestJSON-1669838508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:19:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-355113b1-e8b1-495f-914b-498751493880 tempest-AttachVolumeTestJSON-1669838508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-355113b1-e8b1-495f-914b-498751493880 tempest-AttachVolumeTestJSON-1669838508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:54 devstack sudo[94668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:19:54 devstack sudo[94668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:54 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-03813248-6a86-48b7-a8c9-bdae769902ac tempest-VolumesListAdminTestJSON-881565996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:19:54 devstack sudo[94668]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-03813248-6a86-48b7-a8c9-bdae769902ac tempest-VolumesListAdminTestJSON-881565996 None] Flow 'volume_create_manager' (bc87a7af-1de7-426b-a421-b94837bc8473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:19:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-03813248-6a86-48b7-a8c9-bdae769902ac tempest-VolumesListAdminTestJSON-881565996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5af65d0b-4259-4e07-adf3-5898397420c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-355113b1-e8b1-495f-914b-498751493880 tempest-AttachVolumeTestJSON-1669838508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.849s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:54 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-355113b1-e8b1-495f-914b-498751493880 tempest-AttachVolumeTestJSON-1669838508 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:19:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-03813248-6a86-48b7-a8c9-bdae769902ac tempest-VolumesListAdminTestJSON-881565996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5af65d0b-4259-4e07-adf3-5898397420c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1309542966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4669b647-d88e-44af-a6b5-1696e6d934a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb7bd4d38a944491a38513200f94e146',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:19:55Z,use_quota=True,user_id='1001895bf0e44456b07961b0308ac0a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-03813248-6a86-48b7-a8c9-bdae769902ac tempest-VolumesListAdminTestJSON-881565996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1241a5b-a40e-4701-a1ee-0084573401d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-03813248-6a86-48b7-a8c9-bdae769902ac tempest-VolumesListAdminTestJSON-881565996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1241a5b-a40e-4701-a1ee-0084573401d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-03813248-6a86-48b7-a8c9-bdae769902ac tempest-VolumesListAdminTestJSON-881565996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cd4a912-bedc-4987-8539-832991f3a862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-03813248-6a86-48b7-a8c9-bdae769902ac tempest-VolumesListAdminTestJSON-881565996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cd4a912-bedc-4987-8539-832991f3a862) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4669b647-d88e-44af-a6b5-1696e6d934a9', 'volume_name': 'volume-4669b647-d88e-44af-a6b5-1696e6d934a9', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-03813248-6a86-48b7-a8c9-bdae769902ac tempest-VolumesListAdminTestJSON-881565996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1e5da1d-b88b-4d73-856b-3b8fe927b53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-03813248-6a86-48b7-a8c9-bdae769902ac tempest-VolumesListAdminTestJSON-881565996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1e5da1d-b88b-4d73-856b-3b8fe927b53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-03813248-6a86-48b7-a8c9-bdae769902ac tempest-VolumesListAdminTestJSON-881565996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dea9ee7-f9c5-4496-a8fe-41edc010276d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:54 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-03813248-6a86-48b7-a8c9-bdae769902ac tempest-VolumesListAdminTestJSON-881565996 None] Volume 4669b647-d88e-44af-a6b5-1696e6d934a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4669b647-d88e-44af-a6b5-1696e6d934a9', 'volume_size': 1} Jul 07 08:19:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-03813248-6a86-48b7-a8c9-bdae769902ac tempest-VolumesListAdminTestJSON-881565996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-03813248-6a86-48b7-a8c9-bdae769902ac tempest-VolumesListAdminTestJSON-881565996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:54 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-03813248-6a86-48b7-a8c9-bdae769902ac tempest-VolumesListAdminTestJSON-881565996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1309542966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4669b647-d88e-44af-a6b5-1696e6d934a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb7bd4d38a944491a38513200f94e146',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:19:55Z,use_quota=True,user_id='1001895bf0e44456b07961b0308ac0a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:19:54 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-03813248-6a86-48b7-a8c9-bdae769902ac tempest-VolumesListAdminTestJSON-881565996 None] Creating volume 4669b647-d88e-44af-a6b5-1696e6d934a9 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:19:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-03813248-6a86-48b7-a8c9-bdae769902ac tempest-VolumesListAdminTestJSON-881565996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-03813248-6a86-48b7-a8c9-bdae769902ac tempest-VolumesListAdminTestJSON-881565996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:54 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-03813248-6a86-48b7-a8c9-bdae769902ac tempest-VolumesListAdminTestJSON-881565996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:19:54 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-03813248-6a86-48b7-a8c9-bdae769902ac tempest-VolumesListAdminTestJSON-881565996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:19:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-03813248-6a86-48b7-a8c9-bdae769902ac tempest-VolumesListAdminTestJSON-881565996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:54 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-03813248-6a86-48b7-a8c9-bdae769902ac tempest-VolumesListAdminTestJSON-881565996 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:19:54 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-03813248-6a86-48b7-a8c9-bdae769902ac tempest-VolumesListAdminTestJSON-881565996 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:19:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-03813248-6a86-48b7-a8c9-bdae769902ac tempest-VolumesListAdminTestJSON-881565996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4669b647-d88e-44af-a6b5-1696e6d934a9 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:54 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-355113b1-e8b1-495f-914b-498751493880 tempest-AttachVolumeTestJSON-1669838508 None] Deleted volume successfully. Jul 07 08:19:54 devstack sudo[94671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4669b647-d88e-44af-a6b5-1696e6d934a9 1073741824 Jul 07 08:19:54 devstack sudo[94671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:54 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-355113b1-e8b1-495f-914b-498751493880 tempest-AttachVolumeTestJSON-1669838508 None] Lock "cinder-61b57946-83d4-4109-a18a-c1c7ba193ff0-delete_volume" released by "delete_volume" :: held 2.956s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:19:55 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-94b3d6fb-e83f-4b1a-ad89-b8686339ac05 tempest-VolumeQuotasAdminTestJSON-1740748459 None] Transfer volume completed successfully. Jul 07 08:19:55 devstack sudo[94671]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-03813248-6a86-48b7-a8c9-bdae769902ac tempest-VolumesListAdminTestJSON-881565996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4669b647-d88e-44af-a6b5-1696e6d934a9 1073741824" returned: 0 in 1.036s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:55 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-f186e1c4-ebd9-4c38-b393-1ba3ebe539d6 tempest-VolumeQuotasNegativeTestJSON-1940531890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:19:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f186e1c4-ebd9-4c38-b393-1ba3ebe539d6 tempest-VolumeQuotasNegativeTestJSON-1940531890 None] Flow 'volume_create_manager' (b6b64c4b-12ac-46b2-8128-a41262a8b723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:19:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f186e1c4-ebd9-4c38-b393-1ba3ebe539d6 tempest-VolumeQuotasNegativeTestJSON-1940531890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c81b67b0-a69d-40e5-ab66-68c5f1b19496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f186e1c4-ebd9-4c38-b393-1ba3ebe539d6 tempest-VolumeQuotasNegativeTestJSON-1940531890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c81b67b0-a69d-40e5-ab66-68c5f1b19496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1666964681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccf9e854-81cc-4117-b851-7454f965c630,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2491f9b37205468a8c67986bb924a30b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:19:56Z,use_quota=True,user_id='362cde633c3b4eee88846cef313b1d74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f186e1c4-ebd9-4c38-b393-1ba3ebe539d6 tempest-VolumeQuotasNegativeTestJSON-1940531890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea7e6386-a169-4491-91e3-4d4a913a1d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f186e1c4-ebd9-4c38-b393-1ba3ebe539d6 tempest-VolumeQuotasNegativeTestJSON-1940531890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea7e6386-a169-4491-91e3-4d4a913a1d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f186e1c4-ebd9-4c38-b393-1ba3ebe539d6 tempest-VolumeQuotasNegativeTestJSON-1940531890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1148c378-671f-4024-959f-5f747934db82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f186e1c4-ebd9-4c38-b393-1ba3ebe539d6 tempest-VolumeQuotasNegativeTestJSON-1940531890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1148c378-671f-4024-959f-5f747934db82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccf9e854-81cc-4117-b851-7454f965c630', 'volume_name': 'volume-ccf9e854-81cc-4117-b851-7454f965c630', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f186e1c4-ebd9-4c38-b393-1ba3ebe539d6 tempest-VolumeQuotasNegativeTestJSON-1940531890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ad1624f-ea40-4bdd-affa-5f29d5375b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f186e1c4-ebd9-4c38-b393-1ba3ebe539d6 tempest-VolumeQuotasNegativeTestJSON-1940531890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ad1624f-ea40-4bdd-affa-5f29d5375b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f186e1c4-ebd9-4c38-b393-1ba3ebe539d6 tempest-VolumeQuotasNegativeTestJSON-1940531890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc71fff5-c4fe-4d37-8295-907cdcea4278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:56 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-f186e1c4-ebd9-4c38-b393-1ba3ebe539d6 tempest-VolumeQuotasNegativeTestJSON-1940531890 None] Volume ccf9e854-81cc-4117-b851-7454f965c630: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccf9e854-81cc-4117-b851-7454f965c630', 'volume_size': 1} Jul 07 08:19:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f186e1c4-ebd9-4c38-b393-1ba3ebe539d6 tempest-VolumeQuotasNegativeTestJSON-1940531890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-03813248-6a86-48b7-a8c9-bdae769902ac tempest-VolumesListAdminTestJSON-881565996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4669b647-d88e-44af-a6b5-1696e6d934a9 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:56 devstack sudo[94677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4669b647-d88e-44af-a6b5-1696e6d934a9 Jul 07 08:19:56 devstack sudo[94677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0d545f50-708e-4137-96e8-f1fac127b1f4 tempest-VolumeQuotasAdminTestJSON-391565385 None] Acquiring lock "cinder-b0f62752-b422-43e3-94a8-eaa59d79f8b2-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:19:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0d545f50-708e-4137-96e8-f1fac127b1f4 tempest-VolumeQuotasAdminTestJSON-391565385 None] Lock "cinder-b0f62752-b422-43e3-94a8-eaa59d79f8b2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:19:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0d545f50-708e-4137-96e8-f1fac127b1f4 tempest-VolumeQuotasAdminTestJSON-391565385 None] Acquiring lock "cinder-quobyte-b0f62752-b422-43e3-94a8-eaa59d79f8b2" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:19:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0d545f50-708e-4137-96e8-f1fac127b1f4 tempest-VolumeQuotasAdminTestJSON-391565385 None] Lock "cinder-quobyte-b0f62752-b422-43e3-94a8-eaa59d79f8b2" acquired by "delete_volume" :: waited 0.025s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:19:56 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d39d66-f892-4262-947f-5707f7f2160c]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:19:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0d545f50-708e-4137-96e8-f1fac127b1f4 tempest-VolumeQuotasAdminTestJSON-391565385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b0f62752-b422-43e3-94a8-eaa59d79f8b2 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:56 devstack sudo[94677]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-03813248-6a86-48b7-a8c9-bdae769902ac tempest-VolumesListAdminTestJSON-881565996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4669b647-d88e-44af-a6b5-1696e6d934a9" returned: 0 in 0.727s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-03813248-6a86-48b7-a8c9-bdae769902ac tempest-VolumesListAdminTestJSON-881565996 None] <== create_volume: return (1881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:19:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-03813248-6a86-48b7-a8c9-bdae769902ac tempest-VolumesListAdminTestJSON-881565996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.884s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f186e1c4-ebd9-4c38-b393-1ba3ebe539d6 tempest-VolumeQuotasNegativeTestJSON-1940531890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.747s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f186e1c4-ebd9-4c38-b393-1ba3ebe539d6 tempest-VolumeQuotasNegativeTestJSON-1940531890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1666964681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccf9e854-81cc-4117-b851-7454f965c630,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2491f9b37205468a8c67986bb924a30b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:19:56Z,use_quota=True,user_id='362cde633c3b4eee88846cef313b1d74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:19:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-f186e1c4-ebd9-4c38-b393-1ba3ebe539d6 tempest-VolumeQuotasNegativeTestJSON-1940531890 None] Creating volume ccf9e854-81cc-4117-b851-7454f965c630 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:19:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f186e1c4-ebd9-4c38-b393-1ba3ebe539d6 tempest-VolumeQuotasNegativeTestJSON-1940531890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f186e1c4-ebd9-4c38-b393-1ba3ebe539d6 tempest-VolumeQuotasNegativeTestJSON-1940531890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f186e1c4-ebd9-4c38-b393-1ba3ebe539d6 tempest-VolumeQuotasNegativeTestJSON-1940531890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:19:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f186e1c4-ebd9-4c38-b393-1ba3ebe539d6 tempest-VolumeQuotasNegativeTestJSON-1940531890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:19:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f186e1c4-ebd9-4c38-b393-1ba3ebe539d6 tempest-VolumeQuotasNegativeTestJSON-1940531890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f186e1c4-ebd9-4c38-b393-1ba3ebe539d6 tempest-VolumeQuotasNegativeTestJSON-1940531890 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:19:56 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-f186e1c4-ebd9-4c38-b393-1ba3ebe539d6 tempest-VolumeQuotasNegativeTestJSON-1940531890 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:19:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f186e1c4-ebd9-4c38-b393-1ba3ebe539d6 tempest-VolumeQuotasNegativeTestJSON-1940531890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ccf9e854-81cc-4117-b851-7454f965c630 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:56 devstack sudo[94681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b0f62752-b422-43e3-94a8-eaa59d79f8b2 Jul 07 08:19:56 devstack sudo[94681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-03813248-6a86-48b7-a8c9-bdae769902ac tempest-VolumesListAdminTestJSON-881565996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dea9ee7-f9c5-4496-a8fe-41edc010276d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4669b647-d88e-44af-a6b5-1696e6d934a9', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:56 devstack sudo[94682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ccf9e854-81cc-4117-b851-7454f965c630 1073741824 Jul 07 08:19:56 devstack sudo[94682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-03813248-6a86-48b7-a8c9-bdae769902ac tempest-VolumesListAdminTestJSON-881565996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2333e53-dfa4-4e1d-b2c7-75183823cd95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:56 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-03813248-6a86-48b7-a8c9-bdae769902ac tempest-VolumesListAdminTestJSON-881565996 None] Volume volume-4669b647-d88e-44af-a6b5-1696e6d934a9 (4669b647-d88e-44af-a6b5-1696e6d934a9): created successfully Jul 07 08:19:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-03813248-6a86-48b7-a8c9-bdae769902ac tempest-VolumesListAdminTestJSON-881565996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2333e53-dfa4-4e1d-b2c7-75183823cd95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-03813248-6a86-48b7-a8c9-bdae769902ac tempest-VolumesListAdminTestJSON-881565996 None] Flow 'volume_create_manager' (bc87a7af-1de7-426b-a421-b94837bc8473) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:19:56 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-03813248-6a86-48b7-a8c9-bdae769902ac tempest-VolumesListAdminTestJSON-881565996 None] Created volume successfully. Jul 07 08:19:57 devstack sudo[94681]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0d545f50-708e-4137-96e8-f1fac127b1f4 tempest-VolumeQuotasAdminTestJSON-391565385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b0f62752-b422-43e3-94a8-eaa59d79f8b2" returned: 0 in 0.922s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0d545f50-708e-4137-96e8-f1fac127b1f4 tempest-VolumeQuotasAdminTestJSON-391565385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b0f62752-b422-43e3-94a8-eaa59d79f8b2 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:57 devstack sudo[94691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b0f62752-b422-43e3-94a8-eaa59d79f8b2 Jul 07 08:19:57 devstack sudo[94691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:57 devstack sudo[94682]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f186e1c4-ebd9-4c38-b393-1ba3ebe539d6 tempest-VolumeQuotasNegativeTestJSON-1940531890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ccf9e854-81cc-4117-b851-7454f965c630 1073741824" returned: 0 in 1.060s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f186e1c4-ebd9-4c38-b393-1ba3ebe539d6 tempest-VolumeQuotasNegativeTestJSON-1940531890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ccf9e854-81cc-4117-b851-7454f965c630 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:57 devstack sudo[94693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ccf9e854-81cc-4117-b851-7454f965c630 Jul 07 08:19:57 devstack sudo[94693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:58 devstack sudo[94691]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0d545f50-708e-4137-96e8-f1fac127b1f4 tempest-VolumeQuotasAdminTestJSON-391565385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b0f62752-b422-43e3-94a8-eaa59d79f8b2" returned: 0 in 0.810s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:58 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0d545f50-708e-4137-96e8-f1fac127b1f4 tempest-VolumeQuotasAdminTestJSON-391565385 None] Lock "cinder-quobyte-b0f62752-b422-43e3-94a8-eaa59d79f8b2" released by "delete_volume" :: held 1.785s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:19:58 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-0d545f50-708e-4137-96e8-f1fac127b1f4 tempest-VolumeQuotasAdminTestJSON-391565385 None] Created reservations ['97145e09-bbda-445b-b414-1de36fc48e30', '0e52e557-162a-445c-9f49-784bdac1975b', '77da0715-32e4-4ff9-965c-cc4fec81f987', '53cc39f7-5c4f-4636-b1f8-2ac85226faac'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:19:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0d545f50-708e-4137-96e8-f1fac127b1f4 tempest-VolumeQuotasAdminTestJSON-391565385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0d545f50-708e-4137-96e8-f1fac127b1f4 tempest-VolumeQuotasAdminTestJSON-391565385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-0d545f50-708e-4137-96e8-f1fac127b1f4 tempest-VolumeQuotasAdminTestJSON-391565385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:19:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-0d545f50-708e-4137-96e8-f1fac127b1f4 tempest-VolumeQuotasAdminTestJSON-391565385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:19:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0d545f50-708e-4137-96e8-f1fac127b1f4 tempest-VolumeQuotasAdminTestJSON-391565385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0d545f50-708e-4137-96e8-f1fac127b1f4 tempest-VolumeQuotasAdminTestJSON-391565385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:58 devstack sudo[94699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:19:58 devstack sudo[94699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:58 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2431c12-be7d-436e-8370-afdffb939772 tempest-VolumesListAdminTestJSON-881565996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:19:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d2431c12-be7d-436e-8370-afdffb939772 tempest-VolumesListAdminTestJSON-881565996 None] Flow 'volume_create_manager' (b7f58963-5994-4206-9117-38ff9e480a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:19:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d2431c12-be7d-436e-8370-afdffb939772 tempest-VolumesListAdminTestJSON-881565996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa586af2-4427-4cee-bbe7-a5ce3f30d23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:58 devstack sudo[94693]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f186e1c4-ebd9-4c38-b393-1ba3ebe539d6 tempest-VolumeQuotasNegativeTestJSON-1940531890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ccf9e854-81cc-4117-b851-7454f965c630" returned: 0 in 0.996s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f186e1c4-ebd9-4c38-b393-1ba3ebe539d6 tempest-VolumeQuotasNegativeTestJSON-1940531890 None] <== create_volume: return (2119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:19:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f186e1c4-ebd9-4c38-b393-1ba3ebe539d6 tempest-VolumeQuotasNegativeTestJSON-1940531890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.126s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d2431c12-be7d-436e-8370-afdffb939772 tempest-VolumesListAdminTestJSON-881565996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa586af2-4427-4cee-bbe7-a5ce3f30d23c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1045258696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=782cfbe1-6bf4-4c51-9346-58e66a2ee0e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb7bd4d38a944491a38513200f94e146',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:19:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:19:59Z,use_quota=True,user_id='1001895bf0e44456b07961b0308ac0a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d2431c12-be7d-436e-8370-afdffb939772 tempest-VolumesListAdminTestJSON-881565996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d79b0020-51e8-45f0-9f3b-95fc8768cc88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d2431c12-be7d-436e-8370-afdffb939772 tempest-VolumesListAdminTestJSON-881565996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d79b0020-51e8-45f0-9f3b-95fc8768cc88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d2431c12-be7d-436e-8370-afdffb939772 tempest-VolumesListAdminTestJSON-881565996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (549f994f-3057-47a9-bd0d-5ac2bb52f774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d2431c12-be7d-436e-8370-afdffb939772 tempest-VolumesListAdminTestJSON-881565996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (549f994f-3057-47a9-bd0d-5ac2bb52f774) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '782cfbe1-6bf4-4c51-9346-58e66a2ee0e4', 'volume_name': 'volume-782cfbe1-6bf4-4c51-9346-58e66a2ee0e4', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d2431c12-be7d-436e-8370-afdffb939772 tempest-VolumesListAdminTestJSON-881565996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7188286f-fd67-4377-914c-2a7a2b7b865f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d2431c12-be7d-436e-8370-afdffb939772 tempest-VolumesListAdminTestJSON-881565996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7188286f-fd67-4377-914c-2a7a2b7b865f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d2431c12-be7d-436e-8370-afdffb939772 tempest-VolumesListAdminTestJSON-881565996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47c7951d-b97d-41ec-aff2-8f884f2d35db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:59 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-d2431c12-be7d-436e-8370-afdffb939772 tempest-VolumesListAdminTestJSON-881565996 None] Volume 782cfbe1-6bf4-4c51-9346-58e66a2ee0e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-782cfbe1-6bf4-4c51-9346-58e66a2ee0e4', 'volume_size': 1} Jul 07 08:19:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d2431c12-be7d-436e-8370-afdffb939772 tempest-VolumesListAdminTestJSON-881565996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d2431c12-be7d-436e-8370-afdffb939772 tempest-VolumesListAdminTestJSON-881565996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:59 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d2431c12-be7d-436e-8370-afdffb939772 tempest-VolumesListAdminTestJSON-881565996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1045258696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=782cfbe1-6bf4-4c51-9346-58e66a2ee0e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb7bd4d38a944491a38513200f94e146',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:19:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:19:59Z,use_quota=True,user_id='1001895bf0e44456b07961b0308ac0a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:19:59 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-d2431c12-be7d-436e-8370-afdffb939772 tempest-VolumesListAdminTestJSON-881565996 None] Creating volume 782cfbe1-6bf4-4c51-9346-58e66a2ee0e4 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:19:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d2431c12-be7d-436e-8370-afdffb939772 tempest-VolumesListAdminTestJSON-881565996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d2431c12-be7d-436e-8370-afdffb939772 tempest-VolumesListAdminTestJSON-881565996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:59 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d2431c12-be7d-436e-8370-afdffb939772 tempest-VolumesListAdminTestJSON-881565996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:19:59 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d2431c12-be7d-436e-8370-afdffb939772 tempest-VolumesListAdminTestJSON-881565996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:19:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d2431c12-be7d-436e-8370-afdffb939772 tempest-VolumesListAdminTestJSON-881565996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:59 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d2431c12-be7d-436e-8370-afdffb939772 tempest-VolumesListAdminTestJSON-881565996 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:19:59 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-d2431c12-be7d-436e-8370-afdffb939772 tempest-VolumesListAdminTestJSON-881565996 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:19:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d2431c12-be7d-436e-8370-afdffb939772 tempest-VolumesListAdminTestJSON-881565996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-782cfbe1-6bf4-4c51-9346-58e66a2ee0e4 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f186e1c4-ebd9-4c38-b393-1ba3ebe539d6 tempest-VolumeQuotasNegativeTestJSON-1940531890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc71fff5-c4fe-4d37-8295-907cdcea4278) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccf9e854-81cc-4117-b851-7454f965c630', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f186e1c4-ebd9-4c38-b393-1ba3ebe539d6 tempest-VolumeQuotasNegativeTestJSON-1940531890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16515865-0a35-4775-bebf-ccd13b30094d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:59 devstack sudo[94701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-782cfbe1-6bf4-4c51-9346-58e66a2ee0e4 1073741824 Jul 07 08:19:59 devstack sudo[94701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:59 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-f186e1c4-ebd9-4c38-b393-1ba3ebe539d6 tempest-VolumeQuotasNegativeTestJSON-1940531890 None] Volume volume-ccf9e854-81cc-4117-b851-7454f965c630 (ccf9e854-81cc-4117-b851-7454f965c630): created successfully Jul 07 08:19:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f186e1c4-ebd9-4c38-b393-1ba3ebe539d6 tempest-VolumeQuotasNegativeTestJSON-1940531890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16515865-0a35-4775-bebf-ccd13b30094d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f186e1c4-ebd9-4c38-b393-1ba3ebe539d6 tempest-VolumeQuotasNegativeTestJSON-1940531890 None] Flow 'volume_create_manager' (b6b64c4b-12ac-46b2-8128-a41262a8b723) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:19:59 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-f186e1c4-ebd9-4c38-b393-1ba3ebe539d6 tempest-VolumeQuotasNegativeTestJSON-1940531890 None] Created volume successfully. Jul 07 08:19:59 devstack sudo[94699]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0d545f50-708e-4137-96e8-f1fac127b1f4 tempest-VolumeQuotasAdminTestJSON-391565385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.858s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:59 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-0d545f50-708e-4137-96e8-f1fac127b1f4 tempest-VolumeQuotasAdminTestJSON-391565385 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:19:59 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-0d545f50-708e-4137-96e8-f1fac127b1f4 tempest-VolumeQuotasAdminTestJSON-391565385 None] Deleted volume successfully. Jul 07 08:19:59 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0d545f50-708e-4137-96e8-f1fac127b1f4 tempest-VolumeQuotasAdminTestJSON-391565385 None] Lock "cinder-b0f62752-b422-43e3-94a8-eaa59d79f8b2-delete_volume" released by "delete_volume" :: held 2.993s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:20:00 devstack sudo[94701]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d2431c12-be7d-436e-8370-afdffb939772 tempest-VolumesListAdminTestJSON-881565996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-782cfbe1-6bf4-4c51-9346-58e66a2ee0e4 1073741824" returned: 0 in 1.336s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d2431c12-be7d-436e-8370-afdffb939772 tempest-VolumesListAdminTestJSON-881565996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-782cfbe1-6bf4-4c51-9346-58e66a2ee0e4 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:00 devstack sudo[94708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-782cfbe1-6bf4-4c51-9346-58e66a2ee0e4 Jul 07 08:20:00 devstack sudo[94708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:00 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-73e4f96e-5e7c-4032-9f82-4cedd64afd35 tempest-VolumeQuotasNegativeTestJSON-1940531890 None] Acquiring lock "cinder-ccf9e854-81cc-4117-b851-7454f965c630-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:20:00 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-73e4f96e-5e7c-4032-9f82-4cedd64afd35 tempest-VolumeQuotasNegativeTestJSON-1940531890 None] Lock "cinder-ccf9e854-81cc-4117-b851-7454f965c630-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:20:00 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-73e4f96e-5e7c-4032-9f82-4cedd64afd35 tempest-VolumeQuotasNegativeTestJSON-1940531890 None] Acquiring lock "cinder-quobyte-ccf9e854-81cc-4117-b851-7454f965c630" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:20:00 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-73e4f96e-5e7c-4032-9f82-4cedd64afd35 tempest-VolumeQuotasNegativeTestJSON-1940531890 None] Lock "cinder-quobyte-ccf9e854-81cc-4117-b851-7454f965c630" acquired by "delete_volume" :: waited 0.029s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:20:00 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[f421779b-7bd8-4feb-b686-3ba5916d57d6]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:20:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-73e4f96e-5e7c-4032-9f82-4cedd64afd35 tempest-VolumeQuotasNegativeTestJSON-1940531890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ccf9e854-81cc-4117-b851-7454f965c630 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:00 devstack sudo[94711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ccf9e854-81cc-4117-b851-7454f965c630 Jul 07 08:20:00 devstack sudo[94711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:01 devstack sudo[94708]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d2431c12-be7d-436e-8370-afdffb939772 tempest-VolumesListAdminTestJSON-881565996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-782cfbe1-6bf4-4c51-9346-58e66a2ee0e4" returned: 0 in 0.813s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:01 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d2431c12-be7d-436e-8370-afdffb939772 tempest-VolumesListAdminTestJSON-881565996 None] <== create_volume: return (2192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:20:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d2431c12-be7d-436e-8370-afdffb939772 tempest-VolumesListAdminTestJSON-881565996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.197s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:01 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d2431c12-be7d-436e-8370-afdffb939772 tempest-VolumesListAdminTestJSON-881565996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47c7951d-b97d-41ec-aff2-8f884f2d35db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-782cfbe1-6bf4-4c51-9346-58e66a2ee0e4', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:01 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d2431c12-be7d-436e-8370-afdffb939772 tempest-VolumesListAdminTestJSON-881565996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9c50ab2-9f1d-4615-988f-3ed4186c3e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:01 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-d2431c12-be7d-436e-8370-afdffb939772 tempest-VolumesListAdminTestJSON-881565996 None] Volume volume-782cfbe1-6bf4-4c51-9346-58e66a2ee0e4 (782cfbe1-6bf4-4c51-9346-58e66a2ee0e4): created successfully Jul 07 08:20:01 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d2431c12-be7d-436e-8370-afdffb939772 tempest-VolumesListAdminTestJSON-881565996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9c50ab2-9f1d-4615-988f-3ed4186c3e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:01 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d2431c12-be7d-436e-8370-afdffb939772 tempest-VolumesListAdminTestJSON-881565996 None] Flow 'volume_create_manager' (b7f58963-5994-4206-9117-38ff9e480a4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:20:01 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-d2431c12-be7d-436e-8370-afdffb939772 tempest-VolumesListAdminTestJSON-881565996 None] Created volume successfully. Jul 07 08:20:01 devstack sudo[94711]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-73e4f96e-5e7c-4032-9f82-4cedd64afd35 tempest-VolumeQuotasNegativeTestJSON-1940531890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ccf9e854-81cc-4117-b851-7454f965c630" returned: 0 in 1.017s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-73e4f96e-5e7c-4032-9f82-4cedd64afd35 tempest-VolumeQuotasNegativeTestJSON-1940531890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ccf9e854-81cc-4117-b851-7454f965c630 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:01 devstack sudo[94719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ccf9e854-81cc-4117-b851-7454f965c630 Jul 07 08:20:01 devstack sudo[94719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:02 devstack sudo[94719]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-73e4f96e-5e7c-4032-9f82-4cedd64afd35 tempest-VolumeQuotasNegativeTestJSON-1940531890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ccf9e854-81cc-4117-b851-7454f965c630" returned: 0 in 0.816s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:02 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-73e4f96e-5e7c-4032-9f82-4cedd64afd35 tempest-VolumeQuotasNegativeTestJSON-1940531890 None] Lock "cinder-quobyte-ccf9e854-81cc-4117-b851-7454f965c630" released by "delete_volume" :: held 1.913s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:20:02 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-73e4f96e-5e7c-4032-9f82-4cedd64afd35 tempest-VolumeQuotasNegativeTestJSON-1940531890 None] Created reservations ['fb4e551b-4c77-438f-a117-7e225d32f5a4', '97ec16cc-cc00-48f7-9848-159c1f838648', 'e5317fe2-45c7-471b-846f-aa8fc8762398', 'ce9929f3-3a57-4a3b-9071-cd99c5dc7d76'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:20:02 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-a082331e-1412-4611-935d-b2f197610e93 tempest-VolumesListAdminTestJSON-881565996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:20:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a082331e-1412-4611-935d-b2f197610e93 tempest-VolumesListAdminTestJSON-881565996 None] Flow 'volume_create_manager' (a4fee676-a089-4c98-97fa-1d671a858016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:20:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a082331e-1412-4611-935d-b2f197610e93 tempest-VolumesListAdminTestJSON-881565996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecaf7c3a-1049-4e67-9c37-f0240f079792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a082331e-1412-4611-935d-b2f197610e93 tempest-VolumesListAdminTestJSON-881565996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecaf7c3a-1049-4e67-9c37-f0240f079792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:20:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-64584655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a2e5f31-81cd-43dc-abc7-ed8b5dc13e84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb7bd4d38a944491a38513200f94e146',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:20:03Z,use_quota=True,user_id='1001895bf0e44456b07961b0308ac0a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a082331e-1412-4611-935d-b2f197610e93 tempest-VolumesListAdminTestJSON-881565996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34d564de-aedd-4842-be84-92ade971c422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a082331e-1412-4611-935d-b2f197610e93 tempest-VolumesListAdminTestJSON-881565996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34d564de-aedd-4842-be84-92ade971c422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a082331e-1412-4611-935d-b2f197610e93 tempest-VolumesListAdminTestJSON-881565996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dc5573e-eefe-4d66-a602-4c7709f69551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a082331e-1412-4611-935d-b2f197610e93 tempest-VolumesListAdminTestJSON-881565996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dc5573e-eefe-4d66-a602-4c7709f69551) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a2e5f31-81cd-43dc-abc7-ed8b5dc13e84', 'volume_name': 'volume-5a2e5f31-81cd-43dc-abc7-ed8b5dc13e84', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a082331e-1412-4611-935d-b2f197610e93 tempest-VolumesListAdminTestJSON-881565996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9edefa1-28d3-4800-b7e9-b4d66ca7a81a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a082331e-1412-4611-935d-b2f197610e93 tempest-VolumesListAdminTestJSON-881565996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9edefa1-28d3-4800-b7e9-b4d66ca7a81a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a082331e-1412-4611-935d-b2f197610e93 tempest-VolumesListAdminTestJSON-881565996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed50f0bf-35a9-498e-9664-f620fd51a793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:02 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-a082331e-1412-4611-935d-b2f197610e93 tempest-VolumesListAdminTestJSON-881565996 None] Volume 5a2e5f31-81cd-43dc-abc7-ed8b5dc13e84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a2e5f31-81cd-43dc-abc7-ed8b5dc13e84', 'volume_size': 1} Jul 07 08:20:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a082331e-1412-4611-935d-b2f197610e93 tempest-VolumesListAdminTestJSON-881565996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a082331e-1412-4611-935d-b2f197610e93 tempest-VolumesListAdminTestJSON-881565996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:02 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a082331e-1412-4611-935d-b2f197610e93 tempest-VolumesListAdminTestJSON-881565996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:20:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-64584655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a2e5f31-81cd-43dc-abc7-ed8b5dc13e84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb7bd4d38a944491a38513200f94e146',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:20:03Z,use_quota=True,user_id='1001895bf0e44456b07961b0308ac0a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:20:02 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-a082331e-1412-4611-935d-b2f197610e93 tempest-VolumesListAdminTestJSON-881565996 None] Creating volume 5a2e5f31-81cd-43dc-abc7-ed8b5dc13e84 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:20:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a082331e-1412-4611-935d-b2f197610e93 tempest-VolumesListAdminTestJSON-881565996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a082331e-1412-4611-935d-b2f197610e93 tempest-VolumesListAdminTestJSON-881565996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:02 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a082331e-1412-4611-935d-b2f197610e93 tempest-VolumesListAdminTestJSON-881565996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:20:02 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a082331e-1412-4611-935d-b2f197610e93 tempest-VolumesListAdminTestJSON-881565996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:20:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a082331e-1412-4611-935d-b2f197610e93 tempest-VolumesListAdminTestJSON-881565996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:02 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a082331e-1412-4611-935d-b2f197610e93 tempest-VolumesListAdminTestJSON-881565996 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:20:02 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-a082331e-1412-4611-935d-b2f197610e93 tempest-VolumesListAdminTestJSON-881565996 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:20:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a082331e-1412-4611-935d-b2f197610e93 tempest-VolumesListAdminTestJSON-881565996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5a2e5f31-81cd-43dc-abc7-ed8b5dc13e84 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:02 devstack sudo[94722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5a2e5f31-81cd-43dc-abc7-ed8b5dc13e84 1073741824 Jul 07 08:20:02 devstack sudo[94722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-73e4f96e-5e7c-4032-9f82-4cedd64afd35 tempest-VolumeQuotasNegativeTestJSON-1940531890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-73e4f96e-5e7c-4032-9f82-4cedd64afd35 tempest-VolumeQuotasNegativeTestJSON-1940531890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:02 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-73e4f96e-5e7c-4032-9f82-4cedd64afd35 tempest-VolumeQuotasNegativeTestJSON-1940531890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:20:02 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-73e4f96e-5e7c-4032-9f82-4cedd64afd35 tempest-VolumeQuotasNegativeTestJSON-1940531890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:20:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-73e4f96e-5e7c-4032-9f82-4cedd64afd35 tempest-VolumeQuotasNegativeTestJSON-1940531890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-73e4f96e-5e7c-4032-9f82-4cedd64afd35 tempest-VolumeQuotasNegativeTestJSON-1940531890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:02 devstack sudo[94724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:20:02 devstack sudo[94724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:03 devstack sudo[94724]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-73e4f96e-5e7c-4032-9f82-4cedd64afd35 tempest-VolumeQuotasNegativeTestJSON-1940531890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.881s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:03 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-73e4f96e-5e7c-4032-9f82-4cedd64afd35 tempest-VolumeQuotasNegativeTestJSON-1940531890 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:20:03 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-73e4f96e-5e7c-4032-9f82-4cedd64afd35 tempest-VolumeQuotasNegativeTestJSON-1940531890 None] Deleted volume successfully. Jul 07 08:20:03 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-73e4f96e-5e7c-4032-9f82-4cedd64afd35 tempest-VolumeQuotasNegativeTestJSON-1940531890 None] Lock "cinder-ccf9e854-81cc-4117-b851-7454f965c630-delete_volume" released by "delete_volume" :: held 3.186s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:20:03 devstack sudo[94722]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a082331e-1412-4611-935d-b2f197610e93 tempest-VolumesListAdminTestJSON-881565996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5a2e5f31-81cd-43dc-abc7-ed8b5dc13e84 1073741824" returned: 0 in 1.094s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a082331e-1412-4611-935d-b2f197610e93 tempest-VolumesListAdminTestJSON-881565996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5a2e5f31-81cd-43dc-abc7-ed8b5dc13e84 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:03 devstack sudo[94731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5a2e5f31-81cd-43dc-abc7-ed8b5dc13e84 Jul 07 08:20:03 devstack sudo[94731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7ea0709b-5a9f-40cb-b115-aec295ec77bb tempest-BackendsCapabilitiesAdminTestsJSON-2007034267 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.75777053833, 'free_capacity_gb': 1775.75777053833, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87199) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 07 08:20:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-9fafd6f6-0486-42c4-84de-65da530121e1 tempest-BackendsCapabilitiesAdminTestsJSON-2007034267 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.75777053833, 'free_capacity_gb': 1775.75777053833, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87199) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 07 08:20:04 devstack sudo[94731]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a082331e-1412-4611-935d-b2f197610e93 tempest-VolumesListAdminTestJSON-881565996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5a2e5f31-81cd-43dc-abc7-ed8b5dc13e84" returned: 0 in 0.804s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a082331e-1412-4611-935d-b2f197610e93 tempest-VolumesListAdminTestJSON-881565996 None] <== create_volume: return (1962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:20:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a082331e-1412-4611-935d-b2f197610e93 tempest-VolumesListAdminTestJSON-881565996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.965s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a082331e-1412-4611-935d-b2f197610e93 tempest-VolumesListAdminTestJSON-881565996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed50f0bf-35a9-498e-9664-f620fd51a793) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a2e5f31-81cd-43dc-abc7-ed8b5dc13e84', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a082331e-1412-4611-935d-b2f197610e93 tempest-VolumesListAdminTestJSON-881565996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67b1eab8-af93-41c2-9267-40aa9b7d54c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:04 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-a082331e-1412-4611-935d-b2f197610e93 tempest-VolumesListAdminTestJSON-881565996 None] Volume volume-5a2e5f31-81cd-43dc-abc7-ed8b5dc13e84 (5a2e5f31-81cd-43dc-abc7-ed8b5dc13e84): created successfully Jul 07 08:20:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a082331e-1412-4611-935d-b2f197610e93 tempest-VolumesListAdminTestJSON-881565996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67b1eab8-af93-41c2-9267-40aa9b7d54c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a082331e-1412-4611-935d-b2f197610e93 tempest-VolumesListAdminTestJSON-881565996 None] Flow 'volume_create_manager' (a4fee676-a089-4c98-97fa-1d671a858016) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:20:04 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-a082331e-1412-4611-935d-b2f197610e93 tempest-VolumesListAdminTestJSON-881565996 None] Created volume successfully. Jul 07 08:20:05 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:20:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:20:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:20:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:05 devstack sudo[94734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:20:05 devstack sudo[94734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:06 devstack sudo[94734]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.887s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:06 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:20:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running periodic task VolumeManager._thread_info {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:20:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] thread count: 8 {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 08:20:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] thread info: [<_MainThread(MainThread, started 133056092332160)>, , , , , , , ] {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 08:20:07 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad7fe16e-ca68-42ea-87da-4d346d439c86 tempest-VolumesListAdminTestJSON-718225881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:20:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad7fe16e-ca68-42ea-87da-4d346d439c86 tempest-VolumesListAdminTestJSON-718225881 None] Flow 'volume_create_manager' (ee3d314f-7e74-4526-a883-27ff7edb9719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:20:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad7fe16e-ca68-42ea-87da-4d346d439c86 tempest-VolumesListAdminTestJSON-718225881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7984ef72-c078-446a-89e8-b3dc5b33755f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad7fe16e-ca68-42ea-87da-4d346d439c86 tempest-VolumesListAdminTestJSON-718225881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7984ef72-c078-446a-89e8-b3dc5b33755f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b08feb4-f36f-458f-8f6b-8d09ea2cad36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27c1d232e167425d875d1f1537a91499',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:20:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:20:07Z,use_quota=True,user_id='e40185729f684ff0b87a5223bb97d5bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad7fe16e-ca68-42ea-87da-4d346d439c86 tempest-VolumesListAdminTestJSON-718225881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf7433d1-ab9f-487f-bc20-279e8825bad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad7fe16e-ca68-42ea-87da-4d346d439c86 tempest-VolumesListAdminTestJSON-718225881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf7433d1-ab9f-487f-bc20-279e8825bad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad7fe16e-ca68-42ea-87da-4d346d439c86 tempest-VolumesListAdminTestJSON-718225881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7f2eb46-ad23-458d-89fe-1f744e31e60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad7fe16e-ca68-42ea-87da-4d346d439c86 tempest-VolumesListAdminTestJSON-718225881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7f2eb46-ad23-458d-89fe-1f744e31e60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b08feb4-f36f-458f-8f6b-8d09ea2cad36', 'volume_name': 'volume-5b08feb4-f36f-458f-8f6b-8d09ea2cad36', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad7fe16e-ca68-42ea-87da-4d346d439c86 tempest-VolumesListAdminTestJSON-718225881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b5c5e29-9021-4b95-9e0f-41cc919cffc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad7fe16e-ca68-42ea-87da-4d346d439c86 tempest-VolumesListAdminTestJSON-718225881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b5c5e29-9021-4b95-9e0f-41cc919cffc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad7fe16e-ca68-42ea-87da-4d346d439c86 tempest-VolumesListAdminTestJSON-718225881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5482d043-8e2d-46d8-b03a-943edd3b0586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:07 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-ad7fe16e-ca68-42ea-87da-4d346d439c86 tempest-VolumesListAdminTestJSON-718225881 None] Volume 5b08feb4-f36f-458f-8f6b-8d09ea2cad36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b08feb4-f36f-458f-8f6b-8d09ea2cad36', 'volume_size': 1} Jul 07 08:20:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad7fe16e-ca68-42ea-87da-4d346d439c86 tempest-VolumesListAdminTestJSON-718225881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad7fe16e-ca68-42ea-87da-4d346d439c86 tempest-VolumesListAdminTestJSON-718225881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:07 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ad7fe16e-ca68-42ea-87da-4d346d439c86 tempest-VolumesListAdminTestJSON-718225881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b08feb4-f36f-458f-8f6b-8d09ea2cad36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27c1d232e167425d875d1f1537a91499',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:20:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:20:07Z,use_quota=True,user_id='e40185729f684ff0b87a5223bb97d5bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:20:07 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-ad7fe16e-ca68-42ea-87da-4d346d439c86 tempest-VolumesListAdminTestJSON-718225881 None] Creating volume 5b08feb4-f36f-458f-8f6b-8d09ea2cad36 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:20:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad7fe16e-ca68-42ea-87da-4d346d439c86 tempest-VolumesListAdminTestJSON-718225881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad7fe16e-ca68-42ea-87da-4d346d439c86 tempest-VolumesListAdminTestJSON-718225881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:07 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ad7fe16e-ca68-42ea-87da-4d346d439c86 tempest-VolumesListAdminTestJSON-718225881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:20:07 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ad7fe16e-ca68-42ea-87da-4d346d439c86 tempest-VolumesListAdminTestJSON-718225881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:20:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad7fe16e-ca68-42ea-87da-4d346d439c86 tempest-VolumesListAdminTestJSON-718225881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:07 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ad7fe16e-ca68-42ea-87da-4d346d439c86 tempest-VolumesListAdminTestJSON-718225881 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:20:07 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-ad7fe16e-ca68-42ea-87da-4d346d439c86 tempest-VolumesListAdminTestJSON-718225881 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:20:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ad7fe16e-ca68-42ea-87da-4d346d439c86 tempest-VolumesListAdminTestJSON-718225881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5b08feb4-f36f-458f-8f6b-8d09ea2cad36 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:07 devstack sudo[94738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5b08feb4-f36f-458f-8f6b-8d09ea2cad36 1073741824 Jul 07 08:20:07 devstack sudo[94738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:08 devstack sudo[94738]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ad7fe16e-ca68-42ea-87da-4d346d439c86 tempest-VolumesListAdminTestJSON-718225881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5b08feb4-f36f-458f-8f6b-8d09ea2cad36 1073741824" returned: 0 in 1.072s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ad7fe16e-ca68-42ea-87da-4d346d439c86 tempest-VolumesListAdminTestJSON-718225881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5b08feb4-f36f-458f-8f6b-8d09ea2cad36 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:08 devstack sudo[94744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5b08feb4-f36f-458f-8f6b-8d09ea2cad36 Jul 07 08:20:08 devstack sudo[94744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:09 devstack sudo[94744]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ad7fe16e-ca68-42ea-87da-4d346d439c86 tempest-VolumesListAdminTestJSON-718225881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5b08feb4-f36f-458f-8f6b-8d09ea2cad36" returned: 0 in 0.810s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ad7fe16e-ca68-42ea-87da-4d346d439c86 tempest-VolumesListAdminTestJSON-718225881 None] <== create_volume: return (1934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:20:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad7fe16e-ca68-42ea-87da-4d346d439c86 tempest-VolumesListAdminTestJSON-718225881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.937s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:09 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=134,cinder:UPDATE=168,cinder:INSERT=43,cinder:DELETE=10 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:20:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad7fe16e-ca68-42ea-87da-4d346d439c86 tempest-VolumesListAdminTestJSON-718225881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5482d043-8e2d-46d8-b03a-943edd3b0586) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b08feb4-f36f-458f-8f6b-8d09ea2cad36', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad7fe16e-ca68-42ea-87da-4d346d439c86 tempest-VolumesListAdminTestJSON-718225881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a8f804a-1de9-4897-80cd-f7bad2d19983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:09 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=135,cinder:UPDATE=168,cinder:INSERT=35,cinder:DELETE=10 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:20:09 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-ad7fe16e-ca68-42ea-87da-4d346d439c86 tempest-VolumesListAdminTestJSON-718225881 None] Volume volume-5b08feb4-f36f-458f-8f6b-8d09ea2cad36 (5b08feb4-f36f-458f-8f6b-8d09ea2cad36): created successfully Jul 07 08:20:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad7fe16e-ca68-42ea-87da-4d346d439c86 tempest-VolumesListAdminTestJSON-718225881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a8f804a-1de9-4897-80cd-f7bad2d19983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad7fe16e-ca68-42ea-87da-4d346d439c86 tempest-VolumesListAdminTestJSON-718225881 None] Flow 'volume_create_manager' (ee3d314f-7e74-4526-a883-27ff7edb9719) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:20:09 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-ad7fe16e-ca68-42ea-87da-4d346d439c86 tempest-VolumesListAdminTestJSON-718225881 None] Created volume successfully. Jul 07 08:20:10 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c7b3a792-e06b-4efa-8f35-27da59d21cc0 tempest-VolumesListAdminTestJSON-718225881 None] Acquiring lock "cinder-5b08feb4-f36f-458f-8f6b-8d09ea2cad36-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:20:10 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c7b3a792-e06b-4efa-8f35-27da59d21cc0 tempest-VolumesListAdminTestJSON-718225881 None] Lock "cinder-5b08feb4-f36f-458f-8f6b-8d09ea2cad36-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:20:10 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c7b3a792-e06b-4efa-8f35-27da59d21cc0 tempest-VolumesListAdminTestJSON-718225881 None] Acquiring lock "cinder-quobyte-5b08feb4-f36f-458f-8f6b-8d09ea2cad36" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:20:10 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c7b3a792-e06b-4efa-8f35-27da59d21cc0 tempest-VolumesListAdminTestJSON-718225881 None] Lock "cinder-quobyte-5b08feb4-f36f-458f-8f6b-8d09ea2cad36" acquired by "delete_volume" :: waited 0.022s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:20:10 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8dd1f45-6e08-43c5-9e9d-018cd3551c5d]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:20:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c7b3a792-e06b-4efa-8f35-27da59d21cc0 tempest-VolumesListAdminTestJSON-718225881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5b08feb4-f36f-458f-8f6b-8d09ea2cad36 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:10 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c70980ff-8d22-4438-b994-86c449d11854 tempest-VolumesListAdminTestJSON-881565996 None] Acquiring lock "cinder-5a2e5f31-81cd-43dc-abc7-ed8b5dc13e84-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:20:10 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c70980ff-8d22-4438-b994-86c449d11854 tempest-VolumesListAdminTestJSON-881565996 None] Lock "cinder-5a2e5f31-81cd-43dc-abc7-ed8b5dc13e84-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:20:10 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c70980ff-8d22-4438-b994-86c449d11854 tempest-VolumesListAdminTestJSON-881565996 None] Acquiring lock "cinder-quobyte-5a2e5f31-81cd-43dc-abc7-ed8b5dc13e84" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:20:10 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c70980ff-8d22-4438-b994-86c449d11854 tempest-VolumesListAdminTestJSON-881565996 None] Lock "cinder-quobyte-5a2e5f31-81cd-43dc-abc7-ed8b5dc13e84" acquired by "delete_volume" :: waited 0.023s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:20:10 devstack sudo[94748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5b08feb4-f36f-458f-8f6b-8d09ea2cad36 Jul 07 08:20:10 devstack sudo[94748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:10 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[78cf1c7a-8705-4419-a613-2c5d614742f2]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:20:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c70980ff-8d22-4438-b994-86c449d11854 tempest-VolumesListAdminTestJSON-881565996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5a2e5f31-81cd-43dc-abc7-ed8b5dc13e84 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:11 devstack sudo[94750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5a2e5f31-81cd-43dc-abc7-ed8b5dc13e84 Jul 07 08:20:11 devstack sudo[94750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:11 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f0a5483-99bb-4b3b-814c-69dcfbf16937 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:20:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3f0a5483-99bb-4b3b-814c-69dcfbf16937 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Flow 'volume_create_manager' (37f89097-b13f-4292-a301-7a390afe12f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:20:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3f0a5483-99bb-4b3b-814c-69dcfbf16937 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75e1661f-2907-42b9-8b1e-cf430e848a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3f0a5483-99bb-4b3b-814c-69dcfbf16937 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75e1661f-2907-42b9-8b1e-cf430e848a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1178638931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2425b65-0b90-4d90-8c33-48c698bd7cb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbfe0e2516ff4ab188aa9f073069d50d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:20:12Z,use_quota=True,user_id='a885d70872bc440294d291188daf318b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3f0a5483-99bb-4b3b-814c-69dcfbf16937 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9dc812f-6596-4d29-af8f-b00a72092833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3f0a5483-99bb-4b3b-814c-69dcfbf16937 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9dc812f-6596-4d29-af8f-b00a72092833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3f0a5483-99bb-4b3b-814c-69dcfbf16937 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cc846ee-dbf9-4f5a-90b7-67f085f2245f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3f0a5483-99bb-4b3b-814c-69dcfbf16937 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cc846ee-dbf9-4f5a-90b7-67f085f2245f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2425b65-0b90-4d90-8c33-48c698bd7cb1', 'volume_name': 'volume-d2425b65-0b90-4d90-8c33-48c698bd7cb1', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3f0a5483-99bb-4b3b-814c-69dcfbf16937 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4859a357-58da-46ef-afc4-6a6a2ca6d7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3f0a5483-99bb-4b3b-814c-69dcfbf16937 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4859a357-58da-46ef-afc4-6a6a2ca6d7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3f0a5483-99bb-4b3b-814c-69dcfbf16937 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96e3cdbe-2f96-40d5-8310-88ffe7c31c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:11 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-3f0a5483-99bb-4b3b-814c-69dcfbf16937 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Volume d2425b65-0b90-4d90-8c33-48c698bd7cb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2425b65-0b90-4d90-8c33-48c698bd7cb1', 'volume_size': 1} Jul 07 08:20:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3f0a5483-99bb-4b3b-814c-69dcfbf16937 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3f0a5483-99bb-4b3b-814c-69dcfbf16937 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:11 devstack sudo[94748]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:11 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-3f0a5483-99bb-4b3b-814c-69dcfbf16937 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1178638931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2425b65-0b90-4d90-8c33-48c698bd7cb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbfe0e2516ff4ab188aa9f073069d50d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:20:12Z,use_quota=True,user_id='a885d70872bc440294d291188daf318b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:20:11 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-3f0a5483-99bb-4b3b-814c-69dcfbf16937 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Creating volume d2425b65-0b90-4d90-8c33-48c698bd7cb1 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:20:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3f0a5483-99bb-4b3b-814c-69dcfbf16937 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3f0a5483-99bb-4b3b-814c-69dcfbf16937 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:11 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-3f0a5483-99bb-4b3b-814c-69dcfbf16937 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:20:11 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-3f0a5483-99bb-4b3b-814c-69dcfbf16937 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:20:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3f0a5483-99bb-4b3b-814c-69dcfbf16937 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:11 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-3f0a5483-99bb-4b3b-814c-69dcfbf16937 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:20:11 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-3f0a5483-99bb-4b3b-814c-69dcfbf16937 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:20:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3f0a5483-99bb-4b3b-814c-69dcfbf16937 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d2425b65-0b90-4d90-8c33-48c698bd7cb1 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c7b3a792-e06b-4efa-8f35-27da59d21cc0 tempest-VolumesListAdminTestJSON-718225881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5b08feb4-f36f-458f-8f6b-8d09ea2cad36" returned: 0 in 1.256s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c7b3a792-e06b-4efa-8f35-27da59d21cc0 tempest-VolumesListAdminTestJSON-718225881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5b08feb4-f36f-458f-8f6b-8d09ea2cad36 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:11 devstack sudo[94756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d2425b65-0b90-4d90-8c33-48c698bd7cb1 1073741824 Jul 07 08:20:11 devstack sudo[94756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:11 devstack sudo[94758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5b08feb4-f36f-458f-8f6b-8d09ea2cad36 Jul 07 08:20:11 devstack sudo[94758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:12 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-66fc9e4a-068d-4384-8b78-3fc8ac864572 tempest-GroupsTest-1420034863 None] Group tempest-Group1-1165804778: creating Jul 07 08:20:12 devstack sudo[94750]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c70980ff-8d22-4438-b994-86c449d11854 tempest-VolumesListAdminTestJSON-881565996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5a2e5f31-81cd-43dc-abc7-ed8b5dc13e84" returned: 0 in 1.251s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c70980ff-8d22-4438-b994-86c449d11854 tempest-VolumesListAdminTestJSON-881565996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5a2e5f31-81cd-43dc-abc7-ed8b5dc13e84 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:12 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-66fc9e4a-068d-4384-8b78-3fc8ac864572 tempest-GroupsTest-1420034863 None] Group tempest-Group1-1165804778: created successfully Jul 07 08:20:12 devstack sudo[94762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5a2e5f31-81cd-43dc-abc7-ed8b5dc13e84 Jul 07 08:20:12 devstack sudo[94762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:12 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-66fc9e4a-068d-4384-8b78-3fc8ac864572 tempest-GroupsTest-1420034863 None] Create group completed successfully. Jul 07 08:20:12 devstack sudo[94758]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c7b3a792-e06b-4efa-8f35-27da59d21cc0 tempest-VolumesListAdminTestJSON-718225881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5b08feb4-f36f-458f-8f6b-8d09ea2cad36" returned: 0 in 0.901s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:12 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c7b3a792-e06b-4efa-8f35-27da59d21cc0 tempest-VolumesListAdminTestJSON-718225881 None] Lock "cinder-quobyte-5b08feb4-f36f-458f-8f6b-8d09ea2cad36" released by "delete_volume" :: held 2.224s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:20:12 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-c7b3a792-e06b-4efa-8f35-27da59d21cc0 tempest-VolumesListAdminTestJSON-718225881 None] Created reservations ['42b4f8ea-c3ef-4673-9b2f-ea105c880393', '8e941e9d-439d-4493-a2a7-ce4ee4a0aa10', 'fb7cfaa6-68b9-4685-8e37-e3656b767428', '7825364b-ab1c-4668-bb6f-b2d586bc4579'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:20:12 devstack sudo[94762]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c70980ff-8d22-4438-b994-86c449d11854 tempest-VolumesListAdminTestJSON-881565996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5a2e5f31-81cd-43dc-abc7-ed8b5dc13e84" returned: 0 in 0.751s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:12 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c70980ff-8d22-4438-b994-86c449d11854 tempest-VolumesListAdminTestJSON-881565996 None] Lock "cinder-quobyte-5a2e5f31-81cd-43dc-abc7-ed8b5dc13e84" released by "delete_volume" :: held 2.083s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:20:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c7b3a792-e06b-4efa-8f35-27da59d21cc0 tempest-VolumesListAdminTestJSON-718225881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c7b3a792-e06b-4efa-8f35-27da59d21cc0 tempest-VolumesListAdminTestJSON-718225881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c7b3a792-e06b-4efa-8f35-27da59d21cc0 tempest-VolumesListAdminTestJSON-718225881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:20:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c7b3a792-e06b-4efa-8f35-27da59d21cc0 tempest-VolumesListAdminTestJSON-718225881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:20:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c7b3a792-e06b-4efa-8f35-27da59d21cc0 tempest-VolumesListAdminTestJSON-718225881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c7b3a792-e06b-4efa-8f35-27da59d21cc0 tempest-VolumesListAdminTestJSON-718225881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:13 devstack sudo[94756]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3f0a5483-99bb-4b3b-814c-69dcfbf16937 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d2425b65-0b90-4d90-8c33-48c698bd7cb1 1073741824" returned: 0 in 1.168s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:13 devstack sudo[94773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:20:13 devstack sudo[94773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:13 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-c70980ff-8d22-4438-b994-86c449d11854 tempest-VolumesListAdminTestJSON-881565996 None] Created reservations ['38550c6f-b67e-4b92-9ccc-51081993ce2b', 'cbdb84a3-5194-4c4f-8eb9-963dd0424ce1', '931ab98f-9749-40c0-a930-c1762eb0ddbb', '85ea676a-6329-4910-a2ce-f1991b5be5e9'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:20:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3f0a5483-99bb-4b3b-814c-69dcfbf16937 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d2425b65-0b90-4d90-8c33-48c698bd7cb1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:13 devstack sudo[94775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d2425b65-0b90-4d90-8c33-48c698bd7cb1 Jul 07 08:20:13 devstack sudo[94775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c70980ff-8d22-4438-b994-86c449d11854 tempest-VolumesListAdminTestJSON-881565996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c70980ff-8d22-4438-b994-86c449d11854 tempest-VolumesListAdminTestJSON-881565996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c70980ff-8d22-4438-b994-86c449d11854 tempest-VolumesListAdminTestJSON-881565996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:20:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c70980ff-8d22-4438-b994-86c449d11854 tempest-VolumesListAdminTestJSON-881565996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:20:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c70980ff-8d22-4438-b994-86c449d11854 tempest-VolumesListAdminTestJSON-881565996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c70980ff-8d22-4438-b994-86c449d11854 tempest-VolumesListAdminTestJSON-881565996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:13 devstack sudo[94777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:20:13 devstack sudo[94777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:13 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-30b08d07-ac31-4d19-9855-f41540f0e606 tempest-GroupsTest-1420034863 None] Group tempest-Group2-1082272343: creating Jul 07 08:20:13 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-30b08d07-ac31-4d19-9855-f41540f0e606 tempest-GroupsTest-1420034863 None] Group tempest-Group2-1082272343: created successfully Jul 07 08:20:13 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-30b08d07-ac31-4d19-9855-f41540f0e606 tempest-GroupsTest-1420034863 None] Create group completed successfully. Jul 07 08:20:13 devstack sudo[94773]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c7b3a792-e06b-4efa-8f35-27da59d21cc0 tempest-VolumesListAdminTestJSON-718225881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.848s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:13 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-c7b3a792-e06b-4efa-8f35-27da59d21cc0 tempest-VolumesListAdminTestJSON-718225881 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:20:13 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-c7b3a792-e06b-4efa-8f35-27da59d21cc0 tempest-VolumesListAdminTestJSON-718225881 None] Deleted volume successfully. Jul 07 08:20:13 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c7b3a792-e06b-4efa-8f35-27da59d21cc0 tempest-VolumesListAdminTestJSON-718225881 None] Lock "cinder-5b08feb4-f36f-458f-8f6b-8d09ea2cad36-delete_volume" released by "delete_volume" :: held 3.396s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:20:14 devstack sudo[94775]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3f0a5483-99bb-4b3b-814c-69dcfbf16937 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d2425b65-0b90-4d90-8c33-48c698bd7cb1" returned: 0 in 0.939s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:14 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-3f0a5483-99bb-4b3b-814c-69dcfbf16937 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] <== create_volume: return (2174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:20:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3f0a5483-99bb-4b3b-814c-69dcfbf16937 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.178s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:14 devstack sudo[94777]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:14 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3f0a5483-99bb-4b3b-814c-69dcfbf16937 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96e3cdbe-2f96-40d5-8310-88ffe7c31c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2425b65-0b90-4d90-8c33-48c698bd7cb1', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:14 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3f0a5483-99bb-4b3b-814c-69dcfbf16937 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07e9732d-f483-4c0d-8c7e-0bc5ea783e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c70980ff-8d22-4438-b994-86c449d11854 tempest-VolumesListAdminTestJSON-881565996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.868s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:14 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-c70980ff-8d22-4438-b994-86c449d11854 tempest-VolumesListAdminTestJSON-881565996 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:20:14 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-c70980ff-8d22-4438-b994-86c449d11854 tempest-VolumesListAdminTestJSON-881565996 None] Deleted volume successfully. Jul 07 08:20:14 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-3f0a5483-99bb-4b3b-814c-69dcfbf16937 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Volume volume-d2425b65-0b90-4d90-8c33-48c698bd7cb1 (d2425b65-0b90-4d90-8c33-48c698bd7cb1): created successfully Jul 07 08:20:14 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3f0a5483-99bb-4b3b-814c-69dcfbf16937 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07e9732d-f483-4c0d-8c7e-0bc5ea783e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:14 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3f0a5483-99bb-4b3b-814c-69dcfbf16937 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Flow 'volume_create_manager' (37f89097-b13f-4292-a301-7a390afe12f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:20:14 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-3f0a5483-99bb-4b3b-814c-69dcfbf16937 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Created volume successfully. Jul 07 08:20:14 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c70980ff-8d22-4438-b994-86c449d11854 tempest-VolumesListAdminTestJSON-881565996 None] Lock "cinder-5a2e5f31-81cd-43dc-abc7-ed8b5dc13e84-delete_volume" released by "delete_volume" :: held 3.304s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:20:14 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d00983b6-cec4-4f0a-9d05-bd23a8924286 tempest-VolumesListAdminTestJSON-881565996 None] Acquiring lock "cinder-782cfbe1-6bf4-4c51-9346-58e66a2ee0e4-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:20:14 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d00983b6-cec4-4f0a-9d05-bd23a8924286 tempest-VolumesListAdminTestJSON-881565996 None] Lock "cinder-782cfbe1-6bf4-4c51-9346-58e66a2ee0e4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:20:14 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d00983b6-cec4-4f0a-9d05-bd23a8924286 tempest-VolumesListAdminTestJSON-881565996 None] Acquiring lock "cinder-quobyte-782cfbe1-6bf4-4c51-9346-58e66a2ee0e4" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:20:14 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d00983b6-cec4-4f0a-9d05-bd23a8924286 tempest-VolumesListAdminTestJSON-881565996 None] Lock "cinder-quobyte-782cfbe1-6bf4-4c51-9346-58e66a2ee0e4" acquired by "delete_volume" :: waited 0.015s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:20:14 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[c779901d-b870-4a0f-8d31-a6b651b1f7e6]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:20:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d00983b6-cec4-4f0a-9d05-bd23a8924286 tempest-VolumesListAdminTestJSON-881565996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-782cfbe1-6bf4-4c51-9346-58e66a2ee0e4 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:14 devstack sudo[94782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-782cfbe1-6bf4-4c51-9346-58e66a2ee0e4 Jul 07 08:20:14 devstack sudo[94782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:15 devstack sudo[94782]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d00983b6-cec4-4f0a-9d05-bd23a8924286 tempest-VolumesListAdminTestJSON-881565996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-782cfbe1-6bf4-4c51-9346-58e66a2ee0e4" returned: 0 in 0.914s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d00983b6-cec4-4f0a-9d05-bd23a8924286 tempest-VolumesListAdminTestJSON-881565996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-782cfbe1-6bf4-4c51-9346-58e66a2ee0e4 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:15 devstack sudo[94789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-782cfbe1-6bf4-4c51-9346-58e66a2ee0e4 Jul 07 08:20:15 devstack sudo[94789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:15 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cc44992-b2ba-40c6-8c81-610c2d01f633 tempest-GroupsTest-1420034863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:20:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2cc44992-b2ba-40c6-8c81-610c2d01f633 tempest-GroupsTest-1420034863 None] Flow 'volume_create_manager' (3df68b78-1e96-42b4-a608-3288d259ad41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:20:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2cc44992-b2ba-40c6-8c81-610c2d01f633 tempest-GroupsTest-1420034863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be30f4ec-60c7-48f4-acbf-422522f28e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-19e3a567-af73-4e49-bc26-09d51fd6aeab tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-19e3a567-af73-4e49-bc26-09d51fd6aeab tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2cc44992-b2ba-40c6-8c81-610c2d01f633 tempest-GroupsTest-1420034863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be30f4ec-60c7-48f4-acbf-422522f28e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-105630070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7ab3d7ea-06d1-4dbf-8ff6-d0c0c61c810d,host='devstack@QuobyteHD#QuobyteHD',id=8e40d066-1a94-41c8-ad68-9d0dd6151188,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='724291ad208541308ee3dea868227df8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:20:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:20:15Z,use_quota=True,user_id='7c790bb0c1af4f50b8cb3501d9eb7db5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(26f453ab-949a-4a89-ba74-632b01de3a4a),volume_type_id=26f453ab-949a-4a89-ba74-632b01de3a4a)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2cc44992-b2ba-40c6-8c81-610c2d01f633 tempest-GroupsTest-1420034863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c213a41a-bdcd-4472-814b-df2d68c77eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2cc44992-b2ba-40c6-8c81-610c2d01f633 tempest-GroupsTest-1420034863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c213a41a-bdcd-4472-814b-df2d68c77eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2cc44992-b2ba-40c6-8c81-610c2d01f633 tempest-GroupsTest-1420034863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32d771cb-9076-43c8-a290-fe8500e38e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2cc44992-b2ba-40c6-8c81-610c2d01f633 tempest-GroupsTest-1420034863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32d771cb-9076-43c8-a290-fe8500e38e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e40d066-1a94-41c8-ad68-9d0dd6151188', 'volume_name': 'volume-8e40d066-1a94-41c8-ad68-9d0dd6151188', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2cc44992-b2ba-40c6-8c81-610c2d01f633 tempest-GroupsTest-1420034863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fae0ad6e-0048-457a-97f7-b32201edacaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2cc44992-b2ba-40c6-8c81-610c2d01f633 tempest-GroupsTest-1420034863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fae0ad6e-0048-457a-97f7-b32201edacaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2cc44992-b2ba-40c6-8c81-610c2d01f633 tempest-GroupsTest-1420034863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bc277f3-03d1-4d65-b34a-4c56a7e9cdc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:15 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-2cc44992-b2ba-40c6-8c81-610c2d01f633 tempest-GroupsTest-1420034863 None] Volume 8e40d066-1a94-41c8-ad68-9d0dd6151188: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e40d066-1a94-41c8-ad68-9d0dd6151188', 'volume_size': 1} Jul 07 08:20:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-2cc44992-b2ba-40c6-8c81-610c2d01f633 tempest-GroupsTest-1420034863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-19e3a567-af73-4e49-bc26-09d51fd6aeab tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Creating offline snapshot 726439a8-d72a-424e-822b-33959049398b of volume d2425b65-0b90-4d90-8c33-48c698bd7cb1 {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:20:15 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1047ac-6e95-46ae-9a96-1ef0ade8b1b2]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:20:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-19e3a567-af73-4e49-bc26-09d51fd6aeab tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d2425b65-0b90-4d90-8c33-48c698bd7cb1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:15 devstack sudo[94791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d2425b65-0b90-4d90-8c33-48c698bd7cb1 Jul 07 08:20:15 devstack sudo[94791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:15 devstack sudo[94789]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d00983b6-cec4-4f0a-9d05-bd23a8924286 tempest-VolumesListAdminTestJSON-881565996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-782cfbe1-6bf4-4c51-9346-58e66a2ee0e4" returned: 0 in 0.735s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:16 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d00983b6-cec4-4f0a-9d05-bd23a8924286 tempest-VolumesListAdminTestJSON-881565996 None] Lock "cinder-quobyte-782cfbe1-6bf4-4c51-9346-58e66a2ee0e4" released by "delete_volume" :: held 1.694s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:20:16 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-d00983b6-cec4-4f0a-9d05-bd23a8924286 tempest-VolumesListAdminTestJSON-881565996 None] Created reservations ['ff548549-ed88-4eb8-8572-d7a3942e7248', '855f62d2-d740-4784-8f1b-b383b6561422', '3b81c9b6-3b55-4abf-9bc4-e1684f31d1b9', '5cda99b2-c2a7-4726-80b2-3374e6c88496'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:20:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d00983b6-cec4-4f0a-9d05-bd23a8924286 tempest-VolumesListAdminTestJSON-881565996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d00983b6-cec4-4f0a-9d05-bd23a8924286 tempest-VolumesListAdminTestJSON-881565996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:16 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d00983b6-cec4-4f0a-9d05-bd23a8924286 tempest-VolumesListAdminTestJSON-881565996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:20:16 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d00983b6-cec4-4f0a-9d05-bd23a8924286 tempest-VolumesListAdminTestJSON-881565996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:20:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d00983b6-cec4-4f0a-9d05-bd23a8924286 tempest-VolumesListAdminTestJSON-881565996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d00983b6-cec4-4f0a-9d05-bd23a8924286 tempest-VolumesListAdminTestJSON-881565996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:16 devstack sudo[94798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:20:16 devstack sudo[94798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:16 devstack sudo[94791]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-19e3a567-af73-4e49-bc26-09d51fd6aeab tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d2425b65-0b90-4d90-8c33-48c698bd7cb1" returned: 0 in 0.821s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-19e3a567-af73-4e49-bc26-09d51fd6aeab tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d2425b65-0b90-4d90-8c33-48c698bd7cb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d2425b65-0b90-4d90-8c33-48c698bd7cb1.726439a8-d72a-424e-822b-33959049398b 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:16 devstack sudo[94800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d2425b65-0b90-4d90-8c33-48c698bd7cb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d2425b65-0b90-4d90-8c33-48c698bd7cb1.726439a8-d72a-424e-822b-33959049398b 1G Jul 07 08:20:16 devstack sudo[94800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:16 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f73ca7ca-7357-437f-a7c3-52e63d68864a tempest-VolumesListAdminTestJSON-881565996 None] Acquiring lock "cinder-4669b647-d88e-44af-a6b5-1696e6d934a9-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:20:16 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f73ca7ca-7357-437f-a7c3-52e63d68864a tempest-VolumesListAdminTestJSON-881565996 None] Lock "cinder-4669b647-d88e-44af-a6b5-1696e6d934a9-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:20:16 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f73ca7ca-7357-437f-a7c3-52e63d68864a tempest-VolumesListAdminTestJSON-881565996 None] Acquiring lock "cinder-quobyte-4669b647-d88e-44af-a6b5-1696e6d934a9" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:20:16 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f73ca7ca-7357-437f-a7c3-52e63d68864a tempest-VolumesListAdminTestJSON-881565996 None] Lock "cinder-quobyte-4669b647-d88e-44af-a6b5-1696e6d934a9" acquired by "delete_volume" :: waited 0.022s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:20:16 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[78cb501a-37b2-4f14-b9c1-f58b5f8d096a]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:20:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f73ca7ca-7357-437f-a7c3-52e63d68864a tempest-VolumesListAdminTestJSON-881565996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4669b647-d88e-44af-a6b5-1696e6d934a9 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:16 devstack sudo[94802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4669b647-d88e-44af-a6b5-1696e6d934a9 Jul 07 08:20:16 devstack sudo[94802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:17 devstack sudo[94798]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d00983b6-cec4-4f0a-9d05-bd23a8924286 tempest-VolumesListAdminTestJSON-881565996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.878s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:17 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-d00983b6-cec4-4f0a-9d05-bd23a8924286 tempest-VolumesListAdminTestJSON-881565996 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:20:17 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-d00983b6-cec4-4f0a-9d05-bd23a8924286 tempest-VolumesListAdminTestJSON-881565996 None] Deleted volume successfully. Jul 07 08:20:17 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d00983b6-cec4-4f0a-9d05-bd23a8924286 tempest-VolumesListAdminTestJSON-881565996 None] Lock "cinder-782cfbe1-6bf4-4c51-9346-58e66a2ee0e4-delete_volume" released by "delete_volume" :: held 2.787s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:20:17 devstack sudo[94800]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-19e3a567-af73-4e49-bc26-09d51fd6aeab tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d2425b65-0b90-4d90-8c33-48c698bd7cb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d2425b65-0b90-4d90-8c33-48c698bd7cb1.726439a8-d72a-424e-822b-33959049398b 1G" returned: 0 in 1.001s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-19e3a567-af73-4e49-bc26-09d51fd6aeab tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2425b65-0b90-4d90-8c33-48c698bd7cb1 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d2425b65-0b90-4d90-8c33-48c698bd7cb1.726439a8-d72a-424e-822b-33959049398b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:17 devstack sudo[94809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2425b65-0b90-4d90-8c33-48c698bd7cb1 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d2425b65-0b90-4d90-8c33-48c698bd7cb1.726439a8-d72a-424e-822b-33959049398b Jul 07 08:20:17 devstack sudo[94809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:17 devstack sudo[94802]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f73ca7ca-7357-437f-a7c3-52e63d68864a tempest-VolumesListAdminTestJSON-881565996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4669b647-d88e-44af-a6b5-1696e6d934a9" returned: 0 in 0.977s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f73ca7ca-7357-437f-a7c3-52e63d68864a tempest-VolumesListAdminTestJSON-881565996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4669b647-d88e-44af-a6b5-1696e6d934a9 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:17 devstack sudo[94815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4669b647-d88e-44af-a6b5-1696e6d934a9 Jul 07 08:20:17 devstack sudo[94815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:18 devstack sudo[94809]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-19e3a567-af73-4e49-bc26-09d51fd6aeab tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2425b65-0b90-4d90-8c33-48c698bd7cb1 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d2425b65-0b90-4d90-8c33-48c698bd7cb1.726439a8-d72a-424e-822b-33959049398b" returned: 0 in 0.800s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:18 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-19e3a567-af73-4e49-bc26-09d51fd6aeab tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d2425b65-0b90-4d90-8c33-48c698bd7cb1.726439a8-d72a-424e-822b-33959049398b is being set with open permissions: ugo+rw Jul 07 08:20:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-19e3a567-af73-4e49-bc26-09d51fd6aeab tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d2425b65-0b90-4d90-8c33-48c698bd7cb1.726439a8-d72a-424e-822b-33959049398b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:18 devstack sudo[94820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d2425b65-0b90-4d90-8c33-48c698bd7cb1.726439a8-d72a-424e-822b-33959049398b Jul 07 08:20:18 devstack sudo[94820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:18 devstack sudo[94815]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f73ca7ca-7357-437f-a7c3-52e63d68864a tempest-VolumesListAdminTestJSON-881565996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4669b647-d88e-44af-a6b5-1696e6d934a9" returned: 0 in 0.711s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:18 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f73ca7ca-7357-437f-a7c3-52e63d68864a tempest-VolumesListAdminTestJSON-881565996 None] Lock "cinder-quobyte-4669b647-d88e-44af-a6b5-1696e6d934a9" released by "delete_volume" :: held 1.740s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:20:18 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-f73ca7ca-7357-437f-a7c3-52e63d68864a tempest-VolumesListAdminTestJSON-881565996 None] Created reservations ['87913bd3-f070-4ef1-87e4-b19556a92bcc', '127d1f9a-2003-431a-88b7-9daee0831dc2', 'faf1fcc3-9ea7-4cad-8008-a921de83702b', '7901333d-710f-4513-953e-8eeb6bed17d5'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:20:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f73ca7ca-7357-437f-a7c3-52e63d68864a tempest-VolumesListAdminTestJSON-881565996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f73ca7ca-7357-437f-a7c3-52e63d68864a tempest-VolumesListAdminTestJSON-881565996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:18 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f73ca7ca-7357-437f-a7c3-52e63d68864a tempest-VolumesListAdminTestJSON-881565996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:20:18 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f73ca7ca-7357-437f-a7c3-52e63d68864a tempest-VolumesListAdminTestJSON-881565996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:20:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f73ca7ca-7357-437f-a7c3-52e63d68864a tempest-VolumesListAdminTestJSON-881565996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f73ca7ca-7357-437f-a7c3-52e63d68864a tempest-VolumesListAdminTestJSON-881565996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:18 devstack sudo[94823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:20:18 devstack sudo[94823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:18 devstack sudo[94820]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-19e3a567-af73-4e49-bc26-09d51fd6aeab tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d2425b65-0b90-4d90-8c33-48c698bd7cb1.726439a8-d72a-424e-822b-33959049398b" returned: 0 in 0.741s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-19e3a567-af73-4e49-bc26-09d51fd6aeab tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d2425b65-0b90-4d90-8c33-48c698bd7cb1.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:18 devstack sudo[94826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d2425b65-0b90-4d90-8c33-48c698bd7cb1.info Jul 07 08:20:18 devstack sudo[94826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:19 devstack sudo[94823]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f73ca7ca-7357-437f-a7c3-52e63d68864a tempest-VolumesListAdminTestJSON-881565996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.761s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:19 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-f73ca7ca-7357-437f-a7c3-52e63d68864a tempest-VolumesListAdminTestJSON-881565996 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:20:19 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-f73ca7ca-7357-437f-a7c3-52e63d68864a tempest-VolumesListAdminTestJSON-881565996 None] Deleted volume successfully. Jul 07 08:20:19 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f73ca7ca-7357-437f-a7c3-52e63d68864a tempest-VolumesListAdminTestJSON-881565996 None] Lock "cinder-4669b647-d88e-44af-a6b5-1696e6d934a9-delete_volume" released by "delete_volume" :: held 2.755s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:20:19 devstack sudo[94826]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-19e3a567-af73-4e49-bc26-09d51fd6aeab tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d2425b65-0b90-4d90-8c33-48c698bd7cb1.info" returned: 0 in 0.716s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:19 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-19e3a567-af73-4e49-bc26-09d51fd6aeab tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d2425b65-0b90-4d90-8c33-48c698bd7cb1.info is being set with open permissions: ugo+rw Jul 07 08:20:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-19e3a567-af73-4e49-bc26-09d51fd6aeab tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d2425b65-0b90-4d90-8c33-48c698bd7cb1.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:19 devstack sudo[94830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d2425b65-0b90-4d90-8c33-48c698bd7cb1.info Jul 07 08:20:19 devstack sudo[94830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:20 devstack sudo[94830]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-19e3a567-af73-4e49-bc26-09d51fd6aeab tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d2425b65-0b90-4d90-8c33-48c698bd7cb1.info" returned: 0 in 0.730s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-19e3a567-af73-4e49-bc26-09d51fd6aeab tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.955s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-2cc44992-b2ba-40c6-8c81-610c2d01f633 tempest-GroupsTest-1420034863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.918s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:20 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-2cc44992-b2ba-40c6-8c81-610c2d01f633 tempest-GroupsTest-1420034863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7ab3d7ea-06d1-4dbf-8ff6-d0c0c61c810d,created_at=2026-07-07T06:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-105630070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7ab3d7ea-06d1-4dbf-8ff6-d0c0c61c810d,host='devstack@QuobyteHD#QuobyteHD',id=8e40d066-1a94-41c8-ad68-9d0dd6151188,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='724291ad208541308ee3dea868227df8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:20:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:20:15Z,use_quota=True,user_id='7c790bb0c1af4f50b8cb3501d9eb7db5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(26f453ab-949a-4a89-ba74-632b01de3a4a),volume_type_id=26f453ab-949a-4a89-ba74-632b01de3a4a)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:20:20 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-2cc44992-b2ba-40c6-8c81-610c2d01f633 tempest-GroupsTest-1420034863 None] Creating volume 8e40d066-1a94-41c8-ad68-9d0dd6151188 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:20:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-2cc44992-b2ba-40c6-8c81-610c2d01f633 tempest-GroupsTest-1420034863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-2cc44992-b2ba-40c6-8c81-610c2d01f633 tempest-GroupsTest-1420034863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:20 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-2cc44992-b2ba-40c6-8c81-610c2d01f633 tempest-GroupsTest-1420034863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:20:20 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-2cc44992-b2ba-40c6-8c81-610c2d01f633 tempest-GroupsTest-1420034863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:20:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-2cc44992-b2ba-40c6-8c81-610c2d01f633 tempest-GroupsTest-1420034863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:20 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-2cc44992-b2ba-40c6-8c81-610c2d01f633 tempest-GroupsTest-1420034863 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:20:20 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-2cc44992-b2ba-40c6-8c81-610c2d01f633 tempest-GroupsTest-1420034863 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:20:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-2cc44992-b2ba-40c6-8c81-610c2d01f633 tempest-GroupsTest-1420034863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8e40d066-1a94-41c8-ad68-9d0dd6151188 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:20 devstack sudo[94833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8e40d066-1a94-41c8-ad68-9d0dd6151188 1073741824 Jul 07 08:20:20 devstack sudo[94833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:20 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-19e3a567-af73-4e49-bc26-09d51fd6aeab tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Create snapshot completed successfully Jul 07 08:20:20 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:20:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] Flow 'volume_create_manager' (e84fa66b-4325-4006-b9de-39129c4b76e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:20:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aa59850-79d6-42b9-9488-6c97e334b08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aa59850-79d6-42b9-9488-6c97e334b08c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:20:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-530901865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ca664cf-cd1e-49fa-a485-270b35c28afa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab7ba131e67f4dc0afe60bf6bcda6d0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:20:20Z,use_quota=True,user_id='a177dd49e8764201b637c45166c21fc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3539e86b-e78a-4f45-89a7-06b73f0a723a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3539e86b-e78a-4f45-89a7-06b73f0a723a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9a4506b-e323-4391-ab7b-cc3ce3851783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:20 devstack cinder-volume[87199]: DEBUG cinder.image.glance [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] Creating Keystone auth plugin from conf {{(pid=87199) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 08:20:21 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-04cffbc1-f512-4db8-b70c-311cb1c12e68 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Acquiring lock "cinder-726439a8-d72a-424e-822b-33959049398b-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:20:21 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-04cffbc1-f512-4db8-b70c-311cb1c12e68 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Lock "cinder-726439a8-d72a-424e-822b-33959049398b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:20:21 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-04cffbc1-f512-4db8-b70c-311cb1c12e68 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Acquiring lock "cinder-quobyte-d2425b65-0b90-4d90-8c33-48c698bd7cb1" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:20:21 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-04cffbc1-f512-4db8-b70c-311cb1c12e68 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Lock "cinder-quobyte-d2425b65-0b90-4d90-8c33-48c698bd7cb1" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:20:21 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-04cffbc1-f512-4db8-b70c-311cb1c12e68 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Acquiring lock "cinder-quobyte-726439a8-d72a-424e-822b-33959049398b" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:20:21 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-04cffbc1-f512-4db8-b70c-311cb1c12e68 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Lock "cinder-quobyte-726439a8-d72a-424e-822b-33959049398b" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:20:21 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-04cffbc1-f512-4db8-b70c-311cb1c12e68 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Deleting offline snapshot 726439a8-d72a-424e-822b-33959049398b of volume d2425b65-0b90-4d90-8c33-48c698bd7cb1 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:20:21 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-04cffbc1-f512-4db8-b70c-311cb1c12e68 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] snapshot_file for this snap is: volume-d2425b65-0b90-4d90-8c33-48c698bd7cb1.726439a8-d72a-424e-822b-33959049398b {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:20:21 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4881c33-f60d-40d3-bc70-583e2a36beec]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:20:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-04cffbc1-f512-4db8-b70c-311cb1c12e68 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d2425b65-0b90-4d90-8c33-48c698bd7cb1.726439a8-d72a-424e-822b-33959049398b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:21 devstack sudo[94839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d2425b65-0b90-4d90-8c33-48c698bd7cb1.726439a8-d72a-424e-822b-33959049398b Jul 07 08:20:21 devstack sudo[94839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9a4506b-e323-4391-ab7b-cc3ce3851783) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8ca664cf-cd1e-49fa-a485-270b35c28afa', 'volume_name': 'volume-8ca664cf-cd1e-49fa-a485-270b35c28afa', 'volume_size': 1, 'image_id': '276bad5d-feb0-4ba2-a219-18ecf721ff14', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/276bad5d-feb0-4ba2-a219-18ecf721ff14', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '616624e32aa447818ca627e0bb0985c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '276bad5d-feb0-4ba2-a219-18ecf721ff14', 'created_at': datetime.datetime(2026, 7, 7, 6, 6, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 6, 6, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/276bad5d-feb0-4ba2-a219-18ecf721ff14/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54cf8fc6-65f2-4d2a-b99c-5bc1a6ec53d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54cf8fc6-65f2-4d2a-b99c-5bc1a6ec53d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2477a4e1-caf6-40e6-ab6e-a1723596f89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:21 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] Volume 8ca664cf-cd1e-49fa-a485-270b35c28afa: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8ca664cf-cd1e-49fa-a485-270b35c28afa', 'volume_size': 1, 'image_id': '276bad5d-feb0-4ba2-a219-18ecf721ff14', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/276bad5d-feb0-4ba2-a219-18ecf721ff14', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '616624e32aa447818ca627e0bb0985c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '276bad5d-feb0-4ba2-a219-18ecf721ff14', 'created_at': datetime.datetime(2026, 7, 7, 6, 6, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 6, 6, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/276bad5d-feb0-4ba2-a219-18ecf721ff14/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 07 08:20:21 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] Trying to clone 8ca664cf-cd1e-49fa-a485-270b35c28afa from image 276bad5d-feb0-4ba2-a219-18ecf721ff14 at location (None, [{'url': 'file:///opt/stack/data/glance/images/276bad5d-feb0-4ba2-a219-18ecf721ff14', 'metadata': {}}]). {{(pid=87199) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 08:20:21 devstack sudo[94833]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-2cc44992-b2ba-40c6-8c81-610c2d01f633 tempest-GroupsTest-1420034863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8e40d066-1a94-41c8-ad68-9d0dd6151188 1073741824" returned: 0 in 1.173s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-2cc44992-b2ba-40c6-8c81-610c2d01f633 tempest-GroupsTest-1420034863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8e40d066-1a94-41c8-ad68-9d0dd6151188 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:21 devstack sudo[94862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8e40d066-1a94-41c8-ad68-9d0dd6151188 Jul 07 08:20:21 devstack sudo[94862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:21 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_276bad5d-feb0-4ba2-a219-18ecf721ff14_m8p44e4edevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87199) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 08:20:21 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] Image download 20.69 MB at 20.69 MB/s Jul 07 08:20:21 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25a3095-c3a6-419f-9238-e524038264cb]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:20:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_276bad5d-feb0-4ba2-a219-18ecf721ff14_m8p44e4edevstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:22 devstack sudo[94865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_276bad5d-feb0-4ba2-a219-18ecf721ff14_m8p44e4edevstack@QuobyteHD Jul 07 08:20:22 devstack sudo[94865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:22 devstack sudo[94862]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-2cc44992-b2ba-40c6-8c81-610c2d01f633 tempest-GroupsTest-1420034863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8e40d066-1a94-41c8-ad68-9d0dd6151188" returned: 0 in 0.793s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:22 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-2cc44992-b2ba-40c6-8c81-610c2d01f633 tempest-GroupsTest-1420034863 None] <== create_volume: return (2114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:20:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-2cc44992-b2ba-40c6-8c81-610c2d01f633 tempest-GroupsTest-1420034863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.119s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:22 devstack sudo[94839]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-04cffbc1-f512-4db8-b70c-311cb1c12e68 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d2425b65-0b90-4d90-8c33-48c698bd7cb1.726439a8-d72a-424e-822b-33959049398b" returned: 0 in 1.276s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:22 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-04cffbc1-f512-4db8-b70c-311cb1c12e68 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2425b65-0b90-4d90-8c33-48c698bd7cb1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:20:22 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2cc44992-b2ba-40c6-8c81-610c2d01f633 tempest-GroupsTest-1420034863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bc277f3-03d1-4d65-b34a-4c56a7e9cdc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e40d066-1a94-41c8-ad68-9d0dd6151188', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:22 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2cc44992-b2ba-40c6-8c81-610c2d01f633 tempest-GroupsTest-1420034863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93732703-981a-4efe-a1cc-7806e1410304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:22 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c36807-d632-4b61-993a-c62b11348ac0]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:20:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-04cffbc1-f512-4db8-b70c-311cb1c12e68 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d2425b65-0b90-4d90-8c33-48c698bd7cb1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:22 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-2cc44992-b2ba-40c6-8c81-610c2d01f633 tempest-GroupsTest-1420034863 None] Volume volume-8e40d066-1a94-41c8-ad68-9d0dd6151188 (8e40d066-1a94-41c8-ad68-9d0dd6151188): created successfully Jul 07 08:20:22 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2cc44992-b2ba-40c6-8c81-610c2d01f633 tempest-GroupsTest-1420034863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93732703-981a-4efe-a1cc-7806e1410304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:22 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2cc44992-b2ba-40c6-8c81-610c2d01f633 tempest-GroupsTest-1420034863 None] Flow 'volume_create_manager' (3df68b78-1e96-42b4-a608-3288d259ad41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:20:22 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-2cc44992-b2ba-40c6-8c81-610c2d01f633 tempest-GroupsTest-1420034863 None] Created volume successfully. Jul 07 08:20:22 devstack sudo[94874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d2425b65-0b90-4d90-8c33-48c698bd7cb1 Jul 07 08:20:22 devstack sudo[94874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:22 devstack sudo[94865]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_276bad5d-feb0-4ba2-a219-18ecf721ff14_m8p44e4edevstack@QuobyteHD" returned: 0 in 0.953s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:22 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] Temporary image 276bad5d-feb0-4ba2-a219-18ecf721ff14 is fetched for user a177dd49e8764201b637c45166c21fc2. {{(pid=87199) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 08:20:22 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2965df7-6ccc-47b8-a494-2ad6c03260d7]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:20:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_276bad5d-feb0-4ba2-a219-18ecf721ff14_m8p44e4edevstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:23 devstack sudo[94879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_276bad5d-feb0-4ba2-a219-18ecf721ff14_m8p44e4edevstack@QuobyteHD Jul 07 08:20:23 devstack sudo[94879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:23 devstack sudo[94874]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-04cffbc1-f512-4db8-b70c-311cb1c12e68 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d2425b65-0b90-4d90-8c33-48c698bd7cb1" returned: 0 in 0.828s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-04cffbc1-f512-4db8-b70c-311cb1c12e68 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d2425b65-0b90-4d90-8c33-48c698bd7cb1.726439a8-d72a-424e-822b-33959049398b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:23 devstack sudo[94884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d2425b65-0b90-4d90-8c33-48c698bd7cb1.726439a8-d72a-424e-822b-33959049398b Jul 07 08:20:23 devstack sudo[94884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:23 devstack sudo[94879]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_276bad5d-feb0-4ba2-a219-18ecf721ff14_m8p44e4edevstack@QuobyteHD" returned: 0 in 0.826s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:20:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-530901865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ca664cf-cd1e-49fa-a485-270b35c28afa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab7ba131e67f4dc0afe60bf6bcda6d0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:20:20Z,use_quota=True,user_id='a177dd49e8764201b637c45166c21fc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:20:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] Creating volume 8ca664cf-cd1e-49fa-a485-270b35c28afa {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:20:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:20:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:20:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:20:23 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:20:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8ca664cf-cd1e-49fa-a485-270b35c28afa 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:23 devstack sudo[94889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8ca664cf-cd1e-49fa-a485-270b35c28afa 1073741824 Jul 07 08:20:23 devstack sudo[94889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:24 devstack sudo[94884]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-04cffbc1-f512-4db8-b70c-311cb1c12e68 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d2425b65-0b90-4d90-8c33-48c698bd7cb1.726439a8-d72a-424e-822b-33959049398b" returned: 0 in 0.859s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-04cffbc1-f512-4db8-b70c-311cb1c12e68 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d2425b65-0b90-4d90-8c33-48c698bd7cb1.726439a8-d72a-424e-822b-33959049398b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:24 devstack sudo[94894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d2425b65-0b90-4d90-8c33-48c698bd7cb1.726439a8-d72a-424e-822b-33959049398b Jul 07 08:20:24 devstack sudo[94894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-609f792b-5305-485b-8255-bed41ea61af9 tempest-GroupsTest-1420034863 None] Acquiring lock "cinder-quobyte-8e40d066-1a94-41c8-ad68-9d0dd6151188" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:20:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-609f792b-5305-485b-8255-bed41ea61af9 tempest-GroupsTest-1420034863 None] Lock "cinder-quobyte-8e40d066-1a94-41c8-ad68-9d0dd6151188" acquired by "delete_volume" :: waited 0.026s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:20:24 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c08b9b-192a-4f64-8b5c-be3ec5adaacd]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:20:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-609f792b-5305-485b-8255-bed41ea61af9 tempest-GroupsTest-1420034863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8e40d066-1a94-41c8-ad68-9d0dd6151188 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:24 devstack sudo[94896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8e40d066-1a94-41c8-ad68-9d0dd6151188 Jul 07 08:20:24 devstack sudo[94896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:24 devstack sudo[94889]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8ca664cf-cd1e-49fa-a485-270b35c28afa 1073741824" returned: 0 in 1.016s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8ca664cf-cd1e-49fa-a485-270b35c28afa {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:24 devstack sudo[94902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8ca664cf-cd1e-49fa-a485-270b35c28afa Jul 07 08:20:24 devstack sudo[94902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:25 devstack sudo[94894]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-04cffbc1-f512-4db8-b70c-311cb1c12e68 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d2425b65-0b90-4d90-8c33-48c698bd7cb1.726439a8-d72a-424e-822b-33959049398b" returned: 0 in 0.825s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:25 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-04cffbc1-f512-4db8-b70c-311cb1c12e68 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Lock "cinder-quobyte-726439a8-d72a-424e-822b-33959049398b" released by "_delete_snapshot" :: held 3.926s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:20:25 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-04cffbc1-f512-4db8-b70c-311cb1c12e68 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Lock "cinder-quobyte-d2425b65-0b90-4d90-8c33-48c698bd7cb1" released by "delete_snapshot" :: held 3.970s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:20:25 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-04cffbc1-f512-4db8-b70c-311cb1c12e68 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Created reservations ['400ee5c0-4389-4e4a-a3b4-c3ca29412709', '8446f6e1-70e8-4c4a-a2d1-80a12f678643', 'fdc10673-3acc-4ca6-bb2a-dea17cfadc16', 'ae1a99a1-b174-49dd-aac0-41540babeb2c'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:20:25 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-04cffbc1-f512-4db8-b70c-311cb1c12e68 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Delete snapshot completed successfully. Jul 07 08:20:25 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-04cffbc1-f512-4db8-b70c-311cb1c12e68 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Lock "cinder-726439a8-d72a-424e-822b-33959049398b-delete_snapshot" released by "delete_snapshot" :: held 4.160s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:20:25 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c1c4205b-ef50-46ee-8cd7-1492f1fc6c41 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Acquiring lock "cinder-d2425b65-0b90-4d90-8c33-48c698bd7cb1-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:20:25 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c1c4205b-ef50-46ee-8cd7-1492f1fc6c41 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Lock "cinder-d2425b65-0b90-4d90-8c33-48c698bd7cb1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:20:25 devstack sudo[94896]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-609f792b-5305-485b-8255-bed41ea61af9 tempest-GroupsTest-1420034863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8e40d066-1a94-41c8-ad68-9d0dd6151188" returned: 0 in 1.001s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-609f792b-5305-485b-8255-bed41ea61af9 tempest-GroupsTest-1420034863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8e40d066-1a94-41c8-ad68-9d0dd6151188 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:25 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c1c4205b-ef50-46ee-8cd7-1492f1fc6c41 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Acquiring lock "cinder-quobyte-d2425b65-0b90-4d90-8c33-48c698bd7cb1" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:20:25 devstack sudo[94908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8e40d066-1a94-41c8-ad68-9d0dd6151188 Jul 07 08:20:25 devstack sudo[94908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:25 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c1c4205b-ef50-46ee-8cd7-1492f1fc6c41 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Lock "cinder-quobyte-d2425b65-0b90-4d90-8c33-48c698bd7cb1" acquired by "delete_volume" :: waited 0.017s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:20:25 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[34112629-3b5b-4712-9750-a8b164ccebf9]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:20:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c1c4205b-ef50-46ee-8cd7-1492f1fc6c41 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d2425b65-0b90-4d90-8c33-48c698bd7cb1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:25 devstack sudo[94910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d2425b65-0b90-4d90-8c33-48c698bd7cb1 Jul 07 08:20:25 devstack sudo[94910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:25 devstack sudo[94902]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8ca664cf-cd1e-49fa-a485-270b35c28afa" returned: 0 in 0.923s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:25 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] <== create_volume: return (2005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:20:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:25 devstack cinder-volume[87199]: DEBUG cinder.volume.volume_utils [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] Attempting download of 276bad5d-feb0-4ba2-a219-18ecf721ff14 ((None, [{'url': 'file:///opt/stack/data/glance/images/276bad5d-feb0-4ba2-a219-18ecf721ff14', 'metadata': {}}])) to volume 8ca664cf-cd1e-49fa-a485-270b35c28afa. {{(pid=87199) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 08:20:25 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[755f2f9d-8b08-4df2-81b0-31d37613bdc7]: (4, 'raw') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:20:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_276bad5d-feb0-4ba2-a219-18ecf721ff14_sc3rwk3r {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:26 devstack sudo[94927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_276bad5d-feb0-4ba2-a219-18ecf721ff14_sc3rwk3r Jul 07 08:20:26 devstack sudo[94927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:26 devstack sudo[94908]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-609f792b-5305-485b-8255-bed41ea61af9 tempest-GroupsTest-1420034863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8e40d066-1a94-41c8-ad68-9d0dd6151188" returned: 0 in 0.836s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:26 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-609f792b-5305-485b-8255-bed41ea61af9 tempest-GroupsTest-1420034863 None] Lock "cinder-quobyte-8e40d066-1a94-41c8-ad68-9d0dd6151188" released by "delete_volume" :: held 1.900s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:20:26 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-609f792b-5305-485b-8255-bed41ea61af9 tempest-GroupsTest-1420034863 None] Created reservations ['442e12ae-6995-4f5d-82d0-c84d34c98396'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:20:26 devstack cinder-volume[87199]: WARNING cinder.quota [None req-609f792b-5305-485b-8255-bed41ea61af9 tempest-GroupsTest-1420034863 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-240233162 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-240233162, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:20:26 devstack cinder-volume[87199]: WARNING cinder.quota [None req-609f792b-5305-485b-8255-bed41ea61af9 tempest-GroupsTest-1420034863 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-240233162 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-240233162, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:20:26 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-609f792b-5305-485b-8255-bed41ea61af9 tempest-GroupsTest-1420034863 None] Created reservations ['3d483e60-d3f5-4a3f-a80e-c409526fdefe', '3d15df9b-344f-4713-a4cd-a1a549d3618b', '64b290d2-95c8-4735-9205-572d39fae1f6', '9f1b10a4-7d0e-4f57-afd6-19abb5b1bf1a'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:20:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-609f792b-5305-485b-8255-bed41ea61af9 tempest-GroupsTest-1420034863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-609f792b-5305-485b-8255-bed41ea61af9 tempest-GroupsTest-1420034863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:26 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-609f792b-5305-485b-8255-bed41ea61af9 tempest-GroupsTest-1420034863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:20:26 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-609f792b-5305-485b-8255-bed41ea61af9 tempest-GroupsTest-1420034863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:20:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-609f792b-5305-485b-8255-bed41ea61af9 tempest-GroupsTest-1420034863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-609f792b-5305-485b-8255-bed41ea61af9 tempest-GroupsTest-1420034863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:26 devstack sudo[94955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:20:26 devstack sudo[94955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:26 devstack sudo[94910]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c1c4205b-ef50-46ee-8cd7-1492f1fc6c41 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d2425b65-0b90-4d90-8c33-48c698bd7cb1" returned: 0 in 1.206s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c1c4205b-ef50-46ee-8cd7-1492f1fc6c41 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d2425b65-0b90-4d90-8c33-48c698bd7cb1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:26 devstack sudo[94957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d2425b65-0b90-4d90-8c33-48c698bd7cb1 Jul 07 08:20:26 devstack sudo[94957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:27 devstack sudo[94927]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:27 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-caf27adc-6638-471d-adb4-d548dc6fb7a5 tempest-GroupsTest-1420034863 None] Created reservations ['d71693f7-7dff-4be9-b259-67df3c2ebfdd'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:20:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_276bad5d-feb0-4ba2-a219-18ecf721ff14_sc3rwk3r" returned: 0 in 1.170s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_276bad5d-feb0-4ba2-a219-18ecf721ff14_sc3rwk3r {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-caf27adc-6638-471d-adb4-d548dc6fb7a5 tempest-GroupsTest-1420034863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-caf27adc-6638-471d-adb4-d548dc6fb7a5 tempest-GroupsTest-1420034863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:27 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-caf27adc-6638-471d-adb4-d548dc6fb7a5 tempest-GroupsTest-1420034863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:20:27 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-caf27adc-6638-471d-adb4-d548dc6fb7a5 tempest-GroupsTest-1420034863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:20:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-caf27adc-6638-471d-adb4-d548dc6fb7a5 tempest-GroupsTest-1420034863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-caf27adc-6638-471d-adb4-d548dc6fb7a5 tempest-GroupsTest-1420034863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:27 devstack sudo[94961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_276bad5d-feb0-4ba2-a219-18ecf721ff14_sc3rwk3r Jul 07 08:20:27 devstack sudo[94961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:27 devstack sudo[94962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:20:27 devstack sudo[94962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:27 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f890714-7aaa-4b37-a111-0c061e8e3bb6 tempest-VolumesCloneTest-929522347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:20:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1f890714-7aaa-4b37-a111-0c061e8e3bb6 tempest-VolumesCloneTest-929522347 None] Flow 'volume_create_manager' (ac9b6277-ac07-4bb7-a85a-c3118991714d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:20:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1f890714-7aaa-4b37-a111-0c061e8e3bb6 tempest-VolumesCloneTest-929522347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d719c730-1ccc-4769-b507-bf7e059037d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1f890714-7aaa-4b37-a111-0c061e8e3bb6 tempest-VolumesCloneTest-929522347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d719c730-1ccc-4769-b507-bf7e059037d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:20:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-765533685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41c8533b-b176-4a21-ac3d-1c6b04e85edf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aa08075b88048bba04a6cc6797686c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:20:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:20:27Z,use_quota=True,user_id='93cb26e3bd694dd984f202588d611086',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1f890714-7aaa-4b37-a111-0c061e8e3bb6 tempest-VolumesCloneTest-929522347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5218af09-228b-482e-af82-5cf12eaf5054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1f890714-7aaa-4b37-a111-0c061e8e3bb6 tempest-VolumesCloneTest-929522347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5218af09-228b-482e-af82-5cf12eaf5054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1f890714-7aaa-4b37-a111-0c061e8e3bb6 tempest-VolumesCloneTest-929522347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3266092d-fad3-4952-9f9a-684ed6994552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1f890714-7aaa-4b37-a111-0c061e8e3bb6 tempest-VolumesCloneTest-929522347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3266092d-fad3-4952-9f9a-684ed6994552) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41c8533b-b176-4a21-ac3d-1c6b04e85edf', 'volume_name': 'volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1f890714-7aaa-4b37-a111-0c061e8e3bb6 tempest-VolumesCloneTest-929522347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a99b2564-6f50-48f3-ba9c-4aa19f53d87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1f890714-7aaa-4b37-a111-0c061e8e3bb6 tempest-VolumesCloneTest-929522347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a99b2564-6f50-48f3-ba9c-4aa19f53d87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1f890714-7aaa-4b37-a111-0c061e8e3bb6 tempest-VolumesCloneTest-929522347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef09ea32-03f0-459c-ba1b-afb1e70eb995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:27 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-1f890714-7aaa-4b37-a111-0c061e8e3bb6 tempest-VolumesCloneTest-929522347 None] Volume 41c8533b-b176-4a21-ac3d-1c6b04e85edf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf', 'volume_size': 1} Jul 07 08:20:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1f890714-7aaa-4b37-a111-0c061e8e3bb6 tempest-VolumesCloneTest-929522347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1f890714-7aaa-4b37-a111-0c061e8e3bb6 tempest-VolumesCloneTest-929522347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:27 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1f890714-7aaa-4b37-a111-0c061e8e3bb6 tempest-VolumesCloneTest-929522347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:20:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-765533685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41c8533b-b176-4a21-ac3d-1c6b04e85edf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aa08075b88048bba04a6cc6797686c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:20:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:20:27Z,use_quota=True,user_id='93cb26e3bd694dd984f202588d611086',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:20:27 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-1f890714-7aaa-4b37-a111-0c061e8e3bb6 tempest-VolumesCloneTest-929522347 None] Creating volume 41c8533b-b176-4a21-ac3d-1c6b04e85edf {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:20:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1f890714-7aaa-4b37-a111-0c061e8e3bb6 tempest-VolumesCloneTest-929522347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1f890714-7aaa-4b37-a111-0c061e8e3bb6 tempest-VolumesCloneTest-929522347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:27 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1f890714-7aaa-4b37-a111-0c061e8e3bb6 tempest-VolumesCloneTest-929522347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:20:27 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1f890714-7aaa-4b37-a111-0c061e8e3bb6 tempest-VolumesCloneTest-929522347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:20:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1f890714-7aaa-4b37-a111-0c061e8e3bb6 tempest-VolumesCloneTest-929522347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:27 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1f890714-7aaa-4b37-a111-0c061e8e3bb6 tempest-VolumesCloneTest-929522347 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:20:27 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-1f890714-7aaa-4b37-a111-0c061e8e3bb6 tempest-VolumesCloneTest-929522347 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:20:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1f890714-7aaa-4b37-a111-0c061e8e3bb6 tempest-VolumesCloneTest-929522347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:27 devstack sudo[94965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf 1073741824 Jul 07 08:20:27 devstack sudo[94965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:27 devstack sudo[94957]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c1c4205b-ef50-46ee-8cd7-1492f1fc6c41 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d2425b65-0b90-4d90-8c33-48c698bd7cb1" returned: 0 in 0.871s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:27 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c1c4205b-ef50-46ee-8cd7-1492f1fc6c41 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Lock "cinder-quobyte-d2425b65-0b90-4d90-8c33-48c698bd7cb1" released by "delete_volume" :: held 2.169s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:20:27 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-c1c4205b-ef50-46ee-8cd7-1492f1fc6c41 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Created reservations ['f90b7cd3-f3c4-4dc8-b5e8-d9710f88305f', 'f9f58eaf-1c21-41fd-9a59-ab9c76101c0f', 'f3dea6e3-2cc5-49de-943e-1318856dcac2', 'e5852560-61a0-4d4b-bce0-0354d60e9808'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:20:27 devstack sudo[94955]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-609f792b-5305-485b-8255-bed41ea61af9 tempest-GroupsTest-1420034863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 1.273s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:27 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-609f792b-5305-485b-8255-bed41ea61af9 tempest-GroupsTest-1420034863 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:20:27 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-609f792b-5305-485b-8255-bed41ea61af9 tempest-GroupsTest-1420034863 None] Delete group completed successfully. Jul 07 08:20:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c1c4205b-ef50-46ee-8cd7-1492f1fc6c41 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c1c4205b-ef50-46ee-8cd7-1492f1fc6c41 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:27 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c1c4205b-ef50-46ee-8cd7-1492f1fc6c41 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:20:27 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c1c4205b-ef50-46ee-8cd7-1492f1fc6c41 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:20:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c1c4205b-ef50-46ee-8cd7-1492f1fc6c41 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c1c4205b-ef50-46ee-8cd7-1492f1fc6c41 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:28 devstack sudo[94972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:20:28 devstack sudo[94972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:28 devstack sudo[94961]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_276bad5d-feb0-4ba2-a219-18ecf721ff14_sc3rwk3r" returned: 1 in 1.001s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_276bad5d-feb0-4ba2-a219-18ecf721ff14_sc3rwk3r' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:20:28 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[d765153c-7441-46f8-8492-df10093b5e46]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:20:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_276bad5d-feb0-4ba2-a219-18ecf721ff14_m8p44e4edevstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:28 devstack sudo[94962]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-caf27adc-6638-471d-adb4-d548dc6fb7a5 tempest-GroupsTest-1420034863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.936s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:28 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-caf27adc-6638-471d-adb4-d548dc6fb7a5 tempest-GroupsTest-1420034863 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:20:28 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-caf27adc-6638-471d-adb4-d548dc6fb7a5 tempest-GroupsTest-1420034863 None] Delete group completed successfully. Jul 07 08:20:28 devstack sudo[94977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_276bad5d-feb0-4ba2-a219-18ecf721ff14_m8p44e4edevstack@QuobyteHD Jul 07 08:20:28 devstack sudo[94977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:28 devstack sudo[94965]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1f890714-7aaa-4b37-a111-0c061e8e3bb6 tempest-VolumesCloneTest-929522347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf 1073741824" returned: 0 in 0.970s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1f890714-7aaa-4b37-a111-0c061e8e3bb6 tempest-VolumesCloneTest-929522347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:28 devstack sudo[94980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf Jul 07 08:20:28 devstack sudo[94980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:28 devstack sudo[94972]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c1c4205b-ef50-46ee-8cd7-1492f1fc6c41 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.816s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:28 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-c1c4205b-ef50-46ee-8cd7-1492f1fc6c41 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:20:28 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-01af5ccc-1fbf-4614-8ff7-34a0ef14db37 tempest-GroupsTest-1420034863 None] Group tempest-GroupsTest-Group-602036401: creating Jul 07 08:20:28 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-c1c4205b-ef50-46ee-8cd7-1492f1fc6c41 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Deleted volume successfully. Jul 07 08:20:28 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c1c4205b-ef50-46ee-8cd7-1492f1fc6c41 tempest-VolumeSnapshotQuotasNegativeTestJSON-281710977 None] Lock "cinder-d2425b65-0b90-4d90-8c33-48c698bd7cb1-delete_volume" released by "delete_volume" :: held 3.430s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:20:28 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-01af5ccc-1fbf-4614-8ff7-34a0ef14db37 tempest-GroupsTest-1420034863 None] Group tempest-GroupsTest-Group-602036401: created successfully Jul 07 08:20:28 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-01af5ccc-1fbf-4614-8ff7-34a0ef14db37 tempest-GroupsTest-1420034863 None] Create group completed successfully. Jul 07 08:20:29 devstack sudo[94977]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_276bad5d-feb0-4ba2-a219-18ecf721ff14_m8p44e4edevstack@QuobyteHD" returned: 0 in 0.914s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:29 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] 276bad5d-feb0-4ba2-a219-18ecf721ff14 was qcow2, converting to raw {{(pid=87199) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 08:20:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_276bad5d-feb0-4ba2-a219-18ecf721ff14_m8p44e4edevstack@QuobyteHD /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8ca664cf-cd1e-49fa-a485-270b35c28afa {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:29 devstack sudo[94986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_276bad5d-feb0-4ba2-a219-18ecf721ff14_m8p44e4edevstack@QuobyteHD /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8ca664cf-cd1e-49fa-a485-270b35c28afa Jul 07 08:20:29 devstack sudo[94986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:29 devstack sudo[94980]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1f890714-7aaa-4b37-a111-0c061e8e3bb6 tempest-VolumesCloneTest-929522347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf" returned: 0 in 0.839s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:29 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1f890714-7aaa-4b37-a111-0c061e8e3bb6 tempest-VolumesCloneTest-929522347 None] <== create_volume: return (1863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:20:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1f890714-7aaa-4b37-a111-0c061e8e3bb6 tempest-VolumesCloneTest-929522347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.866s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1f890714-7aaa-4b37-a111-0c061e8e3bb6 tempest-VolumesCloneTest-929522347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef09ea32-03f0-459c-ba1b-afb1e70eb995) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1f890714-7aaa-4b37-a111-0c061e8e3bb6 tempest-VolumesCloneTest-929522347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d7a220e-285a-4052-ab7a-fb2a00dada93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:29 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-1f890714-7aaa-4b37-a111-0c061e8e3bb6 tempest-VolumesCloneTest-929522347 None] Volume volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf (41c8533b-b176-4a21-ac3d-1c6b04e85edf): created successfully Jul 07 08:20:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1f890714-7aaa-4b37-a111-0c061e8e3bb6 tempest-VolumesCloneTest-929522347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d7a220e-285a-4052-ab7a-fb2a00dada93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1f890714-7aaa-4b37-a111-0c061e8e3bb6 tempest-VolumesCloneTest-929522347 None] Flow 'volume_create_manager' (ac9b6277-ac07-4bb7-a85a-c3118991714d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:20:29 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-1f890714-7aaa-4b37-a111-0c061e8e3bb6 tempest-VolumesCloneTest-929522347 None] Created volume successfully. Jul 07 08:20:30 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-29162e1a-f680-4c94-a8ed-316413f4019e tempest-GroupsTest-1420034863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:20:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-29162e1a-f680-4c94-a8ed-316413f4019e tempest-GroupsTest-1420034863 None] Flow 'volume_create_manager' (96fb9535-c572-4554-b8de-8e9df2276f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:20:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-29162e1a-f680-4c94-a8ed-316413f4019e tempest-GroupsTest-1420034863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04a46ee1-a077-49b8-82d2-5fcfa6d5ef6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-29162e1a-f680-4c94-a8ed-316413f4019e tempest-GroupsTest-1420034863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04a46ee1-a077-49b8-82d2-5fcfa6d5ef6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:20:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-794661488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f450828c-1f9b-45f5-ae70-61076b16b7a0,host='devstack@QuobyteHD#QuobyteHD',id=6488eadf-3235-456f-a1a8-d0946f2021f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='724291ad208541308ee3dea868227df8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:20:30Z,use_quota=True,user_id='7c790bb0c1af4f50b8cb3501d9eb7db5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d4de13a-dd1e-4ade-81ef-e4d9e4eea9fc),volume_type_id=8d4de13a-dd1e-4ade-81ef-e4d9e4eea9fc)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-29162e1a-f680-4c94-a8ed-316413f4019e tempest-GroupsTest-1420034863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (031a5958-12ff-4137-a9e7-0b1e698910ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-29162e1a-f680-4c94-a8ed-316413f4019e tempest-GroupsTest-1420034863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (031a5958-12ff-4137-a9e7-0b1e698910ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-29162e1a-f680-4c94-a8ed-316413f4019e tempest-GroupsTest-1420034863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (878b9275-0a81-4194-bc9c-45fa97ded7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-29162e1a-f680-4c94-a8ed-316413f4019e tempest-GroupsTest-1420034863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (878b9275-0a81-4194-bc9c-45fa97ded7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6488eadf-3235-456f-a1a8-d0946f2021f5', 'volume_name': 'volume-6488eadf-3235-456f-a1a8-d0946f2021f5', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-29162e1a-f680-4c94-a8ed-316413f4019e tempest-GroupsTest-1420034863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b6d9de8-be97-4901-b9fb-ea41fa779198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-29162e1a-f680-4c94-a8ed-316413f4019e tempest-GroupsTest-1420034863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b6d9de8-be97-4901-b9fb-ea41fa779198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-29162e1a-f680-4c94-a8ed-316413f4019e tempest-GroupsTest-1420034863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81f5c526-ba8e-44b1-a896-3cce1d164148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:30 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-29162e1a-f680-4c94-a8ed-316413f4019e tempest-GroupsTest-1420034863 None] Volume 6488eadf-3235-456f-a1a8-d0946f2021f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6488eadf-3235-456f-a1a8-d0946f2021f5', 'volume_size': 1} Jul 07 08:20:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-29162e1a-f680-4c94-a8ed-316413f4019e tempest-GroupsTest-1420034863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-29162e1a-f680-4c94-a8ed-316413f4019e tempest-GroupsTest-1420034863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:30 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-29162e1a-f680-4c94-a8ed-316413f4019e tempest-GroupsTest-1420034863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f450828c-1f9b-45f5-ae70-61076b16b7a0,created_at=2026-07-07T06:20:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-794661488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f450828c-1f9b-45f5-ae70-61076b16b7a0,host='devstack@QuobyteHD#QuobyteHD',id=6488eadf-3235-456f-a1a8-d0946f2021f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='724291ad208541308ee3dea868227df8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:20:30Z,use_quota=True,user_id='7c790bb0c1af4f50b8cb3501d9eb7db5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d4de13a-dd1e-4ade-81ef-e4d9e4eea9fc),volume_type_id=8d4de13a-dd1e-4ade-81ef-e4d9e4eea9fc)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:20:30 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-29162e1a-f680-4c94-a8ed-316413f4019e tempest-GroupsTest-1420034863 None] Creating volume 6488eadf-3235-456f-a1a8-d0946f2021f5 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:20:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-29162e1a-f680-4c94-a8ed-316413f4019e tempest-GroupsTest-1420034863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-29162e1a-f680-4c94-a8ed-316413f4019e tempest-GroupsTest-1420034863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:30 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-29162e1a-f680-4c94-a8ed-316413f4019e tempest-GroupsTest-1420034863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:20:30 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-29162e1a-f680-4c94-a8ed-316413f4019e tempest-GroupsTest-1420034863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:20:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-29162e1a-f680-4c94-a8ed-316413f4019e tempest-GroupsTest-1420034863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:30 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-29162e1a-f680-4c94-a8ed-316413f4019e tempest-GroupsTest-1420034863 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:20:30 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-29162e1a-f680-4c94-a8ed-316413f4019e tempest-GroupsTest-1420034863 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:20:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-29162e1a-f680-4c94-a8ed-316413f4019e tempest-GroupsTest-1420034863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6488eadf-3235-456f-a1a8-d0946f2021f5 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:30 devstack sudo[94997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6488eadf-3235-456f-a1a8-d0946f2021f5 1073741824 Jul 07 08:20:30 devstack sudo[94997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:31 devstack sudo[94986]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_276bad5d-feb0-4ba2-a219-18ecf721ff14_m8p44e4edevstack@QuobyteHD /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8ca664cf-cd1e-49fa-a485-270b35c28afa" returned: 0 in 2.290s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:31 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_276bad5d-feb0-4ba2-a219-18ecf721ff14_m8p44e4edevstack@QuobyteHD, size 112.00 MB, duration 2.29 sec, destination /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8ca664cf-cd1e-49fa-a485-270b35c28afa {{(pid=87199) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 08:20:31 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] Converted 112.00 MB image at 48.87 MB/s Jul 07 08:20:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8ca664cf-cd1e-49fa-a485-270b35c28afa 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:31 devstack sudo[94999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8ca664cf-cd1e-49fa-a485-270b35c28afa 1G Jul 07 08:20:31 devstack sudo[94999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:31 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:20:31 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] Flow 'volume_create_manager' (f512b01c-4fb9-498e-b137-6089926d1a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:20:31 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (009654ad-36c2-4a2c-9690-779a01fe158b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:31 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (009654ad-36c2-4a2c-9690-779a01fe158b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-189625104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00973b75-7fc1-4246-8260-f370d34d2fbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aa08075b88048bba04a6cc6797686c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:20:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=41c8533b-b176-4a21-ac3d-1c6b04e85edf,status='creating',terminated_at=None,updated_at=2026-07-07T06:20:31Z,use_quota=True,user_id='93cb26e3bd694dd984f202588d611086',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:31 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17c02a1c-2a4f-429b-9aa0-96a9baac5d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:31 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17c02a1c-2a4f-429b-9aa0-96a9baac5d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:31 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b437d9ab-7e03-4541-a27f-c17a637391bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:31 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b437d9ab-7e03-4541-a27f-c17a637391bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '00973b75-7fc1-4246-8260-f370d34d2fbc', 'volume_name': 'volume-00973b75-7fc1-4246-8260-f370d34d2fbc', 'volume_size': 2, 'source_volid': '41c8533b-b176-4a21-ac3d-1c6b04e85edf', 'source_volstatus': 'available'}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:31 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90f09267-80ca-4577-ac70-cf94e7d2fa66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:31 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90f09267-80ca-4577-ac70-cf94e7d2fa66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:31 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2f4c09c-01f0-4886-8ce0-0658af6897ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:31 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] Volume 00973b75-7fc1-4246-8260-f370d34d2fbc: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-00973b75-7fc1-4246-8260-f370d34d2fbc', 'volume_size': 2, 'source_volid': '41c8533b-b176-4a21-ac3d-1c6b04e85edf', 'source_volstatus': 'available'} Jul 07 08:20:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:31 devstack sudo[94997]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-29162e1a-f680-4c94-a8ed-316413f4019e tempest-GroupsTest-1420034863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6488eadf-3235-456f-a1a8-d0946f2021f5 1073741824" returned: 0 in 1.168s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-29162e1a-f680-4c94-a8ed-316413f4019e tempest-GroupsTest-1420034863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6488eadf-3235-456f-a1a8-d0946f2021f5 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:31 devstack sudo[95005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6488eadf-3235-456f-a1a8-d0946f2021f5 Jul 07 08:20:31 devstack sudo[95005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:32 devstack sudo[94999]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8ca664cf-cd1e-49fa-a485-270b35c28afa 1G" returned: 0 in 0.801s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:32 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fad3029-916e-4b20-b64b-ce20d198f962]: (4, 'raw') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:20:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8ca664cf-cd1e-49fa-a485-270b35c28afa {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:32 devstack sudo[95010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8ca664cf-cd1e-49fa-a485-270b35c28afa Jul 07 08:20:32 devstack sudo[95010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:32 devstack sudo[95005]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-29162e1a-f680-4c94-a8ed-316413f4019e tempest-GroupsTest-1420034863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6488eadf-3235-456f-a1a8-d0946f2021f5" returned: 0 in 0.729s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:32 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-29162e1a-f680-4c94-a8ed-316413f4019e tempest-GroupsTest-1420034863 None] <== create_volume: return (1938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:20:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-29162e1a-f680-4c94-a8ed-316413f4019e tempest-GroupsTest-1420034863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.941s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.113s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:32 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] Cloning volume 41c8533b-b176-4a21-ac3d-1c6b04e85edf to volume 00973b75-7fc1-4246-8260-f370d34d2fbc Jul 07 08:20:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-29162e1a-f680-4c94-a8ed-316413f4019e tempest-GroupsTest-1420034863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81f5c526-ba8e-44b1-a896-3cce1d164148) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6488eadf-3235-456f-a1a8-d0946f2021f5', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-29162e1a-f680-4c94-a8ed-316413f4019e tempest-GroupsTest-1420034863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6712f89b-cf4b-494a-a907-e3f61f7e9292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:32 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-29162e1a-f680-4c94-a8ed-316413f4019e tempest-GroupsTest-1420034863 None] Volume volume-6488eadf-3235-456f-a1a8-d0946f2021f5 (6488eadf-3235-456f-a1a8-d0946f2021f5): created successfully Jul 07 08:20:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-29162e1a-f680-4c94-a8ed-316413f4019e tempest-GroupsTest-1420034863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6712f89b-cf4b-494a-a907-e3f61f7e9292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-29162e1a-f680-4c94-a8ed-316413f4019e tempest-GroupsTest-1420034863 None] Flow 'volume_create_manager' (96fb9535-c572-4554-b8de-8e9df2276f10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:20:32 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] Creating offline snapshot 0da4ee6a-78e6-4bd5-80fd-69627904397b of volume 41c8533b-b176-4a21-ac3d-1c6b04e85edf {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:20:32 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-29162e1a-f680-4c94-a8ed-316413f4019e tempest-GroupsTest-1420034863 None] Created volume successfully. Jul 07 08:20:32 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7b0862-72a1-49ef-8ff4-f1470b2e45e6]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:20:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:32 devstack sudo[95013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf Jul 07 08:20:32 devstack sudo[95013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:33 devstack sudo[95010]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8ca664cf-cd1e-49fa-a485-270b35c28afa" returned: 0 in 0.948s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8ca664cf-cd1e-49fa-a485-270b35c28afa {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:33 devstack sudo[95017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8ca664cf-cd1e-49fa-a485-270b35c28afa Jul 07 08:20:33 devstack sudo[95017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:33 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ebbf74e-4fa1-4ed2-bbb3-23b2aa9b7c87 tempest-GroupsTest-1420034863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:20:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5ebbf74e-4fa1-4ed2-bbb3-23b2aa9b7c87 tempest-GroupsTest-1420034863 None] Flow 'volume_create_manager' (e4710c82-8bb8-4c13-bb57-b32563832b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:20:33 devstack sudo[95013]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5ebbf74e-4fa1-4ed2-bbb3-23b2aa9b7c87 tempest-GroupsTest-1420034863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c6a4fe8-681f-4148-a038-4966818ba753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf" returned: 0 in 1.032s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf.0da4ee6a-78e6-4bd5-80fd-69627904397b 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5ebbf74e-4fa1-4ed2-bbb3-23b2aa9b7c87 tempest-GroupsTest-1420034863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c6a4fe8-681f-4148-a038-4966818ba753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1865647421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f450828c-1f9b-45f5-ae70-61076b16b7a0,host='devstack@QuobyteHD#QuobyteHD',id=5f609f9e-b4e9-4ece-891e-f2f0e2b14407,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='724291ad208541308ee3dea868227df8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:20:34Z,use_quota=True,user_id='7c790bb0c1af4f50b8cb3501d9eb7db5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d4de13a-dd1e-4ade-81ef-e4d9e4eea9fc),volume_type_id=8d4de13a-dd1e-4ade-81ef-e4d9e4eea9fc)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:33 devstack sudo[95022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf.0da4ee6a-78e6-4bd5-80fd-69627904397b 1G Jul 07 08:20:33 devstack sudo[95022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5ebbf74e-4fa1-4ed2-bbb3-23b2aa9b7c87 tempest-GroupsTest-1420034863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (076cc246-8aaa-4cf5-b9ec-e6461a81ddf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5ebbf74e-4fa1-4ed2-bbb3-23b2aa9b7c87 tempest-GroupsTest-1420034863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (076cc246-8aaa-4cf5-b9ec-e6461a81ddf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5ebbf74e-4fa1-4ed2-bbb3-23b2aa9b7c87 tempest-GroupsTest-1420034863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0034b7a5-1531-4144-ac95-1bdf4727b950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5ebbf74e-4fa1-4ed2-bbb3-23b2aa9b7c87 tempest-GroupsTest-1420034863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0034b7a5-1531-4144-ac95-1bdf4727b950) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f609f9e-b4e9-4ece-891e-f2f0e2b14407', 'volume_name': 'volume-5f609f9e-b4e9-4ece-891e-f2f0e2b14407', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5ebbf74e-4fa1-4ed2-bbb3-23b2aa9b7c87 tempest-GroupsTest-1420034863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54bce65f-9764-4c03-9350-e6f8cf77277a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5ebbf74e-4fa1-4ed2-bbb3-23b2aa9b7c87 tempest-GroupsTest-1420034863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54bce65f-9764-4c03-9350-e6f8cf77277a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5ebbf74e-4fa1-4ed2-bbb3-23b2aa9b7c87 tempest-GroupsTest-1420034863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eac83a5-d139-49cd-96de-bc0425ada35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:33 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-5ebbf74e-4fa1-4ed2-bbb3-23b2aa9b7c87 tempest-GroupsTest-1420034863 None] Volume 5f609f9e-b4e9-4ece-891e-f2f0e2b14407: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f609f9e-b4e9-4ece-891e-f2f0e2b14407', 'volume_size': 1} Jul 07 08:20:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-5ebbf74e-4fa1-4ed2-bbb3-23b2aa9b7c87 tempest-GroupsTest-1420034863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:33 devstack sudo[95017]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8ca664cf-cd1e-49fa-a485-270b35c28afa" returned: 1 in 0.882s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8ca664cf-cd1e-49fa-a485-270b35c28afa' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:20:33 devstack cinder-volume[87199]: DEBUG cinder.volume.volume_utils [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] Downloaded image 276bad5d-feb0-4ba2-a219-18ecf721ff14 ((None, [{'url': 'file:///opt/stack/data/glance/images/276bad5d-feb0-4ba2-a219-18ecf721ff14', 'metadata': {}}])) to volume 8ca664cf-cd1e-49fa-a485-270b35c28afa successfully. {{(pid=87199) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 08:20:34 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] Temporary image 276bad5d-feb0-4ba2-a219-18ecf721ff14 for user a177dd49e8764201b637c45166c21fc2 is deleted. {{(pid=87199) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 08:20:34 devstack cinder-volume[87199]: DEBUG cinder.volume.volume_utils [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] Marking volume 8ca664cf-cd1e-49fa-a485-270b35c28afa as bootable. {{(pid=87199) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 08:20:34 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] Copying metadata from image 276bad5d-feb0-4ba2-a219-18ecf721ff14 to 8ca664cf-cd1e-49fa-a485-270b35c28afa. {{(pid=87199) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 08:20:34 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] Creating volume glance metadata for volume 8ca664cf-cd1e-49fa-a485-270b35c28afa backed by image 276bad5d-feb0-4ba2-a219-18ecf721ff14 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '276bad5d-feb0-4ba2-a219-18ecf721ff14', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87199) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 08:20:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2477a4e1-caf6-40e6-ab6e-a1723596f89f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ca664cf-cd1e-49fa-a485-270b35c28afa', 'volume_size': 1, 'image_id': '276bad5d-feb0-4ba2-a219-18ecf721ff14', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/276bad5d-feb0-4ba2-a219-18ecf721ff14', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '616624e32aa447818ca627e0bb0985c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '276bad5d-feb0-4ba2-a219-18ecf721ff14', 'created_at': datetime.datetime(2026, 7, 7, 6, 6, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 6, 6, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/276bad5d-feb0-4ba2-a219-18ecf721ff14/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54bd2d7c-efa6-421e-9cf3-ddd2d6c9605a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:34 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] Volume volume-8ca664cf-cd1e-49fa-a485-270b35c28afa (8ca664cf-cd1e-49fa-a485-270b35c28afa): created successfully Jul 07 08:20:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54bd2d7c-efa6-421e-9cf3-ddd2d6c9605a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] Flow 'volume_create_manager' (e84fa66b-4325-4006-b9de-39129c4b76e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:20:34 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-78ea1439-d7b1-466d-bbc8-41eb4ceacdef tempest-VolumesImageMetadata-727263025 None] Created volume successfully. Jul 07 08:20:34 devstack sudo[95022]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf.0da4ee6a-78e6-4bd5-80fd-69627904397b 1G" returned: 0 in 0.965s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf.0da4ee6a-78e6-4bd5-80fd-69627904397b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:34 devstack sudo[95030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf.0da4ee6a-78e6-4bd5-80fd-69627904397b Jul 07 08:20:34 devstack sudo[95030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:34 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-25bfc837-fc93-45ec-a321-7d3722ec837c tempest-VolumesImageMetadata-727263025 None] Acquiring lock "cinder-8ca664cf-cd1e-49fa-a485-270b35c28afa-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:20:34 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-25bfc837-fc93-45ec-a321-7d3722ec837c tempest-VolumesImageMetadata-727263025 None] Lock "cinder-8ca664cf-cd1e-49fa-a485-270b35c28afa-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:20:34 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-25bfc837-fc93-45ec-a321-7d3722ec837c tempest-VolumesImageMetadata-727263025 None] Acquiring lock "cinder-quobyte-8ca664cf-cd1e-49fa-a485-270b35c28afa" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:20:34 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-25bfc837-fc93-45ec-a321-7d3722ec837c tempest-VolumesImageMetadata-727263025 None] Lock "cinder-quobyte-8ca664cf-cd1e-49fa-a485-270b35c28afa" acquired by "delete_volume" :: waited 0.029s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:20:35 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3bbccd6-cfe7-4447-b15d-f2fb762e9399]: (4, 'raw') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:20:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-25bfc837-fc93-45ec-a321-7d3722ec837c tempest-VolumesImageMetadata-727263025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8ca664cf-cd1e-49fa-a485-270b35c28afa {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:35 devstack sudo[95032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8ca664cf-cd1e-49fa-a485-270b35c28afa Jul 07 08:20:35 devstack sudo[95032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:35 devstack sudo[95030]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf.0da4ee6a-78e6-4bd5-80fd-69627904397b" returned: 0 in 0.761s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:35 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf.0da4ee6a-78e6-4bd5-80fd-69627904397b is being set with open permissions: ugo+rw Jul 07 08:20:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf.0da4ee6a-78e6-4bd5-80fd-69627904397b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:35 devstack sudo[95037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf.0da4ee6a-78e6-4bd5-80fd-69627904397b Jul 07 08:20:35 devstack sudo[95037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:35 devstack sudo[95032]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-25bfc837-fc93-45ec-a321-7d3722ec837c tempest-VolumesImageMetadata-727263025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8ca664cf-cd1e-49fa-a485-270b35c28afa" returned: 0 in 0.844s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-25bfc837-fc93-45ec-a321-7d3722ec837c tempest-VolumesImageMetadata-727263025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8ca664cf-cd1e-49fa-a485-270b35c28afa {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:36 devstack sudo[95041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8ca664cf-cd1e-49fa-a485-270b35c28afa Jul 07 08:20:36 devstack sudo[95041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:36 devstack sudo[95037]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf.0da4ee6a-78e6-4bd5-80fd-69627904397b" returned: 0 in 0.864s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:36 devstack sudo[95044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf.info Jul 07 08:20:36 devstack sudo[95044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:36 devstack sudo[95041]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-25bfc837-fc93-45ec-a321-7d3722ec837c tempest-VolumesImageMetadata-727263025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8ca664cf-cd1e-49fa-a485-270b35c28afa" returned: 1 in 0.808s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-25bfc837-fc93-45ec-a321-7d3722ec837c tempest-VolumesImageMetadata-727263025 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8ca664cf-cd1e-49fa-a485-270b35c28afa' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:20:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-25bfc837-fc93-45ec-a321-7d3722ec837c tempest-VolumesImageMetadata-727263025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8ca664cf-cd1e-49fa-a485-270b35c28afa {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:36 devstack sudo[95049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8ca664cf-cd1e-49fa-a485-270b35c28afa Jul 07 08:20:36 devstack sudo[95049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:37 devstack sudo[95044]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf.info" returned: 0 in 0.735s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:37 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf.info is being set with open permissions: ugo+rw Jul 07 08:20:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:37 devstack sudo[95052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf.info Jul 07 08:20:37 devstack sudo[95052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:37 devstack sudo[95049]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-25bfc837-fc93-45ec-a321-7d3722ec837c tempest-VolumesImageMetadata-727263025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8ca664cf-cd1e-49fa-a485-270b35c28afa" returned: 0 in 0.715s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:37 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-25bfc837-fc93-45ec-a321-7d3722ec837c tempest-VolumesImageMetadata-727263025 None] Lock "cinder-quobyte-8ca664cf-cd1e-49fa-a485-270b35c28afa" released by "delete_volume" :: held 2.446s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:20:37 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-25bfc837-fc93-45ec-a321-7d3722ec837c tempest-VolumesImageMetadata-727263025 None] Created reservations ['d4f27c23-047c-467d-81d0-0cb326c12c4e', '62f1cb0d-bd92-4a37-ad5f-3d614a51bf0e', '82f5a8b3-b0fd-4e4a-aa83-6f08e8d70372', 'c4189863-a9a6-40e5-985f-03024bf2823e'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:20:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-25bfc837-fc93-45ec-a321-7d3722ec837c tempest-VolumesImageMetadata-727263025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-25bfc837-fc93-45ec-a321-7d3722ec837c tempest-VolumesImageMetadata-727263025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:37 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-25bfc837-fc93-45ec-a321-7d3722ec837c tempest-VolumesImageMetadata-727263025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:20:37 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-25bfc837-fc93-45ec-a321-7d3722ec837c tempest-VolumesImageMetadata-727263025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:20:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-25bfc837-fc93-45ec-a321-7d3722ec837c tempest-VolumesImageMetadata-727263025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-25bfc837-fc93-45ec-a321-7d3722ec837c tempest-VolumesImageMetadata-727263025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:37 devstack sudo[95055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:20:37 devstack sudo[95055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:37 devstack sudo[95052]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf.info" returned: 0 in 0.744s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:37 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] Acquiring lock "cinder-quobyte-00973b75-7fc1-4246-8260-f370d34d2fbc" by "_copy_volume_from_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:20:37 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] Lock "cinder-quobyte-00973b75-7fc1-4246-8260-f370d34d2fbc" acquired by "_copy_volume_from_snapshot" :: waited 0.044s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:20:37 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] snapshot: 0da4ee6a-78e6-4bd5-80fd-69627904397b, volume: 00973b75-7fc1-4246-8260-f370d34d2fbc, {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 08:20:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:37 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:20:37 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:20:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:37 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aaa1262-60e7-44da-89d0-a33b40c636cf]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:20:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf.0da4ee6a-78e6-4bd5-80fd-69627904397b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:38 devstack sudo[95058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf.0da4ee6a-78e6-4bd5-80fd-69627904397b Jul 07 08:20:38 devstack sudo[95058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:38 devstack sudo[95055]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-25bfc837-fc93-45ec-a321-7d3722ec837c tempest-VolumesImageMetadata-727263025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.749s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:38 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-25bfc837-fc93-45ec-a321-7d3722ec837c tempest-VolumesImageMetadata-727263025 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:20:38 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-25bfc837-fc93-45ec-a321-7d3722ec837c tempest-VolumesImageMetadata-727263025 None] Deleted volume successfully. Jul 07 08:20:38 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-25bfc837-fc93-45ec-a321-7d3722ec837c tempest-VolumesImageMetadata-727263025 None] Lock "cinder-8ca664cf-cd1e-49fa-a485-270b35c28afa-delete_volume" released by "delete_volume" :: held 3.440s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:20:38 devstack sudo[95058]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf.0da4ee6a-78e6-4bd5-80fd-69627904397b" returned: 0 in 0.846s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:38 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:20:38 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 08:20:38 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] Creating direct copy from snapshot {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 08:20:38 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad57e67d-1dc9-406f-ac69-d63545b85df5]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:20:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:38 devstack sudo[95064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf Jul 07 08:20:38 devstack sudo[95064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:39 devstack sudo[95064]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf" returned: 0 in 0.843s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:39 devstack cinder-volume[87199]: DEBUG cinder.utils [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] Path /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-00973b75-7fc1-4246-8260-f370d34d2fbc not found in is_blk_device check {{(pid=87199) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 08:20:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-00973b75-7fc1-4246-8260-f370d34d2fbc {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:39 devstack sudo[95069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-00973b75-7fc1-4246-8260-f370d34d2fbc Jul 07 08:20:39 devstack sudo[95069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:43 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-39933e92-1630-4585-8aa1-5926332c541e tempest-SnapshotMetadataTestJSON-780618117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:20:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-39933e92-1630-4585-8aa1-5926332c541e tempest-SnapshotMetadataTestJSON-780618117 None] Flow 'volume_create_manager' (5703fa63-92ba-4a26-9548-053da504c90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:20:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-39933e92-1630-4585-8aa1-5926332c541e tempest-SnapshotMetadataTestJSON-780618117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c2a3d49-a4c0-4a40-af98-6b4c866f16ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-39933e92-1630-4585-8aa1-5926332c541e tempest-SnapshotMetadataTestJSON-780618117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c2a3d49-a4c0-4a40-af98-6b4c866f16ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-55647614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26362ef2-b5bc-4836-aedb-4346f7b3b746,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a3f26f1369749898d13c9f1af23833a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:20:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:20:43Z,use_quota=True,user_id='e1b77d670c384329a9f33eb6dcb818a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-39933e92-1630-4585-8aa1-5926332c541e tempest-SnapshotMetadataTestJSON-780618117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62534d17-67af-4cdf-9ff8-b71f431c5f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-39933e92-1630-4585-8aa1-5926332c541e tempest-SnapshotMetadataTestJSON-780618117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62534d17-67af-4cdf-9ff8-b71f431c5f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-39933e92-1630-4585-8aa1-5926332c541e tempest-SnapshotMetadataTestJSON-780618117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (564cd720-b3d2-4896-9768-7f525bd582de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-39933e92-1630-4585-8aa1-5926332c541e tempest-SnapshotMetadataTestJSON-780618117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (564cd720-b3d2-4896-9768-7f525bd582de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26362ef2-b5bc-4836-aedb-4346f7b3b746', 'volume_name': 'volume-26362ef2-b5bc-4836-aedb-4346f7b3b746', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-39933e92-1630-4585-8aa1-5926332c541e tempest-SnapshotMetadataTestJSON-780618117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (569c2d85-a438-49a4-8bd3-97ddbb247493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-39933e92-1630-4585-8aa1-5926332c541e tempest-SnapshotMetadataTestJSON-780618117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (569c2d85-a438-49a4-8bd3-97ddbb247493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-39933e92-1630-4585-8aa1-5926332c541e tempest-SnapshotMetadataTestJSON-780618117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d1c5038-cec5-44f2-867b-6258ef43eba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:43 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-39933e92-1630-4585-8aa1-5926332c541e tempest-SnapshotMetadataTestJSON-780618117 None] Volume 26362ef2-b5bc-4836-aedb-4346f7b3b746: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26362ef2-b5bc-4836-aedb-4346f7b3b746', 'volume_size': 1} Jul 07 08:20:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-39933e92-1630-4585-8aa1-5926332c541e tempest-SnapshotMetadataTestJSON-780618117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:45 devstack sudo[95069]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-00973b75-7fc1-4246-8260-f370d34d2fbc" returned: 0 in 5.396s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:45 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7f3f00-1cdd-4cd0-860e-5eeef0e082c3]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:20:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:45 devstack sudo[95084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf Jul 07 08:20:45 devstack sudo[95084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:45 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-50f4cd75-7674-4653-bb98-0ee19eb1b867 tempest-VolumesDeleteCascade-1233200636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:20:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-50f4cd75-7674-4653-bb98-0ee19eb1b867 tempest-VolumesDeleteCascade-1233200636 None] Flow 'volume_create_manager' (b5619add-c5da-4ea4-82d3-0c8ff43a84a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:20:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-50f4cd75-7674-4653-bb98-0ee19eb1b867 tempest-VolumesDeleteCascade-1233200636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (145b0ef1-c839-4f84-9141-7ce866844062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-50f4cd75-7674-4653-bb98-0ee19eb1b867 tempest-VolumesDeleteCascade-1233200636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (145b0ef1-c839-4f84-9141-7ce866844062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:20:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-279080987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f333c782-57cf-4a54-a396-b88b60fc891d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97188b0d72f54c39b53585699c758934',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:20:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:20:46Z,use_quota=True,user_id='f333b41c84eb421388e3b21cdc55b91d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-50f4cd75-7674-4653-bb98-0ee19eb1b867 tempest-VolumesDeleteCascade-1233200636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ec65eca-0560-4c46-8d72-4a3510d65231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-50f4cd75-7674-4653-bb98-0ee19eb1b867 tempest-VolumesDeleteCascade-1233200636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ec65eca-0560-4c46-8d72-4a3510d65231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-50f4cd75-7674-4653-bb98-0ee19eb1b867 tempest-VolumesDeleteCascade-1233200636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (302962cd-08d6-4333-a569-fc4bc768cbf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-50f4cd75-7674-4653-bb98-0ee19eb1b867 tempest-VolumesDeleteCascade-1233200636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (302962cd-08d6-4333-a569-fc4bc768cbf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f333c782-57cf-4a54-a396-b88b60fc891d', 'volume_name': 'volume-f333c782-57cf-4a54-a396-b88b60fc891d', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-50f4cd75-7674-4653-bb98-0ee19eb1b867 tempest-VolumesDeleteCascade-1233200636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16d5948e-6b64-4d79-853e-5ec3ddfeb545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-50f4cd75-7674-4653-bb98-0ee19eb1b867 tempest-VolumesDeleteCascade-1233200636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16d5948e-6b64-4d79-853e-5ec3ddfeb545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-50f4cd75-7674-4653-bb98-0ee19eb1b867 tempest-VolumesDeleteCascade-1233200636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc67bc6d-2358-4438-8bd3-58e7286011f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:45 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-50f4cd75-7674-4653-bb98-0ee19eb1b867 tempest-VolumesDeleteCascade-1233200636 None] Volume f333c782-57cf-4a54-a396-b88b60fc891d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f333c782-57cf-4a54-a396-b88b60fc891d', 'volume_size': 1} Jul 07 08:20:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-50f4cd75-7674-4653-bb98-0ee19eb1b867 tempest-VolumesDeleteCascade-1233200636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:46 devstack sudo[95084]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf" returned: 0 in 0.941s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:46 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] Image conversion details: src /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf, size 1024.00 MB, duration 5.40 sec, destination /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-00973b75-7fc1-4246-8260-f370d34d2fbc {{(pid=87199) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 08:20:46 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] Converted 1024.00 MB image at 189.74 MB/s Jul 07 08:20:46 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-00973b75-7fc1-4246-8260-f370d34d2fbc is being set with open permissions: ugo+rw Jul 07 08:20:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-00973b75-7fc1-4246-8260-f370d34d2fbc {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:46 devstack sudo[95092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-00973b75-7fc1-4246-8260-f370d34d2fbc Jul 07 08:20:46 devstack sudo[95092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:46 devstack sudo[95092]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-00973b75-7fc1-4246-8260-f370d34d2fbc" returned: 0 in 0.613s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] Lock "cinder-quobyte-00973b75-7fc1-4246-8260-f370d34d2fbc" released by "_copy_volume_from_snapshot" :: held 8.755s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:20:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] Acquiring lock "cinder-quobyte-0da4ee6a-78e6-4bd5-80fd-69627904397b" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:20:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] Lock "cinder-quobyte-0da4ee6a-78e6-4bd5-80fd-69627904397b" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:20:46 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] Deleting offline snapshot 0da4ee6a-78e6-4bd5-80fd-69627904397b of volume 41c8533b-b176-4a21-ac3d-1c6b04e85edf {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:20:46 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] snapshot_file for this snap is: volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf.0da4ee6a-78e6-4bd5-80fd-69627904397b {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:20:46 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0a0980-2427-45ce-aa41-fe9d60a15d12]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:20:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf.0da4ee6a-78e6-4bd5-80fd-69627904397b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:46 devstack sudo[95098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf.0da4ee6a-78e6-4bd5-80fd-69627904397b Jul 07 08:20:46 devstack sudo[95098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:47 devstack sudo[95098]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf.0da4ee6a-78e6-4bd5-80fd-69627904397b" returned: 0 in 0.748s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:20:47 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[520e6ea1-61ee-4c71-bce6-5db0f36b9cb6]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:20:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:47 devstack sudo[95103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf Jul 07 08:20:47 devstack sudo[95103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:48 devstack sudo[95103]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf" returned: 0 in 0.729s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf.0da4ee6a-78e6-4bd5-80fd-69627904397b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:48 devstack sudo[95108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf.0da4ee6a-78e6-4bd5-80fd-69627904397b Jul 07 08:20:48 devstack sudo[95108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:48 devstack sudo[95108]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf.0da4ee6a-78e6-4bd5-80fd-69627904397b" returned: 0 in 0.728s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf.0da4ee6a-78e6-4bd5-80fd-69627904397b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:48 devstack sudo[95113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf.0da4ee6a-78e6-4bd5-80fd-69627904397b Jul 07 08:20:48 devstack sudo[95113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:49 devstack sudo[95113]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf.0da4ee6a-78e6-4bd5-80fd-69627904397b" returned: 0 in 0.607s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:49 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] Lock "cinder-quobyte-0da4ee6a-78e6-4bd5-80fd-69627904397b" released by "_delete_snapshot" :: held 2.902s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:20:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.050s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-5ebbf74e-4fa1-4ed2-bbb3-23b2aa9b7c87 tempest-GroupsTest-1420034863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.849s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:49 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-5ebbf74e-4fa1-4ed2-bbb3-23b2aa9b7c87 tempest-GroupsTest-1420034863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f450828c-1f9b-45f5-ae70-61076b16b7a0,created_at=2026-07-07T06:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1865647421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f450828c-1f9b-45f5-ae70-61076b16b7a0,host='devstack@QuobyteHD#QuobyteHD',id=5f609f9e-b4e9-4ece-891e-f2f0e2b14407,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='724291ad208541308ee3dea868227df8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:20:34Z,use_quota=True,user_id='7c790bb0c1af4f50b8cb3501d9eb7db5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d4de13a-dd1e-4ade-81ef-e4d9e4eea9fc),volume_type_id=8d4de13a-dd1e-4ade-81ef-e4d9e4eea9fc)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:20:49 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-5ebbf74e-4fa1-4ed2-bbb3-23b2aa9b7c87 tempest-GroupsTest-1420034863 None] Creating volume 5f609f9e-b4e9-4ece-891e-f2f0e2b14407 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:20:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-5ebbf74e-4fa1-4ed2-bbb3-23b2aa9b7c87 tempest-GroupsTest-1420034863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-5ebbf74e-4fa1-4ed2-bbb3-23b2aa9b7c87 tempest-GroupsTest-1420034863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:49 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-5ebbf74e-4fa1-4ed2-bbb3-23b2aa9b7c87 tempest-GroupsTest-1420034863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:20:49 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-5ebbf74e-4fa1-4ed2-bbb3-23b2aa9b7c87 tempest-GroupsTest-1420034863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:20:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-5ebbf74e-4fa1-4ed2-bbb3-23b2aa9b7c87 tempest-GroupsTest-1420034863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:49 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-5ebbf74e-4fa1-4ed2-bbb3-23b2aa9b7c87 tempest-GroupsTest-1420034863 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:20:49 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-5ebbf74e-4fa1-4ed2-bbb3-23b2aa9b7c87 tempest-GroupsTest-1420034863 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:20:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5ebbf74e-4fa1-4ed2-bbb3-23b2aa9b7c87 tempest-GroupsTest-1420034863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5f609f9e-b4e9-4ece-891e-f2f0e2b14407 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:49 devstack sudo[95116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5f609f9e-b4e9-4ece-891e-f2f0e2b14407 1073741824 Jul 07 08:20:49 devstack sudo[95116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:49 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2f4c09c-01f0-4886-8ce0-0658af6897ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00973b75-7fc1-4246-8260-f370d34d2fbc', 'volume_size': 2, 'source_volid': '41c8533b-b176-4a21-ac3d-1c6b04e85edf', 'source_volstatus': 'available'}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:49 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba9958b2-c388-42bd-a2e8-4719e761166d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:49 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] Volume volume-00973b75-7fc1-4246-8260-f370d34d2fbc (00973b75-7fc1-4246-8260-f370d34d2fbc): created successfully Jul 07 08:20:49 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba9958b2-c388-42bd-a2e8-4719e761166d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:49 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] Flow 'volume_create_manager' (f512b01c-4fb9-498e-b137-6089926d1a5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:20:49 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-bbf68d0a-659f-499c-9b58-46f12162a0c4 tempest-VolumesCloneTest-929522347 None] Created volume successfully. Jul 07 08:20:50 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4062c46f-336c-4336-b1c6-afaf254f4c64 tempest-VolumesCloneTest-929522347 None] Acquiring lock "cinder-00973b75-7fc1-4246-8260-f370d34d2fbc-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:20:50 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4062c46f-336c-4336-b1c6-afaf254f4c64 tempest-VolumesCloneTest-929522347 None] Lock "cinder-00973b75-7fc1-4246-8260-f370d34d2fbc-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:20:50 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4062c46f-336c-4336-b1c6-afaf254f4c64 tempest-VolumesCloneTest-929522347 None] Acquiring lock "cinder-quobyte-00973b75-7fc1-4246-8260-f370d34d2fbc" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:20:50 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4062c46f-336c-4336-b1c6-afaf254f4c64 tempest-VolumesCloneTest-929522347 None] Lock "cinder-quobyte-00973b75-7fc1-4246-8260-f370d34d2fbc" acquired by "delete_volume" :: waited 0.016s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:20:50 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[a732f943-dfce-4ffd-bd54-fbdf40663cd1]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:20:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4062c46f-336c-4336-b1c6-afaf254f4c64 tempest-VolumesCloneTest-929522347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-00973b75-7fc1-4246-8260-f370d34d2fbc {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:50 devstack sudo[95120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-00973b75-7fc1-4246-8260-f370d34d2fbc Jul 07 08:20:50 devstack sudo[95120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:50 devstack sudo[95116]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5ebbf74e-4fa1-4ed2-bbb3-23b2aa9b7c87 tempest-GroupsTest-1420034863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5f609f9e-b4e9-4ece-891e-f2f0e2b14407 1073741824" returned: 0 in 0.826s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5ebbf74e-4fa1-4ed2-bbb3-23b2aa9b7c87 tempest-GroupsTest-1420034863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5f609f9e-b4e9-4ece-891e-f2f0e2b14407 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:50 devstack sudo[95123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5f609f9e-b4e9-4ece-891e-f2f0e2b14407 Jul 07 08:20:50 devstack sudo[95123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:50 devstack sudo[95120]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4062c46f-336c-4336-b1c6-afaf254f4c64 tempest-VolumesCloneTest-929522347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-00973b75-7fc1-4246-8260-f370d34d2fbc" returned: 0 in 0.775s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4062c46f-336c-4336-b1c6-afaf254f4c64 tempest-VolumesCloneTest-929522347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-00973b75-7fc1-4246-8260-f370d34d2fbc {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:51 devstack sudo[95129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-00973b75-7fc1-4246-8260-f370d34d2fbc Jul 07 08:20:51 devstack sudo[95129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:51 devstack sudo[95123]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5ebbf74e-4fa1-4ed2-bbb3-23b2aa9b7c87 tempest-GroupsTest-1420034863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5f609f9e-b4e9-4ece-891e-f2f0e2b14407" returned: 0 in 0.634s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:51 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-5ebbf74e-4fa1-4ed2-bbb3-23b2aa9b7c87 tempest-GroupsTest-1420034863 None] <== create_volume: return (1515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:20:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-5ebbf74e-4fa1-4ed2-bbb3-23b2aa9b7c87 tempest-GroupsTest-1420034863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.518s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-39933e92-1630-4585-8aa1-5926332c541e tempest-SnapshotMetadataTestJSON-780618117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.564s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:51 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-39933e92-1630-4585-8aa1-5926332c541e tempest-SnapshotMetadataTestJSON-780618117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-55647614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26362ef2-b5bc-4836-aedb-4346f7b3b746,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a3f26f1369749898d13c9f1af23833a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:20:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:20:43Z,use_quota=True,user_id='e1b77d670c384329a9f33eb6dcb818a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:20:51 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-39933e92-1630-4585-8aa1-5926332c541e tempest-SnapshotMetadataTestJSON-780618117 None] Creating volume 26362ef2-b5bc-4836-aedb-4346f7b3b746 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:20:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-39933e92-1630-4585-8aa1-5926332c541e tempest-SnapshotMetadataTestJSON-780618117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-39933e92-1630-4585-8aa1-5926332c541e tempest-SnapshotMetadataTestJSON-780618117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:51 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-39933e92-1630-4585-8aa1-5926332c541e tempest-SnapshotMetadataTestJSON-780618117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:20:51 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-39933e92-1630-4585-8aa1-5926332c541e tempest-SnapshotMetadataTestJSON-780618117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:20:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-39933e92-1630-4585-8aa1-5926332c541e tempest-SnapshotMetadataTestJSON-780618117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:51 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-39933e92-1630-4585-8aa1-5926332c541e tempest-SnapshotMetadataTestJSON-780618117 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:20:51 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-39933e92-1630-4585-8aa1-5926332c541e tempest-SnapshotMetadataTestJSON-780618117 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:20:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-39933e92-1630-4585-8aa1-5926332c541e tempest-SnapshotMetadataTestJSON-780618117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-26362ef2-b5bc-4836-aedb-4346f7b3b746 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:51 devstack sudo[95132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-26362ef2-b5bc-4836-aedb-4346f7b3b746 1073741824 Jul 07 08:20:51 devstack sudo[95132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5ebbf74e-4fa1-4ed2-bbb3-23b2aa9b7c87 tempest-GroupsTest-1420034863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eac83a5-d139-49cd-96de-bc0425ada35f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f609f9e-b4e9-4ece-891e-f2f0e2b14407', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5ebbf74e-4fa1-4ed2-bbb3-23b2aa9b7c87 tempest-GroupsTest-1420034863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d719bcc-05e2-4670-8a2b-d30f4a6cc244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:51 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-5ebbf74e-4fa1-4ed2-bbb3-23b2aa9b7c87 tempest-GroupsTest-1420034863 None] Volume volume-5f609f9e-b4e9-4ece-891e-f2f0e2b14407 (5f609f9e-b4e9-4ece-891e-f2f0e2b14407): created successfully Jul 07 08:20:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5ebbf74e-4fa1-4ed2-bbb3-23b2aa9b7c87 tempest-GroupsTest-1420034863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d719bcc-05e2-4670-8a2b-d30f4a6cc244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5ebbf74e-4fa1-4ed2-bbb3-23b2aa9b7c87 tempest-GroupsTest-1420034863 None] Flow 'volume_create_manager' (e4710c82-8bb8-4c13-bb57-b32563832b9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:20:51 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-5ebbf74e-4fa1-4ed2-bbb3-23b2aa9b7c87 tempest-GroupsTest-1420034863 None] Created volume successfully. Jul 07 08:20:51 devstack sudo[95129]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4062c46f-336c-4336-b1c6-afaf254f4c64 tempest-VolumesCloneTest-929522347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-00973b75-7fc1-4246-8260-f370d34d2fbc" returned: 0 in 0.706s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:51 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4062c46f-336c-4336-b1c6-afaf254f4c64 tempest-VolumesCloneTest-929522347 None] Lock "cinder-quobyte-00973b75-7fc1-4246-8260-f370d34d2fbc" released by "delete_volume" :: held 1.526s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:20:51 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-4062c46f-336c-4336-b1c6-afaf254f4c64 tempest-VolumesCloneTest-929522347 None] Created reservations ['cb140b1d-336b-44cb-b947-74addf5a36c6', '08b546fa-4248-4ddc-94cb-d9d9326a02e1', 'f97a7fdc-fe6d-40e2-a566-d04f86844424', 'b2cd8811-c3e0-4427-9f34-d0e326dce9ec'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:20:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4062c46f-336c-4336-b1c6-afaf254f4c64 tempest-VolumesCloneTest-929522347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4062c46f-336c-4336-b1c6-afaf254f4c64 tempest-VolumesCloneTest-929522347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:51 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4062c46f-336c-4336-b1c6-afaf254f4c64 tempest-VolumesCloneTest-929522347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:20:51 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4062c46f-336c-4336-b1c6-afaf254f4c64 tempest-VolumesCloneTest-929522347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:20:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4062c46f-336c-4336-b1c6-afaf254f4c64 tempest-VolumesCloneTest-929522347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4062c46f-336c-4336-b1c6-afaf254f4c64 tempest-VolumesCloneTest-929522347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:51 devstack sudo[95139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:20:51 devstack sudo[95139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:52 devstack sudo[95132]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-39933e92-1630-4585-8aa1-5926332c541e tempest-SnapshotMetadataTestJSON-780618117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-26362ef2-b5bc-4836-aedb-4346f7b3b746 1073741824" returned: 0 in 0.833s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-39933e92-1630-4585-8aa1-5926332c541e tempest-SnapshotMetadataTestJSON-780618117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-26362ef2-b5bc-4836-aedb-4346f7b3b746 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:52 devstack sudo[95141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-26362ef2-b5bc-4836-aedb-4346f7b3b746 Jul 07 08:20:52 devstack sudo[95141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:52 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-1cc43401-2027-4f15-8830-79573ddd4a0a tempest-GroupsTest-1420034863 None] Update group completed successfully. Jul 07 08:20:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-22bbdc70-586e-44b7-90b9-091e54367042 tempest-VolumesCloneTest-929522347 None] Acquiring lock "cinder-41c8533b-b176-4a21-ac3d-1c6b04e85edf-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:20:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-22bbdc70-586e-44b7-90b9-091e54367042 tempest-VolumesCloneTest-929522347 None] Lock "cinder-41c8533b-b176-4a21-ac3d-1c6b04e85edf-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:20:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-22bbdc70-586e-44b7-90b9-091e54367042 tempest-VolumesCloneTest-929522347 None] Acquiring lock "cinder-quobyte-41c8533b-b176-4a21-ac3d-1c6b04e85edf" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:20:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-22bbdc70-586e-44b7-90b9-091e54367042 tempest-VolumesCloneTest-929522347 None] Lock "cinder-quobyte-41c8533b-b176-4a21-ac3d-1c6b04e85edf" acquired by "delete_volume" :: waited 0.024s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:20:52 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcfc814e-5455-4164-b761-1d675d57e024]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:20:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-22bbdc70-586e-44b7-90b9-091e54367042 tempest-VolumesCloneTest-929522347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:52 devstack sudo[95139]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4062c46f-336c-4336-b1c6-afaf254f4c64 tempest-VolumesCloneTest-929522347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.718s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:52 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-4062c46f-336c-4336-b1c6-afaf254f4c64 tempest-VolumesCloneTest-929522347 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:20:52 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-4062c46f-336c-4336-b1c6-afaf254f4c64 tempest-VolumesCloneTest-929522347 None] Deleted volume successfully. Jul 07 08:20:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4062c46f-336c-4336-b1c6-afaf254f4c64 tempest-VolumesCloneTest-929522347 None] Lock "cinder-00973b75-7fc1-4246-8260-f370d34d2fbc-delete_volume" released by "delete_volume" :: held 2.452s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:20:52 devstack sudo[95144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf Jul 07 08:20:52 devstack sudo[95144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:52 devstack sudo[95141]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-39933e92-1630-4585-8aa1-5926332c541e tempest-SnapshotMetadataTestJSON-780618117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-26362ef2-b5bc-4836-aedb-4346f7b3b746" returned: 0 in 0.772s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:52 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-39933e92-1630-4585-8aa1-5926332c541e tempest-SnapshotMetadataTestJSON-780618117 None] <== create_volume: return (1647ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:20:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-39933e92-1630-4585-8aa1-5926332c541e tempest-SnapshotMetadataTestJSON-780618117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.650s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-50f4cd75-7674-4653-bb98-0ee19eb1b867 tempest-VolumesDeleteCascade-1233200636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.026s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:52 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-50f4cd75-7674-4653-bb98-0ee19eb1b867 tempest-VolumesDeleteCascade-1233200636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:20:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-279080987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f333c782-57cf-4a54-a396-b88b60fc891d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97188b0d72f54c39b53585699c758934',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:20:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:20:46Z,use_quota=True,user_id='f333b41c84eb421388e3b21cdc55b91d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:20:52 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-50f4cd75-7674-4653-bb98-0ee19eb1b867 tempest-VolumesDeleteCascade-1233200636 None] Creating volume f333c782-57cf-4a54-a396-b88b60fc891d {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:20:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-50f4cd75-7674-4653-bb98-0ee19eb1b867 tempest-VolumesDeleteCascade-1233200636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-50f4cd75-7674-4653-bb98-0ee19eb1b867 tempest-VolumesDeleteCascade-1233200636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:52 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-50f4cd75-7674-4653-bb98-0ee19eb1b867 tempest-VolumesDeleteCascade-1233200636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:20:52 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-50f4cd75-7674-4653-bb98-0ee19eb1b867 tempest-VolumesDeleteCascade-1233200636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:20:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-50f4cd75-7674-4653-bb98-0ee19eb1b867 tempest-VolumesDeleteCascade-1233200636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:52 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-50f4cd75-7674-4653-bb98-0ee19eb1b867 tempest-VolumesDeleteCascade-1233200636 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:20:52 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-50f4cd75-7674-4653-bb98-0ee19eb1b867 tempest-VolumesDeleteCascade-1233200636 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:20:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-50f4cd75-7674-4653-bb98-0ee19eb1b867 tempest-VolumesDeleteCascade-1233200636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:52 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-39933e92-1630-4585-8aa1-5926332c541e tempest-SnapshotMetadataTestJSON-780618117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d1c5038-cec5-44f2-867b-6258ef43eba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26362ef2-b5bc-4836-aedb-4346f7b3b746', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:52 devstack sudo[95147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d 1073741824 Jul 07 08:20:52 devstack sudo[95147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:52 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-39933e92-1630-4585-8aa1-5926332c541e tempest-SnapshotMetadataTestJSON-780618117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (288ff7ad-e1ea-4104-b28e-af84599064d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:52 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-39933e92-1630-4585-8aa1-5926332c541e tempest-SnapshotMetadataTestJSON-780618117 None] Volume volume-26362ef2-b5bc-4836-aedb-4346f7b3b746 (26362ef2-b5bc-4836-aedb-4346f7b3b746): created successfully Jul 07 08:20:52 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-39933e92-1630-4585-8aa1-5926332c541e tempest-SnapshotMetadataTestJSON-780618117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (288ff7ad-e1ea-4104-b28e-af84599064d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:52 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-39933e92-1630-4585-8aa1-5926332c541e tempest-SnapshotMetadataTestJSON-780618117 None] Flow 'volume_create_manager' (5703fa63-92ba-4a26-9548-053da504c90c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:20:52 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-39933e92-1630-4585-8aa1-5926332c541e tempest-SnapshotMetadataTestJSON-780618117 None] Created volume successfully. Jul 07 08:20:53 devstack sudo[95144]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-22bbdc70-586e-44b7-90b9-091e54367042 tempest-VolumesCloneTest-929522347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf" returned: 0 in 0.764s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-22bbdc70-586e-44b7-90b9-091e54367042 tempest-VolumesCloneTest-929522347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:53 devstack sudo[95152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf Jul 07 08:20:53 devstack sudo[95152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:53 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-1bc5c105-c9c2-4d11-8a4f-120f63096402 tempest-GroupsTest-1420034863 None] Update group completed successfully. Jul 07 08:20:53 devstack sudo[95147]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-50f4cd75-7674-4653-bb98-0ee19eb1b867 tempest-VolumesDeleteCascade-1233200636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d 1073741824" returned: 0 in 0.985s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-50f4cd75-7674-4653-bb98-0ee19eb1b867 tempest-VolumesDeleteCascade-1233200636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:53 devstack sudo[95158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d Jul 07 08:20:53 devstack sudo[95158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:53 devstack sudo[95152]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-22bbdc70-586e-44b7-90b9-091e54367042 tempest-VolumesCloneTest-929522347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41c8533b-b176-4a21-ac3d-1c6b04e85edf" returned: 0 in 0.692s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:54 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-22bbdc70-586e-44b7-90b9-091e54367042 tempest-VolumesCloneTest-929522347 None] Lock "cinder-quobyte-41c8533b-b176-4a21-ac3d-1c6b04e85edf" released by "delete_volume" :: held 1.530s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:20:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-91d54c7b-e618-412b-8be8-9f281ad5e6c6 tempest-SnapshotMetadataTestJSON-780618117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:54 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-22bbdc70-586e-44b7-90b9-091e54367042 tempest-VolumesCloneTest-929522347 None] Created reservations ['9faacba0-8341-4730-aab1-04c62cab6d93', '73ee55b0-e49f-457e-98d2-54d9ace89960', '63f6c8ca-4c91-4a2b-af0e-6382a7f8d1a7', 'd020c801-5db6-44c5-aa6e-57f3ebabf36e'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:20:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-22bbdc70-586e-44b7-90b9-091e54367042 tempest-VolumesCloneTest-929522347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-22bbdc70-586e-44b7-90b9-091e54367042 tempest-VolumesCloneTest-929522347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:54 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-22bbdc70-586e-44b7-90b9-091e54367042 tempest-VolumesCloneTest-929522347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:20:54 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-22bbdc70-586e-44b7-90b9-091e54367042 tempest-VolumesCloneTest-929522347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:20:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-22bbdc70-586e-44b7-90b9-091e54367042 tempest-VolumesCloneTest-929522347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-22bbdc70-586e-44b7-90b9-091e54367042 tempest-VolumesCloneTest-929522347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:54 devstack sudo[95161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:20:54 devstack sudo[95161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:54 devstack sudo[95158]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-50f4cd75-7674-4653-bb98-0ee19eb1b867 tempest-VolumesDeleteCascade-1233200636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d" returned: 0 in 0.663s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:54 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-50f4cd75-7674-4653-bb98-0ee19eb1b867 tempest-VolumesDeleteCascade-1233200636 None] <== create_volume: return (1705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:20:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-50f4cd75-7674-4653-bb98-0ee19eb1b867 tempest-VolumesDeleteCascade-1233200636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-91d54c7b-e618-412b-8be8-9f281ad5e6c6 tempest-SnapshotMetadataTestJSON-780618117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.504s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:54 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-91d54c7b-e618-412b-8be8-9f281ad5e6c6 tempest-SnapshotMetadataTestJSON-780618117 None] Creating offline snapshot f563509c-7c0f-45eb-a2fd-55ec9189af8f of volume 26362ef2-b5bc-4836-aedb-4346f7b3b746 {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:20:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-50f4cd75-7674-4653-bb98-0ee19eb1b867 tempest-VolumesDeleteCascade-1233200636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc67bc6d-2358-4438-8bd3-58e7286011f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f333c782-57cf-4a54-a396-b88b60fc891d', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-50f4cd75-7674-4653-bb98-0ee19eb1b867 tempest-VolumesDeleteCascade-1233200636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6579931a-1e8b-4091-9c8d-acb3362f4025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:54 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f14c67d-841a-496b-a3bb-eb5147eb3b4d]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:20:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-91d54c7b-e618-412b-8be8-9f281ad5e6c6 tempest-SnapshotMetadataTestJSON-780618117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-26362ef2-b5bc-4836-aedb-4346f7b3b746 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:54 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-50f4cd75-7674-4653-bb98-0ee19eb1b867 tempest-VolumesDeleteCascade-1233200636 None] Volume volume-f333c782-57cf-4a54-a396-b88b60fc891d (f333c782-57cf-4a54-a396-b88b60fc891d): created successfully Jul 07 08:20:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-50f4cd75-7674-4653-bb98-0ee19eb1b867 tempest-VolumesDeleteCascade-1233200636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6579931a-1e8b-4091-9c8d-acb3362f4025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-50f4cd75-7674-4653-bb98-0ee19eb1b867 tempest-VolumesDeleteCascade-1233200636 None] Flow 'volume_create_manager' (b5619add-c5da-4ea4-82d3-0c8ff43a84a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:20:54 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-50f4cd75-7674-4653-bb98-0ee19eb1b867 tempest-VolumesDeleteCascade-1233200636 None] Created volume successfully. Jul 07 08:20:54 devstack sudo[95164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-26362ef2-b5bc-4836-aedb-4346f7b3b746 Jul 07 08:20:54 devstack sudo[95164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:54 devstack sudo[95161]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-22bbdc70-586e-44b7-90b9-091e54367042 tempest-VolumesCloneTest-929522347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.706s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:54 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-22bbdc70-586e-44b7-90b9-091e54367042 tempest-VolumesCloneTest-929522347 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:20:54 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-22bbdc70-586e-44b7-90b9-091e54367042 tempest-VolumesCloneTest-929522347 None] Deleted volume successfully. Jul 07 08:20:54 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-22bbdc70-586e-44b7-90b9-091e54367042 tempest-VolumesCloneTest-929522347 None] Lock "cinder-41c8533b-b176-4a21-ac3d-1c6b04e85edf-delete_volume" released by "delete_volume" :: held 2.455s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:20:55 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0caf58d5-4670-4dac-8984-446c52743683 tempest-GroupsTest-1420034863 None] Acquiring lock "cinder-quobyte-5f609f9e-b4e9-4ece-891e-f2f0e2b14407" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:20:55 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0caf58d5-4670-4dac-8984-446c52743683 tempest-GroupsTest-1420034863 None] Lock "cinder-quobyte-5f609f9e-b4e9-4ece-891e-f2f0e2b14407" acquired by "delete_volume" :: waited 0.020s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:20:55 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6dbb645-9dab-4f25-b428-6c6a4fdc88ff]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:20:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0caf58d5-4670-4dac-8984-446c52743683 tempest-GroupsTest-1420034863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5f609f9e-b4e9-4ece-891e-f2f0e2b14407 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:55 devstack sudo[95164]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-91d54c7b-e618-412b-8be8-9f281ad5e6c6 tempest-SnapshotMetadataTestJSON-780618117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-26362ef2-b5bc-4836-aedb-4346f7b3b746" returned: 0 in 0.912s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-91d54c7b-e618-412b-8be8-9f281ad5e6c6 tempest-SnapshotMetadataTestJSON-780618117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-26362ef2-b5bc-4836-aedb-4346f7b3b746,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-26362ef2-b5bc-4836-aedb-4346f7b3b746.f563509c-7c0f-45eb-a2fd-55ec9189af8f 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:55 devstack sudo[95171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-26362ef2-b5bc-4836-aedb-4346f7b3b746,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-26362ef2-b5bc-4836-aedb-4346f7b3b746.f563509c-7c0f-45eb-a2fd-55ec9189af8f 1G Jul 07 08:20:55 devstack sudo[95171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-862eafe5-b6eb-44b1-882a-8a67495bcf8b tempest-VolumesDeleteCascade-1233200636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:55 devstack sudo[95170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5f609f9e-b4e9-4ece-891e-f2f0e2b14407 Jul 07 08:20:55 devstack sudo[95170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:56 devstack sudo[95170]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0caf58d5-4670-4dac-8984-446c52743683 tempest-GroupsTest-1420034863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5f609f9e-b4e9-4ece-891e-f2f0e2b14407" returned: 0 in 0.939s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0caf58d5-4670-4dac-8984-446c52743683 tempest-GroupsTest-1420034863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5f609f9e-b4e9-4ece-891e-f2f0e2b14407 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:56 devstack sudo[95183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5f609f9e-b4e9-4ece-891e-f2f0e2b14407 Jul 07 08:20:56 devstack sudo[95183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:56 devstack sudo[95171]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-91d54c7b-e618-412b-8be8-9f281ad5e6c6 tempest-SnapshotMetadataTestJSON-780618117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-26362ef2-b5bc-4836-aedb-4346f7b3b746,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-26362ef2-b5bc-4836-aedb-4346f7b3b746.f563509c-7c0f-45eb-a2fd-55ec9189af8f 1G" returned: 0 in 0.947s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-91d54c7b-e618-412b-8be8-9f281ad5e6c6 tempest-SnapshotMetadataTestJSON-780618117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26362ef2-b5bc-4836-aedb-4346f7b3b746 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-26362ef2-b5bc-4836-aedb-4346f7b3b746.f563509c-7c0f-45eb-a2fd-55ec9189af8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:56 devstack sudo[95185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26362ef2-b5bc-4836-aedb-4346f7b3b746 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-26362ef2-b5bc-4836-aedb-4346f7b3b746.f563509c-7c0f-45eb-a2fd-55ec9189af8f Jul 07 08:20:56 devstack sudo[95185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:57 devstack sudo[95183]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0caf58d5-4670-4dac-8984-446c52743683 tempest-GroupsTest-1420034863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5f609f9e-b4e9-4ece-891e-f2f0e2b14407" returned: 0 in 0.694s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:57 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0caf58d5-4670-4dac-8984-446c52743683 tempest-GroupsTest-1420034863 None] Lock "cinder-quobyte-5f609f9e-b4e9-4ece-891e-f2f0e2b14407" released by "delete_volume" :: held 1.692s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:20:57 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0caf58d5-4670-4dac-8984-446c52743683 tempest-GroupsTest-1420034863 None] Acquiring lock "cinder-quobyte-6488eadf-3235-456f-a1a8-d0946f2021f5" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:20:57 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0caf58d5-4670-4dac-8984-446c52743683 tempest-GroupsTest-1420034863 None] Lock "cinder-quobyte-6488eadf-3235-456f-a1a8-d0946f2021f5" acquired by "delete_volume" :: waited 0.017s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:20:57 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fca79da-6b58-4cc5-ba81-75d02294cf7f]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:20:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0caf58d5-4670-4dac-8984-446c52743683 tempest-GroupsTest-1420034863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6488eadf-3235-456f-a1a8-d0946f2021f5 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:57 devstack sudo[95185]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-91d54c7b-e618-412b-8be8-9f281ad5e6c6 tempest-SnapshotMetadataTestJSON-780618117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26362ef2-b5bc-4836-aedb-4346f7b3b746 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-26362ef2-b5bc-4836-aedb-4346f7b3b746.f563509c-7c0f-45eb-a2fd-55ec9189af8f" returned: 0 in 0.749s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:57 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-91d54c7b-e618-412b-8be8-9f281ad5e6c6 tempest-SnapshotMetadataTestJSON-780618117 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-26362ef2-b5bc-4836-aedb-4346f7b3b746.f563509c-7c0f-45eb-a2fd-55ec9189af8f is being set with open permissions: ugo+rw Jul 07 08:20:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-91d54c7b-e618-412b-8be8-9f281ad5e6c6 tempest-SnapshotMetadataTestJSON-780618117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-26362ef2-b5bc-4836-aedb-4346f7b3b746.f563509c-7c0f-45eb-a2fd-55ec9189af8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:57 devstack sudo[95193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-26362ef2-b5bc-4836-aedb-4346f7b3b746.f563509c-7c0f-45eb-a2fd-55ec9189af8f Jul 07 08:20:57 devstack sudo[95193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:57 devstack sudo[95192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6488eadf-3235-456f-a1a8-d0946f2021f5 Jul 07 08:20:57 devstack sudo[95192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:57 devstack sudo[95193]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-91d54c7b-e618-412b-8be8-9f281ad5e6c6 tempest-SnapshotMetadataTestJSON-780618117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-26362ef2-b5bc-4836-aedb-4346f7b3b746.f563509c-7c0f-45eb-a2fd-55ec9189af8f" returned: 0 in 0.644s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-91d54c7b-e618-412b-8be8-9f281ad5e6c6 tempest-SnapshotMetadataTestJSON-780618117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-26362ef2-b5bc-4836-aedb-4346f7b3b746.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:57 devstack sudo[95200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-26362ef2-b5bc-4836-aedb-4346f7b3b746.info Jul 07 08:20:57 devstack sudo[95200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:58 devstack sudo[95192]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0caf58d5-4670-4dac-8984-446c52743683 tempest-GroupsTest-1420034863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6488eadf-3235-456f-a1a8-d0946f2021f5" returned: 0 in 0.864s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0caf58d5-4670-4dac-8984-446c52743683 tempest-GroupsTest-1420034863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6488eadf-3235-456f-a1a8-d0946f2021f5 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:58 devstack sudo[95202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6488eadf-3235-456f-a1a8-d0946f2021f5 Jul 07 08:20:58 devstack sudo[95202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:58 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-12f14a43-b402-49b9-a554-f3e82cbdfd81 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:20:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-12f14a43-b402-49b9-a554-f3e82cbdfd81 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Flow 'volume_create_manager' (f8e9ebab-a548-4f75-9901-1f208d2843b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:20:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-12f14a43-b402-49b9-a554-f3e82cbdfd81 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (546c2469-a0c5-408b-be89-08af3e568b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-12f14a43-b402-49b9-a554-f3e82cbdfd81 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (546c2469-a0c5-408b-be89-08af3e568b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:20:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1182080823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63d1a94b-7299-4296-ad89-06f4f1d6fc38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3686c10d08a4185965a8d7902e7f0ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:20:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:20:58Z,use_quota=True,user_id='8fab6870700a4d47a3c386dfbb59a3e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-12f14a43-b402-49b9-a554-f3e82cbdfd81 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1071a892-052e-46e4-abc1-7af2debce09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-12f14a43-b402-49b9-a554-f3e82cbdfd81 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1071a892-052e-46e4-abc1-7af2debce09d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-12f14a43-b402-49b9-a554-f3e82cbdfd81 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac90bae0-e8ea-4748-86bd-c9441969633d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-12f14a43-b402-49b9-a554-f3e82cbdfd81 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac90bae0-e8ea-4748-86bd-c9441969633d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63d1a94b-7299-4296-ad89-06f4f1d6fc38', 'volume_name': 'volume-63d1a94b-7299-4296-ad89-06f4f1d6fc38', 'volume_size': 2}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-12f14a43-b402-49b9-a554-f3e82cbdfd81 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59d921f9-3ae4-433d-b103-0bcf87db4823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-12f14a43-b402-49b9-a554-f3e82cbdfd81 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59d921f9-3ae4-433d-b103-0bcf87db4823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-12f14a43-b402-49b9-a554-f3e82cbdfd81 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58f6b3cd-165d-4ba7-baa9-7bb212283915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:58 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-12f14a43-b402-49b9-a554-f3e82cbdfd81 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Volume 63d1a94b-7299-4296-ad89-06f4f1d6fc38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63d1a94b-7299-4296-ad89-06f4f1d6fc38', 'volume_size': 2} Jul 07 08:20:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-12f14a43-b402-49b9-a554-f3e82cbdfd81 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:58 devstack sudo[95200]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-91d54c7b-e618-412b-8be8-9f281ad5e6c6 tempest-SnapshotMetadataTestJSON-780618117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-26362ef2-b5bc-4836-aedb-4346f7b3b746.info" returned: 0 in 0.697s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:58 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-91d54c7b-e618-412b-8be8-9f281ad5e6c6 tempest-SnapshotMetadataTestJSON-780618117 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-26362ef2-b5bc-4836-aedb-4346f7b3b746.info is being set with open permissions: ugo+rw Jul 07 08:20:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-91d54c7b-e618-412b-8be8-9f281ad5e6c6 tempest-SnapshotMetadataTestJSON-780618117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-26362ef2-b5bc-4836-aedb-4346f7b3b746.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:58 devstack sudo[95205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-26362ef2-b5bc-4836-aedb-4346f7b3b746.info Jul 07 08:20:58 devstack sudo[95205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:58 devstack sudo[95202]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0caf58d5-4670-4dac-8984-446c52743683 tempest-GroupsTest-1420034863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6488eadf-3235-456f-a1a8-d0946f2021f5" returned: 0 in 0.702s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:58 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0caf58d5-4670-4dac-8984-446c52743683 tempest-GroupsTest-1420034863 None] Lock "cinder-quobyte-6488eadf-3235-456f-a1a8-d0946f2021f5" released by "delete_volume" :: held 1.621s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:20:58 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-0caf58d5-4670-4dac-8984-446c52743683 tempest-GroupsTest-1420034863 None] Created reservations ['7019df4d-3827-44f2-9751-2997d56bfd68'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:20:58 devstack cinder-volume[87199]: WARNING cinder.quota [None req-0caf58d5-4670-4dac-8984-446c52743683 tempest-GroupsTest-1420034863 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1611886421 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1611886421, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:20:58 devstack cinder-volume[87199]: WARNING cinder.quota [None req-0caf58d5-4670-4dac-8984-446c52743683 tempest-GroupsTest-1420034863 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1611886421 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1611886421, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:20:58 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-0caf58d5-4670-4dac-8984-446c52743683 tempest-GroupsTest-1420034863 None] Created reservations ['9c69539d-fcaa-411b-b0a9-c688de8234a8', '16bbfa3d-c59c-447e-8749-a43e1c29bb02', 'd7ef5c32-1ead-4e2a-8d3c-376a7318b5c2', 'aeff982a-bfff-4d7b-9746-aac4f0d00aa0'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:20:58 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-0caf58d5-4670-4dac-8984-446c52743683 tempest-GroupsTest-1420034863 None] Created reservations ['77a0024a-0da6-4e2a-8125-160c0ea5361a', '19df5cff-1f32-48de-b853-4730bbee0cf1', 'e2190cf1-7e9e-4999-bf8b-9a5f7987375d', '6e463b31-b0c2-46e0-be62-4b7157857e1b'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:20:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0caf58d5-4670-4dac-8984-446c52743683 tempest-GroupsTest-1420034863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0caf58d5-4670-4dac-8984-446c52743683 tempest-GroupsTest-1420034863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:59 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-0caf58d5-4670-4dac-8984-446c52743683 tempest-GroupsTest-1420034863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:20:59 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-0caf58d5-4670-4dac-8984-446c52743683 tempest-GroupsTest-1420034863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:20:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0caf58d5-4670-4dac-8984-446c52743683 tempest-GroupsTest-1420034863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0caf58d5-4670-4dac-8984-446c52743683 tempest-GroupsTest-1420034863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:59 devstack sudo[95209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:20:59 devstack sudo[95209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:59 devstack sudo[95205]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-91d54c7b-e618-412b-8be8-9f281ad5e6c6 tempest-SnapshotMetadataTestJSON-780618117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-26362ef2-b5bc-4836-aedb-4346f7b3b746.info" returned: 0 in 0.696s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-91d54c7b-e618-412b-8be8-9f281ad5e6c6 tempest-SnapshotMetadataTestJSON-780618117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.761s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-862eafe5-b6eb-44b1-882a-8a67495bcf8b tempest-VolumesDeleteCascade-1233200636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.740s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:59 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-862eafe5-b6eb-44b1-882a-8a67495bcf8b tempest-VolumesDeleteCascade-1233200636 None] Creating offline snapshot 045bd478-1bf2-48d7-998c-97ce918e31e6 of volume f333c782-57cf-4a54-a396-b88b60fc891d {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:20:59 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-91d54c7b-e618-412b-8be8-9f281ad5e6c6 tempest-SnapshotMetadataTestJSON-780618117 None] Create snapshot completed successfully Jul 07 08:20:59 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[56620c9e-06e2-4d66-b6b9-34df11065557]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:20:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-862eafe5-b6eb-44b1-882a-8a67495bcf8b tempest-VolumesDeleteCascade-1233200636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:59 devstack sudo[95212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d Jul 07 08:20:59 devstack sudo[95212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:59 devstack sudo[95209]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0caf58d5-4670-4dac-8984-446c52743683 tempest-GroupsTest-1420034863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.635s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:59 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-0caf58d5-4670-4dac-8984-446c52743683 tempest-GroupsTest-1420034863 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:20:59 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-0caf58d5-4670-4dac-8984-446c52743683 tempest-GroupsTest-1420034863 None] Delete group completed successfully. Jul 07 08:21:00 devstack sudo[95212]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-862eafe5-b6eb-44b1-882a-8a67495bcf8b tempest-VolumesDeleteCascade-1233200636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d" returned: 0 in 0.773s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-862eafe5-b6eb-44b1-882a-8a67495bcf8b tempest-VolumesDeleteCascade-1233200636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d.045bd478-1bf2-48d7-998c-97ce918e31e6 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:00 devstack sudo[95218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d.045bd478-1bf2-48d7-998c-97ce918e31e6 1G Jul 07 08:21:00 devstack sudo[95218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:01 devstack sudo[95218]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-862eafe5-b6eb-44b1-882a-8a67495bcf8b tempest-VolumesDeleteCascade-1233200636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d.045bd478-1bf2-48d7-998c-97ce918e31e6 1G" returned: 0 in 0.897s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-862eafe5-b6eb-44b1-882a-8a67495bcf8b tempest-VolumesDeleteCascade-1233200636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f333c782-57cf-4a54-a396-b88b60fc891d -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d.045bd478-1bf2-48d7-998c-97ce918e31e6 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:01 devstack sudo[95226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f333c782-57cf-4a54-a396-b88b60fc891d -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d.045bd478-1bf2-48d7-998c-97ce918e31e6 Jul 07 08:21:01 devstack sudo[95226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:01 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-894ac0d3-7014-4d65-905c-1adafc0ee7f7 tempest-SnapshotMetadataTestJSON-780618117 None] Acquiring lock "cinder-f563509c-7c0f-45eb-a2fd-55ec9189af8f-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:21:01 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-894ac0d3-7014-4d65-905c-1adafc0ee7f7 tempest-SnapshotMetadataTestJSON-780618117 None] Lock "cinder-f563509c-7c0f-45eb-a2fd-55ec9189af8f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:21:01 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-894ac0d3-7014-4d65-905c-1adafc0ee7f7 tempest-SnapshotMetadataTestJSON-780618117 None] Acquiring lock "cinder-quobyte-26362ef2-b5bc-4836-aedb-4346f7b3b746" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:21:01 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-894ac0d3-7014-4d65-905c-1adafc0ee7f7 tempest-SnapshotMetadataTestJSON-780618117 None] Lock "cinder-quobyte-26362ef2-b5bc-4836-aedb-4346f7b3b746" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:21:01 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-894ac0d3-7014-4d65-905c-1adafc0ee7f7 tempest-SnapshotMetadataTestJSON-780618117 None] Acquiring lock "cinder-quobyte-f563509c-7c0f-45eb-a2fd-55ec9189af8f" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:21:01 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-894ac0d3-7014-4d65-905c-1adafc0ee7f7 tempest-SnapshotMetadataTestJSON-780618117 None] Lock "cinder-quobyte-f563509c-7c0f-45eb-a2fd-55ec9189af8f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:21:01 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-894ac0d3-7014-4d65-905c-1adafc0ee7f7 tempest-SnapshotMetadataTestJSON-780618117 None] Deleting offline snapshot f563509c-7c0f-45eb-a2fd-55ec9189af8f of volume 26362ef2-b5bc-4836-aedb-4346f7b3b746 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:21:01 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-894ac0d3-7014-4d65-905c-1adafc0ee7f7 tempest-SnapshotMetadataTestJSON-780618117 None] snapshot_file for this snap is: volume-26362ef2-b5bc-4836-aedb-4346f7b3b746.f563509c-7c0f-45eb-a2fd-55ec9189af8f {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:21:01 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea576f6-cbdd-4926-825b-d4d7c0c8307d]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:21:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-894ac0d3-7014-4d65-905c-1adafc0ee7f7 tempest-SnapshotMetadataTestJSON-780618117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-26362ef2-b5bc-4836-aedb-4346f7b3b746.f563509c-7c0f-45eb-a2fd-55ec9189af8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:01 devstack sudo[95230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-26362ef2-b5bc-4836-aedb-4346f7b3b746.f563509c-7c0f-45eb-a2fd-55ec9189af8f Jul 07 08:21:01 devstack sudo[95230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:01 devstack sudo[95226]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-862eafe5-b6eb-44b1-882a-8a67495bcf8b tempest-VolumesDeleteCascade-1233200636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f333c782-57cf-4a54-a396-b88b60fc891d -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d.045bd478-1bf2-48d7-998c-97ce918e31e6" returned: 0 in 0.768s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:01 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-862eafe5-b6eb-44b1-882a-8a67495bcf8b tempest-VolumesDeleteCascade-1233200636 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d.045bd478-1bf2-48d7-998c-97ce918e31e6 is being set with open permissions: ugo+rw Jul 07 08:21:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-862eafe5-b6eb-44b1-882a-8a67495bcf8b tempest-VolumesDeleteCascade-1233200636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d.045bd478-1bf2-48d7-998c-97ce918e31e6 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:01 devstack sudo[95235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d.045bd478-1bf2-48d7-998c-97ce918e31e6 Jul 07 08:21:01 devstack sudo[95235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:02 devstack sudo[95230]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-894ac0d3-7014-4d65-905c-1adafc0ee7f7 tempest-SnapshotMetadataTestJSON-780618117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-26362ef2-b5bc-4836-aedb-4346f7b3b746.f563509c-7c0f-45eb-a2fd-55ec9189af8f" returned: 0 in 0.857s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:02 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-894ac0d3-7014-4d65-905c-1adafc0ee7f7 tempest-SnapshotMetadataTestJSON-780618117 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26362ef2-b5bc-4836-aedb-4346f7b3b746(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:21:02 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9bfd364-cb4b-4ece-a134-58c61ca87d27]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:21:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-894ac0d3-7014-4d65-905c-1adafc0ee7f7 tempest-SnapshotMetadataTestJSON-780618117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-26362ef2-b5bc-4836-aedb-4346f7b3b746 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:02 devstack sudo[95240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-26362ef2-b5bc-4836-aedb-4346f7b3b746 Jul 07 08:21:02 devstack sudo[95240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:02 devstack sudo[95235]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-862eafe5-b6eb-44b1-882a-8a67495bcf8b tempest-VolumesDeleteCascade-1233200636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d.045bd478-1bf2-48d7-998c-97ce918e31e6" returned: 0 in 0.782s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-862eafe5-b6eb-44b1-882a-8a67495bcf8b tempest-VolumesDeleteCascade-1233200636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:02 devstack sudo[95243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d.info Jul 07 08:21:02 devstack sudo[95243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:03 devstack sudo[95240]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-894ac0d3-7014-4d65-905c-1adafc0ee7f7 tempest-SnapshotMetadataTestJSON-780618117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-26362ef2-b5bc-4836-aedb-4346f7b3b746" returned: 0 in 0.875s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-894ac0d3-7014-4d65-905c-1adafc0ee7f7 tempest-SnapshotMetadataTestJSON-780618117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-26362ef2-b5bc-4836-aedb-4346f7b3b746.f563509c-7c0f-45eb-a2fd-55ec9189af8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:03 devstack sudo[95248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-26362ef2-b5bc-4836-aedb-4346f7b3b746.f563509c-7c0f-45eb-a2fd-55ec9189af8f Jul 07 08:21:03 devstack sudo[95248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:03 devstack sudo[95243]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-862eafe5-b6eb-44b1-882a-8a67495bcf8b tempest-VolumesDeleteCascade-1233200636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d.info" returned: 0 in 0.743s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:03 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-862eafe5-b6eb-44b1-882a-8a67495bcf8b tempest-VolumesDeleteCascade-1233200636 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d.info is being set with open permissions: ugo+rw Jul 07 08:21:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-862eafe5-b6eb-44b1-882a-8a67495bcf8b tempest-VolumesDeleteCascade-1233200636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:03 devstack sudo[95251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d.info Jul 07 08:21:03 devstack sudo[95251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:03 devstack sudo[95248]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-894ac0d3-7014-4d65-905c-1adafc0ee7f7 tempest-SnapshotMetadataTestJSON-780618117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-26362ef2-b5bc-4836-aedb-4346f7b3b746.f563509c-7c0f-45eb-a2fd-55ec9189af8f" returned: 0 in 0.813s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-894ac0d3-7014-4d65-905c-1adafc0ee7f7 tempest-SnapshotMetadataTestJSON-780618117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-26362ef2-b5bc-4836-aedb-4346f7b3b746.f563509c-7c0f-45eb-a2fd-55ec9189af8f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:03 devstack sudo[95256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-26362ef2-b5bc-4836-aedb-4346f7b3b746.f563509c-7c0f-45eb-a2fd-55ec9189af8f Jul 07 08:21:03 devstack sudo[95256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:04 devstack sudo[95251]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-862eafe5-b6eb-44b1-882a-8a67495bcf8b tempest-VolumesDeleteCascade-1233200636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d.info" returned: 0 in 0.655s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-862eafe5-b6eb-44b1-882a-8a67495bcf8b tempest-VolumesDeleteCascade-1233200636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.723s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:21:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-12f14a43-b402-49b9-a554-f3e82cbdfd81 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.709s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:21:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-12f14a43-b402-49b9-a554-f3e82cbdfd81 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:20:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1182080823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63d1a94b-7299-4296-ad89-06f4f1d6fc38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3686c10d08a4185965a8d7902e7f0ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:20:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:20:58Z,use_quota=True,user_id='8fab6870700a4d47a3c386dfbb59a3e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:21:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-12f14a43-b402-49b9-a554-f3e82cbdfd81 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Creating volume 63d1a94b-7299-4296-ad89-06f4f1d6fc38 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:21:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-12f14a43-b402-49b9-a554-f3e82cbdfd81 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:21:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-12f14a43-b402-49b9-a554-f3e82cbdfd81 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:21:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-12f14a43-b402-49b9-a554-f3e82cbdfd81 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:21:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-12f14a43-b402-49b9-a554-f3e82cbdfd81 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:21:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-12f14a43-b402-49b9-a554-f3e82cbdfd81 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:21:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-12f14a43-b402-49b9-a554-f3e82cbdfd81 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:21:04 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-12f14a43-b402-49b9-a554-f3e82cbdfd81 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:21:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-12f14a43-b402-49b9-a554-f3e82cbdfd81 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-63d1a94b-7299-4296-ad89-06f4f1d6fc38 2147483648 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:04 devstack sudo[95259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-63d1a94b-7299-4296-ad89-06f4f1d6fc38 2147483648 Jul 07 08:21:04 devstack sudo[95259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:04 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-862eafe5-b6eb-44b1-882a-8a67495bcf8b tempest-VolumesDeleteCascade-1233200636 None] Create snapshot completed successfully Jul 07 08:21:04 devstack sudo[95256]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-894ac0d3-7014-4d65-905c-1adafc0ee7f7 tempest-SnapshotMetadataTestJSON-780618117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-26362ef2-b5bc-4836-aedb-4346f7b3b746.f563509c-7c0f-45eb-a2fd-55ec9189af8f" returned: 0 in 0.748s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:04 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-894ac0d3-7014-4d65-905c-1adafc0ee7f7 tempest-SnapshotMetadataTestJSON-780618117 None] Lock "cinder-quobyte-f563509c-7c0f-45eb-a2fd-55ec9189af8f" released by "_delete_snapshot" :: held 3.416s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:21:04 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-894ac0d3-7014-4d65-905c-1adafc0ee7f7 tempest-SnapshotMetadataTestJSON-780618117 None] Lock "cinder-quobyte-26362ef2-b5bc-4836-aedb-4346f7b3b746" released by "delete_snapshot" :: held 3.444s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:21:04 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-894ac0d3-7014-4d65-905c-1adafc0ee7f7 tempest-SnapshotMetadataTestJSON-780618117 None] Created reservations ['7e38a8bc-bce2-4b53-80bf-bcecc51c1099', '88397486-3f39-4ba3-ad15-b3d2bfd941c1', '51f2d227-ae87-4a7e-a272-7a4cbaf8a8c7', '92b73bca-b7f7-44eb-a237-c8b106030dec'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:21:04 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-894ac0d3-7014-4d65-905c-1adafc0ee7f7 tempest-SnapshotMetadataTestJSON-780618117 None] Delete snapshot completed successfully. Jul 07 08:21:04 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-894ac0d3-7014-4d65-905c-1adafc0ee7f7 tempest-SnapshotMetadataTestJSON-780618117 None] Lock "cinder-f563509c-7c0f-45eb-a2fd-55ec9189af8f-delete_snapshot" released by "delete_snapshot" :: held 3.620s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:21:04 devstack sudo[95259]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-12f14a43-b402-49b9-a554-f3e82cbdfd81 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-63d1a94b-7299-4296-ad89-06f4f1d6fc38 2147483648" returned: 0 in 0.957s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-12f14a43-b402-49b9-a554-f3e82cbdfd81 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-63d1a94b-7299-4296-ad89-06f4f1d6fc38 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:05 devstack sudo[95266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-63d1a94b-7299-4296-ad89-06f4f1d6fc38 Jul 07 08:21:05 devstack sudo[95266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-11c00cd7-236e-4d0f-9a16-2672739e4e07 tempest-VolumesDeleteCascade-1233200636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:21:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fb980613-bc90-4d0d-bb12-788dae9aa6ca tempest-SnapshotMetadataTestJSON-780618117 None] Acquiring lock "cinder-26362ef2-b5bc-4836-aedb-4346f7b3b746-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:21:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fb980613-bc90-4d0d-bb12-788dae9aa6ca tempest-SnapshotMetadataTestJSON-780618117 None] Lock "cinder-26362ef2-b5bc-4836-aedb-4346f7b3b746-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:21:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fb980613-bc90-4d0d-bb12-788dae9aa6ca tempest-SnapshotMetadataTestJSON-780618117 None] Acquiring lock "cinder-quobyte-26362ef2-b5bc-4836-aedb-4346f7b3b746" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:21:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fb980613-bc90-4d0d-bb12-788dae9aa6ca tempest-SnapshotMetadataTestJSON-780618117 None] Lock "cinder-quobyte-26362ef2-b5bc-4836-aedb-4346f7b3b746" acquired by "delete_volume" :: waited 0.013s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:21:05 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92234eb-3ea8-4a02-87dc-bbb075d3cfd7]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:21:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fb980613-bc90-4d0d-bb12-788dae9aa6ca tempest-SnapshotMetadataTestJSON-780618117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-26362ef2-b5bc-4836-aedb-4346f7b3b746 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:05 devstack sudo[95268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-26362ef2-b5bc-4836-aedb-4346f7b3b746 Jul 07 08:21:05 devstack sudo[95268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:05 devstack sudo[95266]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-12f14a43-b402-49b9-a554-f3e82cbdfd81 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-63d1a94b-7299-4296-ad89-06f4f1d6fc38" returned: 0 in 0.717s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-12f14a43-b402-49b9-a554-f3e82cbdfd81 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] <== create_volume: return (1721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:21:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-12f14a43-b402-49b9-a554-f3e82cbdfd81 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.725s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:21:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-11c00cd7-236e-4d0f-9a16-2672739e4e07 tempest-VolumesDeleteCascade-1233200636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.629s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:21:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-11c00cd7-236e-4d0f-9a16-2672739e4e07 tempest-VolumesDeleteCascade-1233200636 None] Creating offline snapshot 4ae949ea-7da4-48ff-a77e-f1fd83c74dc7 of volume f333c782-57cf-4a54-a396-b88b60fc891d {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:21:05 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:21:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:21:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:21:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:21:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:21:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:21:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-12f14a43-b402-49b9-a554-f3e82cbdfd81 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58f6b3cd-165d-4ba7-baa9-7bb212283915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63d1a94b-7299-4296-ad89-06f4f1d6fc38', 'volume_size': 2}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:21:05 devstack sudo[95271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:21:05 devstack sudo[95271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-12f14a43-b402-49b9-a554-f3e82cbdfd81 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (078d776a-ff85-4594-8e68-87dab6b21331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:21:05 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a362da-4a0e-4d6f-bcee-aac5c8641a2c]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:21:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-11c00cd7-236e-4d0f-9a16-2672739e4e07 tempest-VolumesDeleteCascade-1233200636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d.045bd478-1bf2-48d7-998c-97ce918e31e6 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:05 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-12f14a43-b402-49b9-a554-f3e82cbdfd81 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Volume volume-63d1a94b-7299-4296-ad89-06f4f1d6fc38 (63d1a94b-7299-4296-ad89-06f4f1d6fc38): created successfully Jul 07 08:21:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-12f14a43-b402-49b9-a554-f3e82cbdfd81 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (078d776a-ff85-4594-8e68-87dab6b21331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:21:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-12f14a43-b402-49b9-a554-f3e82cbdfd81 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Flow 'volume_create_manager' (f8e9ebab-a548-4f75-9901-1f208d2843b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:21:05 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-20dffefa-d020-4524-a079-0e76d6739bfc tempest-GroupsV314Test-1651555741 None] Group tempest-GroupsV314Test-Group-1233296021: creating Jul 07 08:21:05 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-12f14a43-b402-49b9-a554-f3e82cbdfd81 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Created volume successfully. Jul 07 08:21:05 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-20dffefa-d020-4524-a079-0e76d6739bfc tempest-GroupsV314Test-1651555741 None] Group tempest-GroupsV314Test-Group-1233296021: created successfully Jul 07 08:21:05 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-20dffefa-d020-4524-a079-0e76d6739bfc tempest-GroupsV314Test-1651555741 None] Create group completed successfully. Jul 07 08:21:06 devstack sudo[95273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d.045bd478-1bf2-48d7-998c-97ce918e31e6 Jul 07 08:21:06 devstack sudo[95273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:06 devstack sudo[95268]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fb980613-bc90-4d0d-bb12-788dae9aa6ca tempest-SnapshotMetadataTestJSON-780618117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-26362ef2-b5bc-4836-aedb-4346f7b3b746" returned: 0 in 0.841s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fb980613-bc90-4d0d-bb12-788dae9aa6ca tempest-SnapshotMetadataTestJSON-780618117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-26362ef2-b5bc-4836-aedb-4346f7b3b746 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:06 devstack sudo[95279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-26362ef2-b5bc-4836-aedb-4346f7b3b746 Jul 07 08:21:06 devstack sudo[95279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:06 devstack sudo[95271]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.654s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:06 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:21:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running periodic task VolumeManager._thread_info {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:21:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] thread count: 28 {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 08:21:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] thread info: [<_MainThread(MainThread, started 133056092332160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 08:21:06 devstack sudo[95273]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-11c00cd7-236e-4d0f-9a16-2672739e4e07 tempest-VolumesDeleteCascade-1233200636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d.045bd478-1bf2-48d7-998c-97ce918e31e6" returned: 0 in 0.829s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-11c00cd7-236e-4d0f-9a16-2672739e4e07 tempest-VolumesDeleteCascade-1233200636 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f333c782-57cf-4a54-a396-b88b60fc891d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:21:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-11c00cd7-236e-4d0f-9a16-2672739e4e07 tempest-VolumesDeleteCascade-1233200636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d.045bd478-1bf2-48d7-998c-97ce918e31e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d.4ae949ea-7da4-48ff-a77e-f1fd83c74dc7 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:06 devstack sudo[95284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d.045bd478-1bf2-48d7-998c-97ce918e31e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d.4ae949ea-7da4-48ff-a77e-f1fd83c74dc7 1G Jul 07 08:21:06 devstack sudo[95284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-19a9294f-b6e8-4043-ad9c-004ec97eb7f5 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:21:07 devstack sudo[95279]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fb980613-bc90-4d0d-bb12-788dae9aa6ca tempest-SnapshotMetadataTestJSON-780618117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-26362ef2-b5bc-4836-aedb-4346f7b3b746" returned: 0 in 0.697s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:07 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fb980613-bc90-4d0d-bb12-788dae9aa6ca tempest-SnapshotMetadataTestJSON-780618117 None] Lock "cinder-quobyte-26362ef2-b5bc-4836-aedb-4346f7b3b746" released by "delete_volume" :: held 1.627s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:21:07 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-fb980613-bc90-4d0d-bb12-788dae9aa6ca tempest-SnapshotMetadataTestJSON-780618117 None] Created reservations ['54aff397-ba4c-406f-a697-0bb9940bc3f2', 'fb05ea6d-2b08-499a-bd68-961de9bebcf0', '9123f3eb-3d2e-4566-8da6-5afc975ff051', '64968289-9be3-4f15-a8da-8e481790ecba'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:21:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-fb980613-bc90-4d0d-bb12-788dae9aa6ca tempest-SnapshotMetadataTestJSON-780618117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:21:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-fb980613-bc90-4d0d-bb12-788dae9aa6ca tempest-SnapshotMetadataTestJSON-780618117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:21:07 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-fb980613-bc90-4d0d-bb12-788dae9aa6ca tempest-SnapshotMetadataTestJSON-780618117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:21:07 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-fb980613-bc90-4d0d-bb12-788dae9aa6ca tempest-SnapshotMetadataTestJSON-780618117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:21:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-fb980613-bc90-4d0d-bb12-788dae9aa6ca tempest-SnapshotMetadataTestJSON-780618117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:21:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fb980613-bc90-4d0d-bb12-788dae9aa6ca tempest-SnapshotMetadataTestJSON-780618117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:07 devstack sudo[95287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:21:07 devstack sudo[95287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:07 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e90818c-f629-48b6-b752-6674f059013a tempest-GroupsV314Test-1651555741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:21:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8e90818c-f629-48b6-b752-6674f059013a tempest-GroupsV314Test-1651555741 None] Flow 'volume_create_manager' (967eb9fb-05e1-458b-8159-7b50309d0fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:21:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8e90818c-f629-48b6-b752-6674f059013a tempest-GroupsV314Test-1651555741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ee76de6-9e0e-4c24-a476-5d31efd85655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:21:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8e90818c-f629-48b6-b752-6674f059013a tempest-GroupsV314Test-1651555741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ee76de6-9e0e-4c24-a476-5d31efd85655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-629712843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=70f3e932-a113-4725-a23c-e6f85544255f,host='devstack@QuobyteHD#QuobyteHD',id=35cac7f2-2952-4e01-aba5-e6dfbb696e29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caba21e0426846b7a6c1fe7bb37723bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:21:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:21:07Z,use_quota=True,user_id='85891c46536c46638ff8d7dc453d1c4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bcfbaf48-6d46-4f2c-8c93-33d3aaf84a46),volume_type_id=bcfbaf48-6d46-4f2c-8c93-33d3aaf84a46)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:21:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8e90818c-f629-48b6-b752-6674f059013a tempest-GroupsV314Test-1651555741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89b309f9-c117-47f3-ae4c-a7c6f5a61010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:21:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8e90818c-f629-48b6-b752-6674f059013a tempest-GroupsV314Test-1651555741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89b309f9-c117-47f3-ae4c-a7c6f5a61010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:21:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8e90818c-f629-48b6-b752-6674f059013a tempest-GroupsV314Test-1651555741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d7f5006-1219-4e10-9f0a-fb481d53aaf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:21:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8e90818c-f629-48b6-b752-6674f059013a tempest-GroupsV314Test-1651555741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d7f5006-1219-4e10-9f0a-fb481d53aaf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35cac7f2-2952-4e01-aba5-e6dfbb696e29', 'volume_name': 'volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:21:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8e90818c-f629-48b6-b752-6674f059013a tempest-GroupsV314Test-1651555741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b08faaa6-b0f3-4250-b367-84faeb6a2b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:21:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8e90818c-f629-48b6-b752-6674f059013a tempest-GroupsV314Test-1651555741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b08faaa6-b0f3-4250-b367-84faeb6a2b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:21:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8e90818c-f629-48b6-b752-6674f059013a tempest-GroupsV314Test-1651555741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (475d9cb6-45ed-47c5-bd9c-694671f7e6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:21:07 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-8e90818c-f629-48b6-b752-6674f059013a tempest-GroupsV314Test-1651555741 None] Volume 35cac7f2-2952-4e01-aba5-e6dfbb696e29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29', 'volume_size': 1} Jul 07 08:21:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8e90818c-f629-48b6-b752-6674f059013a tempest-GroupsV314Test-1651555741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:21:07 devstack sudo[95284]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-11c00cd7-236e-4d0f-9a16-2672739e4e07 tempest-VolumesDeleteCascade-1233200636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d.045bd478-1bf2-48d7-998c-97ce918e31e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d.4ae949ea-7da4-48ff-a77e-f1fd83c74dc7 1G" returned: 0 in 0.998s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-11c00cd7-236e-4d0f-9a16-2672739e4e07 tempest-VolumesDeleteCascade-1233200636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f333c782-57cf-4a54-a396-b88b60fc891d.045bd478-1bf2-48d7-998c-97ce918e31e6 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d.4ae949ea-7da4-48ff-a77e-f1fd83c74dc7 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:07 devstack sudo[95293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f333c782-57cf-4a54-a396-b88b60fc891d.045bd478-1bf2-48d7-998c-97ce918e31e6 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d.4ae949ea-7da4-48ff-a77e-f1fd83c74dc7 Jul 07 08:21:07 devstack sudo[95293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:08 devstack sudo[95287]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fb980613-bc90-4d0d-bb12-788dae9aa6ca tempest-SnapshotMetadataTestJSON-780618117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.763s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:08 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-fb980613-bc90-4d0d-bb12-788dae9aa6ca tempest-SnapshotMetadataTestJSON-780618117 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:21:08 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-fb980613-bc90-4d0d-bb12-788dae9aa6ca tempest-SnapshotMetadataTestJSON-780618117 None] Deleted volume successfully. Jul 07 08:21:08 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fb980613-bc90-4d0d-bb12-788dae9aa6ca tempest-SnapshotMetadataTestJSON-780618117 None] Lock "cinder-26362ef2-b5bc-4836-aedb-4346f7b3b746-delete_volume" released by "delete_volume" :: held 2.626s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:21:08 devstack sudo[95293]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-11c00cd7-236e-4d0f-9a16-2672739e4e07 tempest-VolumesDeleteCascade-1233200636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f333c782-57cf-4a54-a396-b88b60fc891d.045bd478-1bf2-48d7-998c-97ce918e31e6 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d.4ae949ea-7da4-48ff-a77e-f1fd83c74dc7" returned: 0 in 0.723s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:08 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-11c00cd7-236e-4d0f-9a16-2672739e4e07 tempest-VolumesDeleteCascade-1233200636 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d.4ae949ea-7da4-48ff-a77e-f1fd83c74dc7 is being set with open permissions: ugo+rw Jul 07 08:21:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-11c00cd7-236e-4d0f-9a16-2672739e4e07 tempest-VolumesDeleteCascade-1233200636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d.4ae949ea-7da4-48ff-a77e-f1fd83c74dc7 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:08 devstack sudo[95300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d.4ae949ea-7da4-48ff-a77e-f1fd83c74dc7 Jul 07 08:21:08 devstack sudo[95300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:09 devstack sudo[95300]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-11c00cd7-236e-4d0f-9a16-2672739e4e07 tempest-VolumesDeleteCascade-1233200636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d.4ae949ea-7da4-48ff-a77e-f1fd83c74dc7" returned: 0 in 0.677s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-11c00cd7-236e-4d0f-9a16-2672739e4e07 tempest-VolumesDeleteCascade-1233200636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.404s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:21:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-19a9294f-b6e8-4043-ad9c-004ec97eb7f5 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.180s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:21:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-19a9294f-b6e8-4043-ad9c-004ec97eb7f5 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Creating offline snapshot 27416941-522f-473e-ac02-3a48c174d4b6 of volume 63d1a94b-7299-4296-ad89-06f4f1d6fc38 {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:21:09 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-11c00cd7-236e-4d0f-9a16-2672739e4e07 tempest-VolumesDeleteCascade-1233200636 None] Create snapshot completed successfully Jul 07 08:21:09 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[04dc73c0-1550-4c17-95de-445c7c24774c]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:21:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-19a9294f-b6e8-4043-ad9c-004ec97eb7f5 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-63d1a94b-7299-4296-ad89-06f4f1d6fc38 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:09 devstack sudo[95303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-63d1a94b-7299-4296-ad89-06f4f1d6fc38 Jul 07 08:21:09 devstack sudo[95303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:09 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] Acquiring lock "cinder-f333c782-57cf-4a54-a396-b88b60fc891d-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:21:09 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] Lock "cinder-f333c782-57cf-4a54-a396-b88b60fc891d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:21:09 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:UPDATE=157,cinder:SELECT=135,cinder:INSERT=44,cinder:DELETE=13 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:21:09 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:UPDATE=165,cinder:DELETE=11,cinder:SELECT=142,cinder:INSERT=43 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:21:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] Performing cascade delete. {{(pid=87199) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 07 08:21:09 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] Acquiring lock "cinder-045bd478-1bf2-48d7-998c-97ce918e31e6-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:21:09 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] Lock "cinder-045bd478-1bf2-48d7-998c-97ce918e31e6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:21:09 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] Acquiring lock "cinder-quobyte-f333c782-57cf-4a54-a396-b88b60fc891d" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:21:09 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] Lock "cinder-quobyte-f333c782-57cf-4a54-a396-b88b60fc891d" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:21:09 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] Acquiring lock "cinder-quobyte-045bd478-1bf2-48d7-998c-97ce918e31e6" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:21:09 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] Lock "cinder-quobyte-045bd478-1bf2-48d7-998c-97ce918e31e6" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:21:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] Deleting offline snapshot 045bd478-1bf2-48d7-998c-97ce918e31e6 of volume f333c782-57cf-4a54-a396-b88b60fc891d {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:21:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] snapshot_file for this snap is: volume-f333c782-57cf-4a54-a396-b88b60fc891d.045bd478-1bf2-48d7-998c-97ce918e31e6 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:21:09 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a7bb3e-9141-471f-bfd9-ca45a4827125]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:21:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d.045bd478-1bf2-48d7-998c-97ce918e31e6 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:09 devstack sudo[95305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d.045bd478-1bf2-48d7-998c-97ce918e31e6 Jul 07 08:21:09 devstack sudo[95305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:10 devstack sudo[95303]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-19a9294f-b6e8-4043-ad9c-004ec97eb7f5 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-63d1a94b-7299-4296-ad89-06f4f1d6fc38" returned: 0 in 0.824s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-19a9294f-b6e8-4043-ad9c-004ec97eb7f5 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-63d1a94b-7299-4296-ad89-06f4f1d6fc38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-63d1a94b-7299-4296-ad89-06f4f1d6fc38.27416941-522f-473e-ac02-3a48c174d4b6 2G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:10 devstack sudo[95310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-63d1a94b-7299-4296-ad89-06f4f1d6fc38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-63d1a94b-7299-4296-ad89-06f4f1d6fc38.27416941-522f-473e-ac02-3a48c174d4b6 2G Jul 07 08:21:10 devstack sudo[95310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:10 devstack sudo[95305]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d.045bd478-1bf2-48d7-998c-97ce918e31e6" returned: 0 in 0.820s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:10 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f333c782-57cf-4a54-a396-b88b60fc891d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:21:10 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9e875d-0578-4f29-a2d6-959bf2d0998e]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:21:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:10 devstack sudo[95315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d Jul 07 08:21:10 devstack sudo[95315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:10 devstack sudo[95310]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-19a9294f-b6e8-4043-ad9c-004ec97eb7f5 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-63d1a94b-7299-4296-ad89-06f4f1d6fc38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-63d1a94b-7299-4296-ad89-06f4f1d6fc38.27416941-522f-473e-ac02-3a48c174d4b6 2G" returned: 0 in 0.920s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-19a9294f-b6e8-4043-ad9c-004ec97eb7f5 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63d1a94b-7299-4296-ad89-06f4f1d6fc38 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-63d1a94b-7299-4296-ad89-06f4f1d6fc38.27416941-522f-473e-ac02-3a48c174d4b6 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:10 devstack sudo[95322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63d1a94b-7299-4296-ad89-06f4f1d6fc38 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-63d1a94b-7299-4296-ad89-06f4f1d6fc38.27416941-522f-473e-ac02-3a48c174d4b6 Jul 07 08:21:10 devstack sudo[95322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:11 devstack sudo[95315]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d" returned: 0 in 0.825s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:11 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[c806160d-0e52-4ea8-9553-2d7a63ecd3af]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:21:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d.4ae949ea-7da4-48ff-a77e-f1fd83c74dc7 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:11 devstack sudo[95327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d.4ae949ea-7da4-48ff-a77e-f1fd83c74dc7 Jul 07 08:21:11 devstack sudo[95327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:11 devstack sudo[95322]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-19a9294f-b6e8-4043-ad9c-004ec97eb7f5 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63d1a94b-7299-4296-ad89-06f4f1d6fc38 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-63d1a94b-7299-4296-ad89-06f4f1d6fc38.27416941-522f-473e-ac02-3a48c174d4b6" returned: 0 in 0.819s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:11 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-19a9294f-b6e8-4043-ad9c-004ec97eb7f5 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-63d1a94b-7299-4296-ad89-06f4f1d6fc38.27416941-522f-473e-ac02-3a48c174d4b6 is being set with open permissions: ugo+rw Jul 07 08:21:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-19a9294f-b6e8-4043-ad9c-004ec97eb7f5 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-63d1a94b-7299-4296-ad89-06f4f1d6fc38.27416941-522f-473e-ac02-3a48c174d4b6 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:11 devstack sudo[95333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-63d1a94b-7299-4296-ad89-06f4f1d6fc38.27416941-522f-473e-ac02-3a48c174d4b6 Jul 07 08:21:11 devstack sudo[95333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:12 devstack sudo[95327]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d.4ae949ea-7da4-48ff-a77e-f1fd83c74dc7" returned: 0 in 0.796s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:12 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f333c782-57cf-4a54-a396-b88b60fc891d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:21:12 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[4710bf4f-df2c-4811-be1a-f3530f289fed]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:21:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d.045bd478-1bf2-48d7-998c-97ce918e31e6 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:12 devstack sudo[95338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d.045bd478-1bf2-48d7-998c-97ce918e31e6 Jul 07 08:21:12 devstack sudo[95338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:12 devstack sudo[95333]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-19a9294f-b6e8-4043-ad9c-004ec97eb7f5 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-63d1a94b-7299-4296-ad89-06f4f1d6fc38.27416941-522f-473e-ac02-3a48c174d4b6" returned: 0 in 0.688s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-19a9294f-b6e8-4043-ad9c-004ec97eb7f5 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-63d1a94b-7299-4296-ad89-06f4f1d6fc38.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:12 devstack sudo[95341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-63d1a94b-7299-4296-ad89-06f4f1d6fc38.info Jul 07 08:21:12 devstack sudo[95341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:12 devstack sudo[95338]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d.045bd478-1bf2-48d7-998c-97ce918e31e6" returned: 0 in 0.807s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:12 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f333c782-57cf-4a54-a396-b88b60fc891d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:21:12 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f96d55-17d4-47e2-b65d-c51b6bd65e81]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:21:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:13 devstack sudo[95347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d Jul 07 08:21:13 devstack sudo[95347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:13 devstack sudo[95341]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-19a9294f-b6e8-4043-ad9c-004ec97eb7f5 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-63d1a94b-7299-4296-ad89-06f4f1d6fc38.info" returned: 0 in 0.709s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:13 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-19a9294f-b6e8-4043-ad9c-004ec97eb7f5 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-63d1a94b-7299-4296-ad89-06f4f1d6fc38.info is being set with open permissions: ugo+rw Jul 07 08:21:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-19a9294f-b6e8-4043-ad9c-004ec97eb7f5 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-63d1a94b-7299-4296-ad89-06f4f1d6fc38.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:13 devstack sudo[95350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-63d1a94b-7299-4296-ad89-06f4f1d6fc38.info Jul 07 08:21:13 devstack sudo[95350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:13 devstack sudo[95347]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d" returned: 0 in 0.897s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d.045bd478-1bf2-48d7-998c-97ce918e31e6 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:13 devstack sudo[95356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d.045bd478-1bf2-48d7-998c-97ce918e31e6 Jul 07 08:21:13 devstack sudo[95356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:13 devstack sudo[95350]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-19a9294f-b6e8-4043-ad9c-004ec97eb7f5 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-63d1a94b-7299-4296-ad89-06f4f1d6fc38.info" returned: 0 in 0.683s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-19a9294f-b6e8-4043-ad9c-004ec97eb7f5 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.763s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:21:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8e90818c-f629-48b6-b752-6674f059013a tempest-GroupsV314Test-1651555741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.299s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:21:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8e90818c-f629-48b6-b752-6674f059013a tempest-GroupsV314Test-1651555741 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=70f3e932-a113-4725-a23c-e6f85544255f,created_at=2026-07-07T06:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-629712843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=70f3e932-a113-4725-a23c-e6f85544255f,host='devstack@QuobyteHD#QuobyteHD',id=35cac7f2-2952-4e01-aba5-e6dfbb696e29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caba21e0426846b7a6c1fe7bb37723bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:21:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:21:07Z,use_quota=True,user_id='85891c46536c46638ff8d7dc453d1c4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bcfbaf48-6d46-4f2c-8c93-33d3aaf84a46),volume_type_id=bcfbaf48-6d46-4f2c-8c93-33d3aaf84a46)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:21:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-8e90818c-f629-48b6-b752-6674f059013a tempest-GroupsV314Test-1651555741 None] Creating volume 35cac7f2-2952-4e01-aba5-e6dfbb696e29 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:21:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8e90818c-f629-48b6-b752-6674f059013a tempest-GroupsV314Test-1651555741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:21:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8e90818c-f629-48b6-b752-6674f059013a tempest-GroupsV314Test-1651555741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:21:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8e90818c-f629-48b6-b752-6674f059013a tempest-GroupsV314Test-1651555741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:21:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8e90818c-f629-48b6-b752-6674f059013a tempest-GroupsV314Test-1651555741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:21:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8e90818c-f629-48b6-b752-6674f059013a tempest-GroupsV314Test-1651555741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:21:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8e90818c-f629-48b6-b752-6674f059013a tempest-GroupsV314Test-1651555741 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:21:13 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-8e90818c-f629-48b6-b752-6674f059013a tempest-GroupsV314Test-1651555741 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:21:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8e90818c-f629-48b6-b752-6674f059013a tempest-GroupsV314Test-1651555741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:13 devstack sudo[95358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29 1073741824 Jul 07 08:21:13 devstack sudo[95358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:14 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-19a9294f-b6e8-4043-ad9c-004ec97eb7f5 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Create snapshot completed successfully Jul 07 08:21:14 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fd7829f6-ffe1-434c-a639-5c1a26edb916 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Acquiring lock "cinder-27416941-522f-473e-ac02-3a48c174d4b6-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:21:14 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fd7829f6-ffe1-434c-a639-5c1a26edb916 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Lock "cinder-27416941-522f-473e-ac02-3a48c174d4b6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:21:14 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fd7829f6-ffe1-434c-a639-5c1a26edb916 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Acquiring lock "cinder-quobyte-63d1a94b-7299-4296-ad89-06f4f1d6fc38" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:21:14 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fd7829f6-ffe1-434c-a639-5c1a26edb916 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Lock "cinder-quobyte-63d1a94b-7299-4296-ad89-06f4f1d6fc38" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:21:14 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fd7829f6-ffe1-434c-a639-5c1a26edb916 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Acquiring lock "cinder-quobyte-27416941-522f-473e-ac02-3a48c174d4b6" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:21:14 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fd7829f6-ffe1-434c-a639-5c1a26edb916 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Lock "cinder-quobyte-27416941-522f-473e-ac02-3a48c174d4b6" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:21:14 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-fd7829f6-ffe1-434c-a639-5c1a26edb916 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Deleting offline snapshot 27416941-522f-473e-ac02-3a48c174d4b6 of volume 63d1a94b-7299-4296-ad89-06f4f1d6fc38 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:21:14 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-fd7829f6-ffe1-434c-a639-5c1a26edb916 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] snapshot_file for this snap is: volume-63d1a94b-7299-4296-ad89-06f4f1d6fc38.27416941-522f-473e-ac02-3a48c174d4b6 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:21:14 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9cd9de-8627-4550-b4eb-75eda37a64f9]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:21:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fd7829f6-ffe1-434c-a639-5c1a26edb916 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-63d1a94b-7299-4296-ad89-06f4f1d6fc38.27416941-522f-473e-ac02-3a48c174d4b6 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:14 devstack sudo[95364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-63d1a94b-7299-4296-ad89-06f4f1d6fc38.27416941-522f-473e-ac02-3a48c174d4b6 Jul 07 08:21:14 devstack sudo[95364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:14 devstack sudo[95356]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d.045bd478-1bf2-48d7-998c-97ce918e31e6" returned: 0 in 1.088s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d.045bd478-1bf2-48d7-998c-97ce918e31e6 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:14 devstack sudo[95370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d.045bd478-1bf2-48d7-998c-97ce918e31e6 Jul 07 08:21:14 devstack sudo[95370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:15 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-2523a310-bec7-4830-8aa1-1c737a93bd9d tempest-VolumesTransfersTest-1721540905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:21:15 devstack sudo[95358]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2523a310-bec7-4830-8aa1-1c737a93bd9d tempest-VolumesTransfersTest-1721540905 None] Flow 'volume_create_manager' (0b898202-f9a2-454a-a296-76d0357bf3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:21:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2523a310-bec7-4830-8aa1-1c737a93bd9d tempest-VolumesTransfersTest-1721540905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35a1af28-7573-4fe6-afb3-70d33f8d075d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:21:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8e90818c-f629-48b6-b752-6674f059013a tempest-GroupsV314Test-1651555741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29 1073741824" returned: 0 in 1.142s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2523a310-bec7-4830-8aa1-1c737a93bd9d tempest-VolumesTransfersTest-1721540905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35a1af28-7573-4fe6-afb3-70d33f8d075d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:21:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-985636778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62cfe80f-8e7f-4002-80eb-e1da07edffdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a92535059bb944aa87faa1f8534e0647',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:21:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:21:15Z,use_quota=True,user_id='2b62dc929a0c4381b56ffb54b7cd84e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:21:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2523a310-bec7-4830-8aa1-1c737a93bd9d tempest-VolumesTransfersTest-1721540905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (450be8b4-11a6-4c77-9700-128cb52c90de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:21:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2523a310-bec7-4830-8aa1-1c737a93bd9d tempest-VolumesTransfersTest-1721540905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (450be8b4-11a6-4c77-9700-128cb52c90de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:21:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2523a310-bec7-4830-8aa1-1c737a93bd9d tempest-VolumesTransfersTest-1721540905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53fd5ec9-4d5b-4c59-9a5d-623e1aa23784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:21:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2523a310-bec7-4830-8aa1-1c737a93bd9d tempest-VolumesTransfersTest-1721540905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53fd5ec9-4d5b-4c59-9a5d-623e1aa23784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62cfe80f-8e7f-4002-80eb-e1da07edffdb', 'volume_name': 'volume-62cfe80f-8e7f-4002-80eb-e1da07edffdb', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:21:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2523a310-bec7-4830-8aa1-1c737a93bd9d tempest-VolumesTransfersTest-1721540905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45c788d6-b3af-494f-8ef2-a9e4a9ed749c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:21:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2523a310-bec7-4830-8aa1-1c737a93bd9d tempest-VolumesTransfersTest-1721540905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45c788d6-b3af-494f-8ef2-a9e4a9ed749c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:21:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2523a310-bec7-4830-8aa1-1c737a93bd9d tempest-VolumesTransfersTest-1721540905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5710ae9-e6b7-4dfa-be6e-ca41193dee45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:21:15 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-2523a310-bec7-4830-8aa1-1c737a93bd9d tempest-VolumesTransfersTest-1721540905 None] Volume 62cfe80f-8e7f-4002-80eb-e1da07edffdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62cfe80f-8e7f-4002-80eb-e1da07edffdb', 'volume_size': 1} Jul 07 08:21:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-2523a310-bec7-4830-8aa1-1c737a93bd9d tempest-VolumesTransfersTest-1721540905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:21:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8e90818c-f629-48b6-b752-6674f059013a tempest-GroupsV314Test-1651555741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:15 devstack sudo[95372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29 Jul 07 08:21:15 devstack sudo[95372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:15 devstack sudo[95364]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fd7829f6-ffe1-434c-a639-5c1a26edb916 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-63d1a94b-7299-4296-ad89-06f4f1d6fc38.27416941-522f-473e-ac02-3a48c174d4b6" returned: 0 in 0.896s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-fd7829f6-ffe1-434c-a639-5c1a26edb916 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63d1a94b-7299-4296-ad89-06f4f1d6fc38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:21:15 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[143baff9-a79c-48f5-b5e2-b8796c01e51b]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:21:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fd7829f6-ffe1-434c-a639-5c1a26edb916 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-63d1a94b-7299-4296-ad89-06f4f1d6fc38 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:15 devstack sudo[95378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-63d1a94b-7299-4296-ad89-06f4f1d6fc38 Jul 07 08:21:15 devstack sudo[95378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:15 devstack sudo[95370]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d.045bd478-1bf2-48d7-998c-97ce918e31e6" returned: 0 in 0.684s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f333c782-57cf-4a54-a396-b88b60fc891d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d.4ae949ea-7da4-48ff-a77e-f1fd83c74dc7 -F qcow2 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:15 devstack sudo[95380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f333c782-57cf-4a54-a396-b88b60fc891d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d.4ae949ea-7da4-48ff-a77e-f1fd83c74dc7 -F qcow2 Jul 07 08:21:15 devstack sudo[95380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:15 devstack sudo[95372]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8e90818c-f629-48b6-b752-6674f059013a tempest-GroupsV314Test-1651555741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29" returned: 0 in 0.673s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8e90818c-f629-48b6-b752-6674f059013a tempest-GroupsV314Test-1651555741 None] <== create_volume: return (1917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:21:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8e90818c-f629-48b6-b752-6674f059013a tempest-GroupsV314Test-1651555741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.923s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:21:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-2523a310-bec7-4830-8aa1-1c737a93bd9d tempest-VolumesTransfersTest-1721540905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.705s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:21:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-2523a310-bec7-4830-8aa1-1c737a93bd9d tempest-VolumesTransfersTest-1721540905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:21:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-985636778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62cfe80f-8e7f-4002-80eb-e1da07edffdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a92535059bb944aa87faa1f8534e0647',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:21:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:21:15Z,use_quota=True,user_id='2b62dc929a0c4381b56ffb54b7cd84e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:21:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-2523a310-bec7-4830-8aa1-1c737a93bd9d tempest-VolumesTransfersTest-1721540905 None] Creating volume 62cfe80f-8e7f-4002-80eb-e1da07edffdb {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:21:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-2523a310-bec7-4830-8aa1-1c737a93bd9d tempest-VolumesTransfersTest-1721540905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:21:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-2523a310-bec7-4830-8aa1-1c737a93bd9d tempest-VolumesTransfersTest-1721540905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:21:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-2523a310-bec7-4830-8aa1-1c737a93bd9d tempest-VolumesTransfersTest-1721540905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:21:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-2523a310-bec7-4830-8aa1-1c737a93bd9d tempest-VolumesTransfersTest-1721540905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:21:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-2523a310-bec7-4830-8aa1-1c737a93bd9d tempest-VolumesTransfersTest-1721540905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:21:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-2523a310-bec7-4830-8aa1-1c737a93bd9d tempest-VolumesTransfersTest-1721540905 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:21:15 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-2523a310-bec7-4830-8aa1-1c737a93bd9d tempest-VolumesTransfersTest-1721540905 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:21:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-2523a310-bec7-4830-8aa1-1c737a93bd9d tempest-VolumesTransfersTest-1721540905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-62cfe80f-8e7f-4002-80eb-e1da07edffdb 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8e90818c-f629-48b6-b752-6674f059013a tempest-GroupsV314Test-1651555741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (475d9cb6-45ed-47c5-bd9c-694671f7e6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:21:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8e90818c-f629-48b6-b752-6674f059013a tempest-GroupsV314Test-1651555741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68491588-6c55-4b95-9ba3-87009eb6218e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:21:15 devstack sudo[95383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-62cfe80f-8e7f-4002-80eb-e1da07edffdb 1073741824 Jul 07 08:21:15 devstack sudo[95383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:15 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-8e90818c-f629-48b6-b752-6674f059013a tempest-GroupsV314Test-1651555741 None] Volume volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29 (35cac7f2-2952-4e01-aba5-e6dfbb696e29): created successfully Jul 07 08:21:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8e90818c-f629-48b6-b752-6674f059013a tempest-GroupsV314Test-1651555741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68491588-6c55-4b95-9ba3-87009eb6218e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:21:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8e90818c-f629-48b6-b752-6674f059013a tempest-GroupsV314Test-1651555741 None] Flow 'volume_create_manager' (967eb9fb-05e1-458b-8159-7b50309d0fa2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:21:15 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-8e90818c-f629-48b6-b752-6674f059013a tempest-GroupsV314Test-1651555741 None] Created volume successfully. Jul 07 08:21:16 devstack sudo[95378]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fd7829f6-ffe1-434c-a639-5c1a26edb916 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-63d1a94b-7299-4296-ad89-06f4f1d6fc38" returned: 0 in 0.873s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fd7829f6-ffe1-434c-a639-5c1a26edb916 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-63d1a94b-7299-4296-ad89-06f4f1d6fc38.27416941-522f-473e-ac02-3a48c174d4b6 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:16 devstack sudo[95391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-63d1a94b-7299-4296-ad89-06f4f1d6fc38.27416941-522f-473e-ac02-3a48c174d4b6 Jul 07 08:21:16 devstack sudo[95391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:16 devstack sudo[95380]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f333c782-57cf-4a54-a396-b88b60fc891d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d.4ae949ea-7da4-48ff-a77e-f1fd83c74dc7 -F qcow2" returned: 0 in 0.794s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:16 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] Lock "cinder-quobyte-045bd478-1bf2-48d7-998c-97ce918e31e6" released by "_delete_snapshot" :: held 6.885s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:21:16 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] Lock "cinder-quobyte-f333c782-57cf-4a54-a396-b88b60fc891d" released by "delete_snapshot" :: held 6.913s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:21:16 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] Created reservations ['3bbd8120-0099-4e11-becb-af6cc829adb2', '2df5db87-41e7-46f7-9d52-c0a89e5267ad', 'ea643908-c5c6-41e1-a6b4-6328bdd8180b', '5dce1568-76da-48d1-becc-4aaf32ab1716'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:21:16 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] Delete snapshot completed successfully. Jul 07 08:21:16 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] Lock "cinder-045bd478-1bf2-48d7-998c-97ce918e31e6-delete_snapshot" released by "delete_snapshot" :: held 7.114s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:21:16 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] Acquiring lock "cinder-4ae949ea-7da4-48ff-a77e-f1fd83c74dc7-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:21:16 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] Lock "cinder-4ae949ea-7da4-48ff-a77e-f1fd83c74dc7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:21:16 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] Acquiring lock "cinder-quobyte-f333c782-57cf-4a54-a396-b88b60fc891d" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:21:16 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] Lock "cinder-quobyte-f333c782-57cf-4a54-a396-b88b60fc891d" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:21:16 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] Acquiring lock "cinder-quobyte-4ae949ea-7da4-48ff-a77e-f1fd83c74dc7" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:21:16 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] Lock "cinder-quobyte-4ae949ea-7da4-48ff-a77e-f1fd83c74dc7" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:21:16 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] Deleting offline snapshot 4ae949ea-7da4-48ff-a77e-f1fd83c74dc7 of volume f333c782-57cf-4a54-a396-b88b60fc891d {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:21:16 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] snapshot_file for this snap is: volume-f333c782-57cf-4a54-a396-b88b60fc891d.4ae949ea-7da4-48ff-a77e-f1fd83c74dc7 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:21:16 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[122a6937-1d49-45bb-9ec0-966bd0c79f95]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:21:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d.4ae949ea-7da4-48ff-a77e-f1fd83c74dc7 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:16 devstack sudo[95383]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-2523a310-bec7-4830-8aa1-1c737a93bd9d tempest-VolumesTransfersTest-1721540905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-62cfe80f-8e7f-4002-80eb-e1da07edffdb 1073741824" returned: 0 in 0.930s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:16 devstack sudo[95397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d.4ae949ea-7da4-48ff-a77e-f1fd83c74dc7 Jul 07 08:21:16 devstack sudo[95397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-2523a310-bec7-4830-8aa1-1c737a93bd9d tempest-VolumesTransfersTest-1721540905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-62cfe80f-8e7f-4002-80eb-e1da07edffdb {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:16 devstack sudo[95399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-62cfe80f-8e7f-4002-80eb-e1da07edffdb Jul 07 08:21:16 devstack sudo[95399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:17 devstack sudo[95391]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fd7829f6-ffe1-434c-a639-5c1a26edb916 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-63d1a94b-7299-4296-ad89-06f4f1d6fc38.27416941-522f-473e-ac02-3a48c174d4b6" returned: 0 in 0.905s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fd7829f6-ffe1-434c-a639-5c1a26edb916 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-63d1a94b-7299-4296-ad89-06f4f1d6fc38.27416941-522f-473e-ac02-3a48c174d4b6 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:17 devstack sudo[95404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-63d1a94b-7299-4296-ad89-06f4f1d6fc38.27416941-522f-473e-ac02-3a48c174d4b6 Jul 07 08:21:17 devstack sudo[95404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:17 devstack sudo[95397]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d.4ae949ea-7da4-48ff-a77e-f1fd83c74dc7" returned: 0 in 0.867s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:17 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f333c782-57cf-4a54-a396-b88b60fc891d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:21:17 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[226b55f6-1da5-4c1d-97a1-6f279348baf2]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:21:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:17 devstack sudo[95399]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-2523a310-bec7-4830-8aa1-1c737a93bd9d tempest-VolumesTransfersTest-1721540905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-62cfe80f-8e7f-4002-80eb-e1da07edffdb" returned: 0 in 0.813s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:17 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-2523a310-bec7-4830-8aa1-1c737a93bd9d tempest-VolumesTransfersTest-1721540905 None] <== create_volume: return (1815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:21:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-2523a310-bec7-4830-8aa1-1c737a93bd9d tempest-VolumesTransfersTest-1721540905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.819s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:21:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2523a310-bec7-4830-8aa1-1c737a93bd9d tempest-VolumesTransfersTest-1721540905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5710ae9-e6b7-4dfa-be6e-ca41193dee45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62cfe80f-8e7f-4002-80eb-e1da07edffdb', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:21:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2523a310-bec7-4830-8aa1-1c737a93bd9d tempest-VolumesTransfersTest-1721540905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69af789d-3ecd-444e-a6d1-2547931d9a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:21:17 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-2523a310-bec7-4830-8aa1-1c737a93bd9d tempest-VolumesTransfersTest-1721540905 None] Volume volume-62cfe80f-8e7f-4002-80eb-e1da07edffdb (62cfe80f-8e7f-4002-80eb-e1da07edffdb): created successfully Jul 07 08:21:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2523a310-bec7-4830-8aa1-1c737a93bd9d tempest-VolumesTransfersTest-1721540905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69af789d-3ecd-444e-a6d1-2547931d9a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:21:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2523a310-bec7-4830-8aa1-1c737a93bd9d tempest-VolumesTransfersTest-1721540905 None] Flow 'volume_create_manager' (0b898202-f9a2-454a-a296-76d0357bf3ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:21:17 devstack sudo[95410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d Jul 07 08:21:17 devstack sudo[95410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:17 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-2523a310-bec7-4830-8aa1-1c737a93bd9d tempest-VolumesTransfersTest-1721540905 None] Created volume successfully. Jul 07 08:21:17 devstack sudo[95404]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fd7829f6-ffe1-434c-a639-5c1a26edb916 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-63d1a94b-7299-4296-ad89-06f4f1d6fc38.27416941-522f-473e-ac02-3a48c174d4b6" returned: 0 in 0.721s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:18 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fd7829f6-ffe1-434c-a639-5c1a26edb916 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Lock "cinder-quobyte-27416941-522f-473e-ac02-3a48c174d4b6" released by "_delete_snapshot" :: held 3.536s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:21:18 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fd7829f6-ffe1-434c-a639-5c1a26edb916 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Lock "cinder-quobyte-63d1a94b-7299-4296-ad89-06f4f1d6fc38" released by "delete_snapshot" :: held 3.573s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:21:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-359e5055-361c-4796-bfcc-04dbca60be08 tempest-GroupsV314Test-1651555741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:21:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-359e5055-361c-4796-bfcc-04dbca60be08 tempest-GroupsV314Test-1651555741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:21:18 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-359e5055-361c-4796-bfcc-04dbca60be08 tempest-GroupsV314Test-1651555741 None] Cloning volume 35cac7f2-2952-4e01-aba5-e6dfbb696e29 to volume 8062d3de-53ff-49c3-9b81-a5929cd5f96e Jul 07 08:21:18 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-359e5055-361c-4796-bfcc-04dbca60be08 tempest-GroupsV314Test-1651555741 None] Creating offline snapshot 1551c422-1c16-485a-80d3-7e04cf63e961 of volume 35cac7f2-2952-4e01-aba5-e6dfbb696e29 {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:21:18 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-fd7829f6-ffe1-434c-a639-5c1a26edb916 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Created reservations ['8aa6f1f3-f092-41fe-9871-8f24c7ac6c84', '48278fc6-8ccc-4eb9-93a2-f86f79968338', 'cf0e1978-009e-4916-8a98-9963a444eef9', '430a9a52-1b78-48a7-bec2-bd7152cb78a6'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:21:18 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcfd284c-9ede-4613-9a43-429b63504840]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:21:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-359e5055-361c-4796-bfcc-04dbca60be08 tempest-GroupsV314Test-1651555741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:18 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-fd7829f6-ffe1-434c-a639-5c1a26edb916 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Delete snapshot completed successfully. Jul 07 08:21:18 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fd7829f6-ffe1-434c-a639-5c1a26edb916 tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Lock "cinder-27416941-522f-473e-ac02-3a48c174d4b6-delete_snapshot" released by "delete_snapshot" :: held 3.911s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:21:18 devstack sudo[95413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29 Jul 07 08:21:18 devstack sudo[95413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:18 devstack sudo[95410]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d" returned: 0 in 0.893s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d.4ae949ea-7da4-48ff-a77e-f1fd83c74dc7 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:18 devstack sudo[95418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d.4ae949ea-7da4-48ff-a77e-f1fd83c74dc7 Jul 07 08:21:18 devstack sudo[95418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:18 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-af4c0bb1-83cb-483f-9bc9-89086265d45e tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Acquiring lock "cinder-63d1a94b-7299-4296-ad89-06f4f1d6fc38-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:21:18 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-af4c0bb1-83cb-483f-9bc9-89086265d45e tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Lock "cinder-63d1a94b-7299-4296-ad89-06f4f1d6fc38-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:21:18 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-af4c0bb1-83cb-483f-9bc9-89086265d45e tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Acquiring lock "cinder-quobyte-63d1a94b-7299-4296-ad89-06f4f1d6fc38" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:21:18 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-af4c0bb1-83cb-483f-9bc9-89086265d45e tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Lock "cinder-quobyte-63d1a94b-7299-4296-ad89-06f4f1d6fc38" acquired by "delete_volume" :: waited 0.023s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:21:18 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87d6d06-d96f-49c8-bb18-53a8f52feed9]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:21:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-af4c0bb1-83cb-483f-9bc9-89086265d45e tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-63d1a94b-7299-4296-ad89-06f4f1d6fc38 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:19 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-1fe5ae0c-b0c2-4e4a-9c44-5a06bb6ae3fe tempest-VolumesTransfersTest-1093312442 None] Transfer volume completed successfully. Jul 07 08:21:19 devstack sudo[95420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-63d1a94b-7299-4296-ad89-06f4f1d6fc38 Jul 07 08:21:19 devstack sudo[95420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:19 devstack sudo[95413]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-359e5055-361c-4796-bfcc-04dbca60be08 tempest-GroupsV314Test-1651555741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29" returned: 0 in 0.952s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-359e5055-361c-4796-bfcc-04dbca60be08 tempest-GroupsV314Test-1651555741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29.1551c422-1c16-485a-80d3-7e04cf63e961 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:19 devstack sudo[95426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29.1551c422-1c16-485a-80d3-7e04cf63e961 1G Jul 07 08:21:19 devstack sudo[95426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:19 devstack sudo[95418]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d.4ae949ea-7da4-48ff-a77e-f1fd83c74dc7" returned: 0 in 0.893s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d.4ae949ea-7da4-48ff-a77e-f1fd83c74dc7 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:19 devstack sudo[95431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d.4ae949ea-7da4-48ff-a77e-f1fd83c74dc7 Jul 07 08:21:19 devstack sudo[95431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:19 devstack sudo[95420]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-af4c0bb1-83cb-483f-9bc9-89086265d45e tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-63d1a94b-7299-4296-ad89-06f4f1d6fc38" returned: 0 in 0.875s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-af4c0bb1-83cb-483f-9bc9-89086265d45e tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-63d1a94b-7299-4296-ad89-06f4f1d6fc38 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:19 devstack sudo[95439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-63d1a94b-7299-4296-ad89-06f4f1d6fc38 Jul 07 08:21:19 devstack sudo[95439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:20 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3870d87e-f09c-4179-8c69-028b93056ef3 tempest-VolumesTransfersTest-1935448358 None] Acquiring lock "cinder-62cfe80f-8e7f-4002-80eb-e1da07edffdb-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:21:20 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3870d87e-f09c-4179-8c69-028b93056ef3 tempest-VolumesTransfersTest-1935448358 None] Lock "cinder-62cfe80f-8e7f-4002-80eb-e1da07edffdb-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:21:20 devstack sudo[95426]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-359e5055-361c-4796-bfcc-04dbca60be08 tempest-GroupsV314Test-1651555741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29.1551c422-1c16-485a-80d3-7e04cf63e961 1G" returned: 0 in 0.997s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-359e5055-361c-4796-bfcc-04dbca60be08 tempest-GroupsV314Test-1651555741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29.1551c422-1c16-485a-80d3-7e04cf63e961 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:20 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3870d87e-f09c-4179-8c69-028b93056ef3 tempest-VolumesTransfersTest-1935448358 None] Acquiring lock "cinder-quobyte-62cfe80f-8e7f-4002-80eb-e1da07edffdb" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:21:20 devstack sudo[95442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29.1551c422-1c16-485a-80d3-7e04cf63e961 Jul 07 08:21:20 devstack sudo[95442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:20 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3870d87e-f09c-4179-8c69-028b93056ef3 tempest-VolumesTransfersTest-1935448358 None] Lock "cinder-quobyte-62cfe80f-8e7f-4002-80eb-e1da07edffdb" acquired by "delete_volume" :: waited 0.021s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:21:20 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a6e716-d72a-4055-a84e-2cf163514d43]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:21:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3870d87e-f09c-4179-8c69-028b93056ef3 tempest-VolumesTransfersTest-1935448358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-62cfe80f-8e7f-4002-80eb-e1da07edffdb {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:20 devstack sudo[95431]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d.4ae949ea-7da4-48ff-a77e-f1fd83c74dc7" returned: 0 in 0.846s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:20 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] Lock "cinder-quobyte-4ae949ea-7da4-48ff-a77e-f1fd83c74dc7" released by "_delete_snapshot" :: held 3.625s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:21:20 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] Lock "cinder-quobyte-f333c782-57cf-4a54-a396-b88b60fc891d" released by "delete_snapshot" :: held 3.654s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:21:20 devstack sudo[95444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-62cfe80f-8e7f-4002-80eb-e1da07edffdb Jul 07 08:21:20 devstack sudo[95444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:20 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] Created reservations ['f765380a-91a3-4739-9032-952da1861306', '636c64e0-1053-4422-8e3e-88bef78aeca2', '1baccd46-305f-410b-b0dc-bc9ee0b35094', 'f6ab339d-b759-47aa-b012-81e95a525be3'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:21:20 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] Delete snapshot completed successfully. Jul 07 08:21:20 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] Lock "cinder-4ae949ea-7da4-48ff-a77e-f1fd83c74dc7-delete_snapshot" released by "delete_snapshot" :: held 3.847s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:21:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] Snapshots deleted, issuing volume delete {{(pid=87199) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 07 08:21:20 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] Acquiring lock "cinder-quobyte-f333c782-57cf-4a54-a396-b88b60fc891d" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:21:20 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] Lock "cinder-quobyte-f333c782-57cf-4a54-a396-b88b60fc891d" acquired by "delete_volume" :: waited 0.018s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:21:20 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc51013-97c0-4564-b500-16737680fad9]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:21:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:20 devstack sudo[95439]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-af4c0bb1-83cb-483f-9bc9-89086265d45e tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-63d1a94b-7299-4296-ad89-06f4f1d6fc38" returned: 0 in 0.787s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:20 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-af4c0bb1-83cb-483f-9bc9-89086265d45e tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Lock "cinder-quobyte-63d1a94b-7299-4296-ad89-06f4f1d6fc38" released by "delete_volume" :: held 1.751s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:21:20 devstack sudo[95447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d Jul 07 08:21:20 devstack sudo[95447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:20 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-af4c0bb1-83cb-483f-9bc9-89086265d45e tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Created reservations ['f61bf164-7672-4bd8-9d9a-9c39bc1a550a', '8a7b2045-71d1-459d-ac42-de1612d7cf7a', 'bfa2213f-d4a6-4d59-9289-b92f34e7ff08', '2ca1ee8e-19cd-4a07-b991-fe804d7bec93'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:21:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-af4c0bb1-83cb-483f-9bc9-89086265d45e tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:21:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-af4c0bb1-83cb-483f-9bc9-89086265d45e tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:21:20 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-af4c0bb1-83cb-483f-9bc9-89086265d45e tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:21:20 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-af4c0bb1-83cb-483f-9bc9-89086265d45e tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:21:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-af4c0bb1-83cb-483f-9bc9-89086265d45e tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:21:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-af4c0bb1-83cb-483f-9bc9-89086265d45e tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:20 devstack sudo[95450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:21:20 devstack sudo[95450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:21 devstack sudo[95444]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3870d87e-f09c-4179-8c69-028b93056ef3 tempest-VolumesTransfersTest-1935448358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-62cfe80f-8e7f-4002-80eb-e1da07edffdb" returned: 0 in 0.832s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3870d87e-f09c-4179-8c69-028b93056ef3 tempest-VolumesTransfersTest-1935448358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-62cfe80f-8e7f-4002-80eb-e1da07edffdb {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:21 devstack sudo[95442]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-359e5055-361c-4796-bfcc-04dbca60be08 tempest-GroupsV314Test-1651555741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29.1551c422-1c16-485a-80d3-7e04cf63e961" returned: 0 in 0.922s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:21 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-359e5055-361c-4796-bfcc-04dbca60be08 tempest-GroupsV314Test-1651555741 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29.1551c422-1c16-485a-80d3-7e04cf63e961 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 08:21:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-359e5055-361c-4796-bfcc-04dbca60be08 tempest-GroupsV314Test-1651555741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29.1551c422-1c16-485a-80d3-7e04cf63e961 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:21 devstack sudo[95458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-62cfe80f-8e7f-4002-80eb-e1da07edffdb Jul 07 08:21:21 devstack sudo[95458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:21 devstack sudo[95459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29.1551c422-1c16-485a-80d3-7e04cf63e961 Jul 07 08:21:21 devstack sudo[95459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:21 devstack sudo[95450]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-af4c0bb1-83cb-483f-9bc9-89086265d45e tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.911s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:21 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-af4c0bb1-83cb-483f-9bc9-89086265d45e tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:21:21 devstack sudo[95447]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:21 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-af4c0bb1-83cb-483f-9bc9-89086265d45e tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Deleted volume successfully. Jul 07 08:21:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d" returned: 0 in 1.174s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:21 devstack sudo[95466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d Jul 07 08:21:21 devstack sudo[95466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:21 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-af4c0bb1-83cb-483f-9bc9-89086265d45e tempest-VolumesSnapshotNegativeTestJSON-1672830130 None] Lock "cinder-63d1a94b-7299-4296-ad89-06f4f1d6fc38-delete_volume" released by "delete_volume" :: held 2.966s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:21:21 devstack sudo[95458]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3870d87e-f09c-4179-8c69-028b93056ef3 tempest-VolumesTransfersTest-1935448358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-62cfe80f-8e7f-4002-80eb-e1da07edffdb" returned: 0 in 0.897s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:21 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3870d87e-f09c-4179-8c69-028b93056ef3 tempest-VolumesTransfersTest-1935448358 None] Lock "cinder-quobyte-62cfe80f-8e7f-4002-80eb-e1da07edffdb" released by "delete_volume" :: held 1.781s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:21:22 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-3870d87e-f09c-4179-8c69-028b93056ef3 tempest-VolumesTransfersTest-1935448358 None] Created reservations ['8d60fedf-8812-450a-8382-3055d5acaf16', 'f7c017a6-02e5-4af4-b67e-c66fb06e3623', '0c6d6bd2-c724-4c8f-a089-b02884803d86', 'cc691bd8-05c3-4063-a5d5-5605d407fbf6'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:21:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3870d87e-f09c-4179-8c69-028b93056ef3 tempest-VolumesTransfersTest-1935448358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:21:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3870d87e-f09c-4179-8c69-028b93056ef3 tempest-VolumesTransfersTest-1935448358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:21:22 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-3870d87e-f09c-4179-8c69-028b93056ef3 tempest-VolumesTransfersTest-1935448358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:21:22 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-3870d87e-f09c-4179-8c69-028b93056ef3 tempest-VolumesTransfersTest-1935448358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:21:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3870d87e-f09c-4179-8c69-028b93056ef3 tempest-VolumesTransfersTest-1935448358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:21:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3870d87e-f09c-4179-8c69-028b93056ef3 tempest-VolumesTransfersTest-1935448358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:22 devstack sudo[95459]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-359e5055-361c-4796-bfcc-04dbca60be08 tempest-GroupsV314Test-1651555741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29.1551c422-1c16-485a-80d3-7e04cf63e961" returned: 0 in 1.138s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:22 devstack sudo[95471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:21:22 devstack sudo[95471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-359e5055-361c-4796-bfcc-04dbca60be08 tempest-GroupsV314Test-1651555741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:22 devstack sudo[95473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29.info Jul 07 08:21:22 devstack sudo[95473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:22 devstack sudo[95466]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f333c782-57cf-4a54-a396-b88b60fc891d" returned: 0 in 1.002s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:22 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] Lock "cinder-quobyte-f333c782-57cf-4a54-a396-b88b60fc891d" released by "delete_volume" :: held 2.252s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:21:22 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] Created reservations ['c48aa007-c33d-4f60-afe2-1e6900a4f743', 'c22fa2a2-f681-482d-a54e-b7e02f07c850', 'b3c3fc2f-88e6-4a70-b332-2b143ed211b8', '48be8643-677a-4c93-b166-84ddf629770e'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:21:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:21:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:21:22 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:21:22 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:21:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:21:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:22 devstack sudo[95476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:21:22 devstack sudo[95476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:23 devstack sudo[95471]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3870d87e-f09c-4179-8c69-028b93056ef3 tempest-VolumesTransfersTest-1935448358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 1.099s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:23 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-3870d87e-f09c-4179-8c69-028b93056ef3 tempest-VolumesTransfersTest-1935448358 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:21:23 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-3870d87e-f09c-4179-8c69-028b93056ef3 tempest-VolumesTransfersTest-1935448358 None] Deleted volume successfully. Jul 07 08:21:23 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3870d87e-f09c-4179-8c69-028b93056ef3 tempest-VolumesTransfersTest-1935448358 None] Lock "cinder-62cfe80f-8e7f-4002-80eb-e1da07edffdb-delete_volume" released by "delete_volume" :: held 3.221s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:21:23 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-08b08440-2818-40e9-a5e0-28bb34c4b11c tempest-VolumesTransfersTest-1721540905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:21:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-08b08440-2818-40e9-a5e0-28bb34c4b11c tempest-VolumesTransfersTest-1721540905 None] Flow 'volume_create_manager' (662b1154-1674-46d0-a42f-771dc8fa26d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:21:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-08b08440-2818-40e9-a5e0-28bb34c4b11c tempest-VolumesTransfersTest-1721540905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e05ca3b3-2ffc-40bc-9862-9d881865affe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:21:23 devstack sudo[95473]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-08b08440-2818-40e9-a5e0-28bb34c4b11c tempest-VolumesTransfersTest-1721540905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e05ca3b3-2ffc-40bc-9862-9d881865affe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:21:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-310974277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5b5299f-cb5e-44e2-bfce-7b7c6114563d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a92535059bb944aa87faa1f8534e0647',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:21:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:21:23Z,use_quota=True,user_id='2b62dc929a0c4381b56ffb54b7cd84e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:21:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-08b08440-2818-40e9-a5e0-28bb34c4b11c tempest-VolumesTransfersTest-1721540905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20d97622-5b0c-4974-981e-02b97b548733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:21:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-08b08440-2818-40e9-a5e0-28bb34c4b11c tempest-VolumesTransfersTest-1721540905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20d97622-5b0c-4974-981e-02b97b548733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:21:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-08b08440-2818-40e9-a5e0-28bb34c4b11c tempest-VolumesTransfersTest-1721540905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d1697d2-9cad-46a0-9be5-68a272ebf0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:21:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-08b08440-2818-40e9-a5e0-28bb34c4b11c tempest-VolumesTransfersTest-1721540905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d1697d2-9cad-46a0-9be5-68a272ebf0a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5b5299f-cb5e-44e2-bfce-7b7c6114563d', 'volume_name': 'volume-a5b5299f-cb5e-44e2-bfce-7b7c6114563d', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:21:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-08b08440-2818-40e9-a5e0-28bb34c4b11c tempest-VolumesTransfersTest-1721540905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0ab0a44-09f7-4d23-b3ed-c7aa72c814ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:21:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-08b08440-2818-40e9-a5e0-28bb34c4b11c tempest-VolumesTransfersTest-1721540905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0ab0a44-09f7-4d23-b3ed-c7aa72c814ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:21:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-08b08440-2818-40e9-a5e0-28bb34c4b11c tempest-VolumesTransfersTest-1721540905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2df391b-7fca-47ef-a51e-33ca24d5179b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:21:23 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-08b08440-2818-40e9-a5e0-28bb34c4b11c tempest-VolumesTransfersTest-1721540905 None] Volume a5b5299f-cb5e-44e2-bfce-7b7c6114563d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5b5299f-cb5e-44e2-bfce-7b7c6114563d', 'volume_size': 1} Jul 07 08:21:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-08b08440-2818-40e9-a5e0-28bb34c4b11c tempest-VolumesTransfersTest-1721540905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:21:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-359e5055-361c-4796-bfcc-04dbca60be08 tempest-GroupsV314Test-1651555741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29.info" returned: 0 in 1.173s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:23 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-359e5055-361c-4796-bfcc-04dbca60be08 tempest-GroupsV314Test-1651555741 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 08:21:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-359e5055-361c-4796-bfcc-04dbca60be08 tempest-GroupsV314Test-1651555741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:23 devstack sudo[95480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29.info Jul 07 08:21:23 devstack sudo[95480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:23 devstack sudo[95476]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.890s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:23 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:21:23 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] Deleted volume successfully. Jul 07 08:21:23 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a7dbf140-9bd1-4dd9-add8-aca372c617c9 tempest-VolumesDeleteCascade-1233200636 None] Lock "cinder-f333c782-57cf-4a54-a396-b88b60fc891d-delete_volume" released by "delete_volume" :: held 14.515s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:21:24 devstack sudo[95480]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-359e5055-361c-4796-bfcc-04dbca60be08 tempest-GroupsV314Test-1651555741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29.info" returned: 0 in 0.788s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-359e5055-361c-4796-bfcc-04dbca60be08 tempest-GroupsV314Test-1651555741 None] Acquiring lock "cinder-quobyte-8062d3de-53ff-49c3-9b81-a5929cd5f96e" by "_copy_volume_from_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:21:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-359e5055-361c-4796-bfcc-04dbca60be08 tempest-GroupsV314Test-1651555741 None] Lock "cinder-quobyte-8062d3de-53ff-49c3-9b81-a5929cd5f96e" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:21:24 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-359e5055-361c-4796-bfcc-04dbca60be08 tempest-GroupsV314Test-1651555741 None] snapshot: 1551c422-1c16-485a-80d3-7e04cf63e961, volume: 8062d3de-53ff-49c3-9b81-a5929cd5f96e, {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 08:21:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-359e5055-361c-4796-bfcc-04dbca60be08 tempest-GroupsV314Test-1651555741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:21:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-359e5055-361c-4796-bfcc-04dbca60be08 tempest-GroupsV314Test-1651555741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:21:24 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-359e5055-361c-4796-bfcc-04dbca60be08 tempest-GroupsV314Test-1651555741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:21:24 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-359e5055-361c-4796-bfcc-04dbca60be08 tempest-GroupsV314Test-1651555741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:21:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-359e5055-361c-4796-bfcc-04dbca60be08 tempest-GroupsV314Test-1651555741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:21:24 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ceecd6-5fba-416b-98cc-17e269241556]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:21:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-359e5055-361c-4796-bfcc-04dbca60be08 tempest-GroupsV314Test-1651555741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29.1551c422-1c16-485a-80d3-7e04cf63e961 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:24 devstack sudo[95484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29.1551c422-1c16-485a-80d3-7e04cf63e961 Jul 07 08:21:24 devstack sudo[95484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:24 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-57883fdb-0c67-43fe-a778-0fbf8df37219 tempest-VolumesDeleteCascade-1233200636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:21:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-57883fdb-0c67-43fe-a778-0fbf8df37219 tempest-VolumesDeleteCascade-1233200636 None] Flow 'volume_create_manager' (1e819496-2a62-4dd9-a3b6-1a55789dcaeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:21:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-57883fdb-0c67-43fe-a778-0fbf8df37219 tempest-VolumesDeleteCascade-1233200636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a59680a-e17b-49ef-976b-b642a50bf612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:21:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-57883fdb-0c67-43fe-a778-0fbf8df37219 tempest-VolumesDeleteCascade-1233200636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a59680a-e17b-49ef-976b-b642a50bf612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-69448701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aff63b9-6e07-4d1e-a855-4234d0cf1e9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97188b0d72f54c39b53585699c758934',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:21:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:21:24Z,use_quota=True,user_id='f333b41c84eb421388e3b21cdc55b91d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:21:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-57883fdb-0c67-43fe-a778-0fbf8df37219 tempest-VolumesDeleteCascade-1233200636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (318f32f1-fdca-40be-8ad0-a81ecaadd5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:21:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-57883fdb-0c67-43fe-a778-0fbf8df37219 tempest-VolumesDeleteCascade-1233200636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (318f32f1-fdca-40be-8ad0-a81ecaadd5bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:21:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-57883fdb-0c67-43fe-a778-0fbf8df37219 tempest-VolumesDeleteCascade-1233200636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2d8639d-9af0-434b-bb3a-0251478e15a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:21:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-57883fdb-0c67-43fe-a778-0fbf8df37219 tempest-VolumesDeleteCascade-1233200636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2d8639d-9af0-434b-bb3a-0251478e15a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1aff63b9-6e07-4d1e-a855-4234d0cf1e9c', 'volume_name': 'volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:21:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-57883fdb-0c67-43fe-a778-0fbf8df37219 tempest-VolumesDeleteCascade-1233200636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6beb3158-7491-43a4-8353-c865874e1fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:21:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-57883fdb-0c67-43fe-a778-0fbf8df37219 tempest-VolumesDeleteCascade-1233200636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6beb3158-7491-43a4-8353-c865874e1fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:21:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-57883fdb-0c67-43fe-a778-0fbf8df37219 tempest-VolumesDeleteCascade-1233200636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b36379b-4b3d-4dd8-98c9-d3837cfe627f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:21:24 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-57883fdb-0c67-43fe-a778-0fbf8df37219 tempest-VolumesDeleteCascade-1233200636 None] Volume 1aff63b9-6e07-4d1e-a855-4234d0cf1e9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c', 'volume_size': 1} Jul 07 08:21:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-57883fdb-0c67-43fe-a778-0fbf8df37219 tempest-VolumesDeleteCascade-1233200636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:21:25 devstack sudo[95484]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-359e5055-361c-4796-bfcc-04dbca60be08 tempest-GroupsV314Test-1651555741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29.1551c422-1c16-485a-80d3-7e04cf63e961" returned: 0 in 0.842s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:25 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-359e5055-361c-4796-bfcc-04dbca60be08 tempest-GroupsV314Test-1651555741 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:21:25 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-359e5055-361c-4796-bfcc-04dbca60be08 tempest-GroupsV314Test-1651555741 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29 {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 08:21:25 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-359e5055-361c-4796-bfcc-04dbca60be08 tempest-GroupsV314Test-1651555741 None] Creating direct copy from snapshot {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 08:21:25 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a520bb-b89a-4edf-a883-3f836de39262]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:21:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-359e5055-361c-4796-bfcc-04dbca60be08 tempest-GroupsV314Test-1651555741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:25 devstack sudo[95489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29 Jul 07 08:21:25 devstack sudo[95489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:26 devstack sudo[95489]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-359e5055-361c-4796-bfcc-04dbca60be08 tempest-GroupsV314Test-1651555741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29" returned: 0 in 0.873s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:26 devstack cinder-volume[87199]: DEBUG cinder.utils [None req-359e5055-361c-4796-bfcc-04dbca60be08 tempest-GroupsV314Test-1651555741 None] Path /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8062d3de-53ff-49c3-9b81-a5929cd5f96e not found in is_blk_device check {{(pid=87199) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 08:21:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-359e5055-361c-4796-bfcc-04dbca60be08 tempest-GroupsV314Test-1651555741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8062d3de-53ff-49c3-9b81-a5929cd5f96e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:26 devstack sudo[95494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8062d3de-53ff-49c3-9b81-a5929cd5f96e Jul 07 08:21:26 devstack sudo[95494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:31 devstack sudo[95494]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-359e5055-361c-4796-bfcc-04dbca60be08 tempest-GroupsV314Test-1651555741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8062d3de-53ff-49c3-9b81-a5929cd5f96e" returned: 0 in 5.553s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:31 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6bf80f-ae97-4750-a88f-572516775da7]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:21:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-359e5055-361c-4796-bfcc-04dbca60be08 tempest-GroupsV314Test-1651555741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:31 devstack sudo[95544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29 Jul 07 08:21:31 devstack sudo[95544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:32 devstack sudo[95544]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-359e5055-361c-4796-bfcc-04dbca60be08 tempest-GroupsV314Test-1651555741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29" returned: 0 in 1.008s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:32 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-359e5055-361c-4796-bfcc-04dbca60be08 tempest-GroupsV314Test-1651555741 None] Image conversion details: src /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29, size 1024.00 MB, duration 5.55 sec, destination /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8062d3de-53ff-49c3-9b81-a5929cd5f96e {{(pid=87199) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 08:21:32 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-359e5055-361c-4796-bfcc-04dbca60be08 tempest-GroupsV314Test-1651555741 None] Converted 1024.00 MB image at 184.34 MB/s Jul 07 08:21:32 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-359e5055-361c-4796-bfcc-04dbca60be08 tempest-GroupsV314Test-1651555741 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8062d3de-53ff-49c3-9b81-a5929cd5f96e is being set with open permissions: ugo+rw: NotImplementedError Jul 07 08:21:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-359e5055-361c-4796-bfcc-04dbca60be08 tempest-GroupsV314Test-1651555741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8062d3de-53ff-49c3-9b81-a5929cd5f96e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:32 devstack sudo[95549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8062d3de-53ff-49c3-9b81-a5929cd5f96e Jul 07 08:21:32 devstack sudo[95549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:33 devstack sudo[95549]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-359e5055-361c-4796-bfcc-04dbca60be08 tempest-GroupsV314Test-1651555741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8062d3de-53ff-49c3-9b81-a5929cd5f96e" returned: 0 in 0.777s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:33 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-359e5055-361c-4796-bfcc-04dbca60be08 tempest-GroupsV314Test-1651555741 None] Lock "cinder-quobyte-8062d3de-53ff-49c3-9b81-a5929cd5f96e" released by "_copy_volume_from_snapshot" :: held 9.155s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:21:33 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-359e5055-361c-4796-bfcc-04dbca60be08 tempest-GroupsV314Test-1651555741 None] Acquiring lock "cinder-quobyte-1551c422-1c16-485a-80d3-7e04cf63e961" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:21:33 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-359e5055-361c-4796-bfcc-04dbca60be08 tempest-GroupsV314Test-1651555741 None] Lock "cinder-quobyte-1551c422-1c16-485a-80d3-7e04cf63e961" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:21:33 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-359e5055-361c-4796-bfcc-04dbca60be08 tempest-GroupsV314Test-1651555741 None] Deleting offline snapshot 1551c422-1c16-485a-80d3-7e04cf63e961 of volume 35cac7f2-2952-4e01-aba5-e6dfbb696e29 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:21:33 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-359e5055-361c-4796-bfcc-04dbca60be08 tempest-GroupsV314Test-1651555741 None] snapshot_file for this snap is: volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29.1551c422-1c16-485a-80d3-7e04cf63e961 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:21:33 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[96082be7-03e3-4075-b29c-87320c311358]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:21:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-359e5055-361c-4796-bfcc-04dbca60be08 tempest-GroupsV314Test-1651555741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29.1551c422-1c16-485a-80d3-7e04cf63e961 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:33 devstack sudo[95552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29.1551c422-1c16-485a-80d3-7e04cf63e961 Jul 07 08:21:33 devstack sudo[95552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:34 devstack sudo[95552]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-359e5055-361c-4796-bfcc-04dbca60be08 tempest-GroupsV314Test-1651555741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29.1551c422-1c16-485a-80d3-7e04cf63e961" returned: 0 in 0.937s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:34 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-359e5055-361c-4796-bfcc-04dbca60be08 tempest-GroupsV314Test-1651555741 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:21:34 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc1b3d9-9b9d-4ccf-b9d0-ede560cba7d4]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:21:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-359e5055-361c-4796-bfcc-04dbca60be08 tempest-GroupsV314Test-1651555741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:34 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=46,cinder:INSERT=12,cinder:UPDATE=45,cinder:DELETE=4 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:21:34 devstack sudo[95557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29 Jul 07 08:21:34 devstack sudo[95557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:35 devstack sudo[95557]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-359e5055-361c-4796-bfcc-04dbca60be08 tempest-GroupsV314Test-1651555741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29" returned: 0 in 0.838s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-359e5055-361c-4796-bfcc-04dbca60be08 tempest-GroupsV314Test-1651555741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29.1551c422-1c16-485a-80d3-7e04cf63e961 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:35 devstack sudo[95562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29.1551c422-1c16-485a-80d3-7e04cf63e961 Jul 07 08:21:35 devstack sudo[95562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:36 devstack sudo[95562]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-359e5055-361c-4796-bfcc-04dbca60be08 tempest-GroupsV314Test-1651555741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29.1551c422-1c16-485a-80d3-7e04cf63e961" returned: 0 in 0.731s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-359e5055-361c-4796-bfcc-04dbca60be08 tempest-GroupsV314Test-1651555741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29.1551c422-1c16-485a-80d3-7e04cf63e961 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:36 devstack sudo[95568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29.1551c422-1c16-485a-80d3-7e04cf63e961 Jul 07 08:21:36 devstack sudo[95568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:36 devstack sudo[95568]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-359e5055-361c-4796-bfcc-04dbca60be08 tempest-GroupsV314Test-1651555741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29.1551c422-1c16-485a-80d3-7e04cf63e961" returned: 0 in 0.710s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:36 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-359e5055-361c-4796-bfcc-04dbca60be08 tempest-GroupsV314Test-1651555741 None] Lock "cinder-quobyte-1551c422-1c16-485a-80d3-7e04cf63e961" released by "_delete_snapshot" :: held 3.332s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:21:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-359e5055-361c-4796-bfcc-04dbca60be08 tempest-GroupsV314Test-1651555741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.735s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:21:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-08b08440-2818-40e9-a5e0-28bb34c4b11c tempest-VolumesTransfersTest-1721540905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.392s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:21:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-08b08440-2818-40e9-a5e0-28bb34c4b11c tempest-VolumesTransfersTest-1721540905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:21:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-310974277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5b5299f-cb5e-44e2-bfce-7b7c6114563d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a92535059bb944aa87faa1f8534e0647',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:21:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:21:23Z,use_quota=True,user_id='2b62dc929a0c4381b56ffb54b7cd84e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:21:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-08b08440-2818-40e9-a5e0-28bb34c4b11c tempest-VolumesTransfersTest-1721540905 None] Creating volume a5b5299f-cb5e-44e2-bfce-7b7c6114563d {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:21:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-08b08440-2818-40e9-a5e0-28bb34c4b11c tempest-VolumesTransfersTest-1721540905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:21:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-08b08440-2818-40e9-a5e0-28bb34c4b11c tempest-VolumesTransfersTest-1721540905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:21:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-08b08440-2818-40e9-a5e0-28bb34c4b11c tempest-VolumesTransfersTest-1721540905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:21:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-08b08440-2818-40e9-a5e0-28bb34c4b11c tempest-VolumesTransfersTest-1721540905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:21:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-08b08440-2818-40e9-a5e0-28bb34c4b11c tempest-VolumesTransfersTest-1721540905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:21:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-08b08440-2818-40e9-a5e0-28bb34c4b11c tempest-VolumesTransfersTest-1721540905 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:21:36 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-08b08440-2818-40e9-a5e0-28bb34c4b11c tempest-VolumesTransfersTest-1721540905 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:21:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-08b08440-2818-40e9-a5e0-28bb34c4b11c tempest-VolumesTransfersTest-1721540905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-a5b5299f-cb5e-44e2-bfce-7b7c6114563d 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:36 devstack sudo[95571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-a5b5299f-cb5e-44e2-bfce-7b7c6114563d 1073741824 Jul 07 08:21:36 devstack sudo[95571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:36 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-359e5055-361c-4796-bfcc-04dbca60be08 tempest-GroupsV314Test-1651555741 None] Create group from source-group-70f3e932-a113-4725-a23c-e6f85544255f completed successfully. Jul 07 08:21:37 devstack sudo[95571]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-08b08440-2818-40e9-a5e0-28bb34c4b11c tempest-VolumesTransfersTest-1721540905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-a5b5299f-cb5e-44e2-bfce-7b7c6114563d 1073741824" returned: 0 in 0.900s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-08b08440-2818-40e9-a5e0-28bb34c4b11c tempest-VolumesTransfersTest-1721540905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-a5b5299f-cb5e-44e2-bfce-7b7c6114563d {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:37 devstack sudo[95577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-a5b5299f-cb5e-44e2-bfce-7b7c6114563d Jul 07 08:21:37 devstack sudo[95577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:38 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d348292c-7e89-4dfb-b5ce-90daeac1976e tempest-GroupsV314Test-1651555741 None] Acquiring lock "cinder-quobyte-8062d3de-53ff-49c3-9b81-a5929cd5f96e" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:21:38 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d348292c-7e89-4dfb-b5ce-90daeac1976e tempest-GroupsV314Test-1651555741 None] Lock "cinder-quobyte-8062d3de-53ff-49c3-9b81-a5929cd5f96e" acquired by "delete_volume" :: waited 0.019s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:21:38 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b4a2d2-ab8d-49b7-87dc-aaffda6bf88a]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:21:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d348292c-7e89-4dfb-b5ce-90daeac1976e tempest-GroupsV314Test-1651555741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8062d3de-53ff-49c3-9b81-a5929cd5f96e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:38 devstack sudo[95579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8062d3de-53ff-49c3-9b81-a5929cd5f96e Jul 07 08:21:38 devstack sudo[95579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:38 devstack sudo[95577]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-08b08440-2818-40e9-a5e0-28bb34c4b11c tempest-VolumesTransfersTest-1721540905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-a5b5299f-cb5e-44e2-bfce-7b7c6114563d" returned: 0 in 0.800s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:38 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-08b08440-2818-40e9-a5e0-28bb34c4b11c tempest-VolumesTransfersTest-1721540905 None] <== create_volume: return (1745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:21:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-08b08440-2818-40e9-a5e0-28bb34c4b11c tempest-VolumesTransfersTest-1721540905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.748s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:21:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-57883fdb-0c67-43fe-a778-0fbf8df37219 tempest-VolumesDeleteCascade-1233200636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.964s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:21:38 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-57883fdb-0c67-43fe-a778-0fbf8df37219 tempest-VolumesDeleteCascade-1233200636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-69448701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aff63b9-6e07-4d1e-a855-4234d0cf1e9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97188b0d72f54c39b53585699c758934',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:21:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:21:24Z,use_quota=True,user_id='f333b41c84eb421388e3b21cdc55b91d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:21:38 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-57883fdb-0c67-43fe-a778-0fbf8df37219 tempest-VolumesDeleteCascade-1233200636 None] Creating volume 1aff63b9-6e07-4d1e-a855-4234d0cf1e9c {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:21:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-57883fdb-0c67-43fe-a778-0fbf8df37219 tempest-VolumesDeleteCascade-1233200636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:21:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-57883fdb-0c67-43fe-a778-0fbf8df37219 tempest-VolumesDeleteCascade-1233200636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:21:38 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-57883fdb-0c67-43fe-a778-0fbf8df37219 tempest-VolumesDeleteCascade-1233200636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:21:38 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-57883fdb-0c67-43fe-a778-0fbf8df37219 tempest-VolumesDeleteCascade-1233200636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:21:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-57883fdb-0c67-43fe-a778-0fbf8df37219 tempest-VolumesDeleteCascade-1233200636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:21:38 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-57883fdb-0c67-43fe-a778-0fbf8df37219 tempest-VolumesDeleteCascade-1233200636 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:21:38 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-57883fdb-0c67-43fe-a778-0fbf8df37219 tempest-VolumesDeleteCascade-1233200636 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:21:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-57883fdb-0c67-43fe-a778-0fbf8df37219 tempest-VolumesDeleteCascade-1233200636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:38 devstack sudo[95582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c 1073741824 Jul 07 08:21:38 devstack sudo[95582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-08b08440-2818-40e9-a5e0-28bb34c4b11c tempest-VolumesTransfersTest-1721540905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2df391b-7fca-47ef-a51e-33ca24d5179b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5b5299f-cb5e-44e2-bfce-7b7c6114563d', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:21:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-08b08440-2818-40e9-a5e0-28bb34c4b11c tempest-VolumesTransfersTest-1721540905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7dcba24-cee1-4001-8d81-026533e893fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:21:38 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-08b08440-2818-40e9-a5e0-28bb34c4b11c tempest-VolumesTransfersTest-1721540905 None] Volume volume-a5b5299f-cb5e-44e2-bfce-7b7c6114563d (a5b5299f-cb5e-44e2-bfce-7b7c6114563d): created successfully Jul 07 08:21:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-08b08440-2818-40e9-a5e0-28bb34c4b11c tempest-VolumesTransfersTest-1721540905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7dcba24-cee1-4001-8d81-026533e893fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:21:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-08b08440-2818-40e9-a5e0-28bb34c4b11c tempest-VolumesTransfersTest-1721540905 None] Flow 'volume_create_manager' (662b1154-1674-46d0-a42f-771dc8fa26d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:21:38 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-08b08440-2818-40e9-a5e0-28bb34c4b11c tempest-VolumesTransfersTest-1721540905 None] Created volume successfully. Jul 07 08:21:38 devstack sudo[95579]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d348292c-7e89-4dfb-b5ce-90daeac1976e tempest-GroupsV314Test-1651555741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8062d3de-53ff-49c3-9b81-a5929cd5f96e" returned: 0 in 0.877s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d348292c-7e89-4dfb-b5ce-90daeac1976e tempest-GroupsV314Test-1651555741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8062d3de-53ff-49c3-9b81-a5929cd5f96e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:38 devstack sudo[95588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8062d3de-53ff-49c3-9b81-a5929cd5f96e Jul 07 08:21:38 devstack sudo[95588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:39 devstack sudo[95582]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-57883fdb-0c67-43fe-a778-0fbf8df37219 tempest-VolumesDeleteCascade-1233200636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c 1073741824" returned: 0 in 0.935s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-57883fdb-0c67-43fe-a778-0fbf8df37219 tempest-VolumesDeleteCascade-1233200636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:39 devstack sudo[95595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c Jul 07 08:21:39 devstack sudo[95595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:39 devstack sudo[95588]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d348292c-7e89-4dfb-b5ce-90daeac1976e tempest-GroupsV314Test-1651555741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8062d3de-53ff-49c3-9b81-a5929cd5f96e" returned: 0 in 0.688s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:39 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d348292c-7e89-4dfb-b5ce-90daeac1976e tempest-GroupsV314Test-1651555741 None] Lock "cinder-quobyte-8062d3de-53ff-49c3-9b81-a5929cd5f96e" released by "delete_volume" :: held 1.630s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:21:39 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-d348292c-7e89-4dfb-b5ce-90daeac1976e tempest-GroupsV314Test-1651555741 None] Created reservations ['d149f88e-59bc-4dd0-8903-998e134bb340'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:21:39 devstack cinder-volume[87199]: WARNING cinder.quota [None req-d348292c-7e89-4dfb-b5ce-90daeac1976e tempest-GroupsV314Test-1651555741 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-942928131 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-942928131, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:21:39 devstack cinder-volume[87199]: WARNING cinder.quota [None req-d348292c-7e89-4dfb-b5ce-90daeac1976e tempest-GroupsV314Test-1651555741 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-942928131 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-942928131, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:21:39 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-d348292c-7e89-4dfb-b5ce-90daeac1976e tempest-GroupsV314Test-1651555741 None] Created reservations ['0726e940-3df8-4ebc-b884-a128b9db3bba', '241b82f1-44db-452e-bed7-e05b2272c0b5', '903f499b-0181-4830-a106-596aece392f8', '992aa219-97f1-4b17-ba3a-5ce948c88760'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:21:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d348292c-7e89-4dfb-b5ce-90daeac1976e tempest-GroupsV314Test-1651555741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:21:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d348292c-7e89-4dfb-b5ce-90daeac1976e tempest-GroupsV314Test-1651555741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:21:40 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d348292c-7e89-4dfb-b5ce-90daeac1976e tempest-GroupsV314Test-1651555741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:21:40 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d348292c-7e89-4dfb-b5ce-90daeac1976e tempest-GroupsV314Test-1651555741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:21:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d348292c-7e89-4dfb-b5ce-90daeac1976e tempest-GroupsV314Test-1651555741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:21:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d348292c-7e89-4dfb-b5ce-90daeac1976e tempest-GroupsV314Test-1651555741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:40 devstack sudo[95597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:21:40 devstack sudo[95597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a6c70edb-8d02-4595-9340-c68f20a7a95d tempest-VolumesTransfersTest-1935448358 None] Acquiring lock "cinder-a5b5299f-cb5e-44e2-bfce-7b7c6114563d-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:21:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a6c70edb-8d02-4595-9340-c68f20a7a95d tempest-VolumesTransfersTest-1935448358 None] Lock "cinder-a5b5299f-cb5e-44e2-bfce-7b7c6114563d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:21:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a6c70edb-8d02-4595-9340-c68f20a7a95d tempest-VolumesTransfersTest-1935448358 None] Acquiring lock "cinder-quobyte-a5b5299f-cb5e-44e2-bfce-7b7c6114563d" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:21:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a6c70edb-8d02-4595-9340-c68f20a7a95d tempest-VolumesTransfersTest-1935448358 None] Lock "cinder-quobyte-a5b5299f-cb5e-44e2-bfce-7b7c6114563d" acquired by "delete_volume" :: waited 0.026s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:21:40 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a26728-35d5-4127-aff4-fea9c0687133]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:21:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a6c70edb-8d02-4595-9340-c68f20a7a95d tempest-VolumesTransfersTest-1935448358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-a5b5299f-cb5e-44e2-bfce-7b7c6114563d {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:40 devstack sudo[95599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-a5b5299f-cb5e-44e2-bfce-7b7c6114563d Jul 07 08:21:40 devstack sudo[95599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:40 devstack sudo[95595]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-57883fdb-0c67-43fe-a778-0fbf8df37219 tempest-VolumesDeleteCascade-1233200636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c" returned: 0 in 0.956s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:40 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-57883fdb-0c67-43fe-a778-0fbf8df37219 tempest-VolumesDeleteCascade-1233200636 None] <== create_volume: return (1952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:21:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-57883fdb-0c67-43fe-a778-0fbf8df37219 tempest-VolumesDeleteCascade-1233200636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.956s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:21:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-57883fdb-0c67-43fe-a778-0fbf8df37219 tempest-VolumesDeleteCascade-1233200636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b36379b-4b3d-4dd8-98c9-d3837cfe627f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:21:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-57883fdb-0c67-43fe-a778-0fbf8df37219 tempest-VolumesDeleteCascade-1233200636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (731940f3-6b0e-463a-bd20-c49471058847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:21:40 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-57883fdb-0c67-43fe-a778-0fbf8df37219 tempest-VolumesDeleteCascade-1233200636 None] Volume volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c (1aff63b9-6e07-4d1e-a855-4234d0cf1e9c): created successfully Jul 07 08:21:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-57883fdb-0c67-43fe-a778-0fbf8df37219 tempest-VolumesDeleteCascade-1233200636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (731940f3-6b0e-463a-bd20-c49471058847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:21:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-57883fdb-0c67-43fe-a778-0fbf8df37219 tempest-VolumesDeleteCascade-1233200636 None] Flow 'volume_create_manager' (1e819496-2a62-4dd9-a3b6-1a55789dcaeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:21:40 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-57883fdb-0c67-43fe-a778-0fbf8df37219 tempest-VolumesDeleteCascade-1233200636 None] Created volume successfully. Jul 07 08:21:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a8eefc63-05ec-48b9-b3c9-2628ad52a9f5 tempest-GroupsV314Test-1651555741 None] Acquiring lock "cinder-quobyte-35cac7f2-2952-4e01-aba5-e6dfbb696e29" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:21:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a8eefc63-05ec-48b9-b3c9-2628ad52a9f5 tempest-GroupsV314Test-1651555741 None] Lock "cinder-quobyte-35cac7f2-2952-4e01-aba5-e6dfbb696e29" acquired by "delete_volume" :: waited 0.030s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:21:40 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ad3953-c01b-4c29-a1d6-5b7d6af4f1d5]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:21:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a8eefc63-05ec-48b9-b3c9-2628ad52a9f5 tempest-GroupsV314Test-1651555741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:40 devstack sudo[95597]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d348292c-7e89-4dfb-b5ce-90daeac1976e tempest-GroupsV314Test-1651555741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.885s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:40 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-d348292c-7e89-4dfb-b5ce-90daeac1976e tempest-GroupsV314Test-1651555741 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:21:40 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-d348292c-7e89-4dfb-b5ce-90daeac1976e tempest-GroupsV314Test-1651555741 None] Delete group completed successfully. Jul 07 08:21:41 devstack sudo[95604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29 Jul 07 08:21:41 devstack sudo[95604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:41 devstack sudo[95599]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a6c70edb-8d02-4595-9340-c68f20a7a95d tempest-VolumesTransfersTest-1935448358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-a5b5299f-cb5e-44e2-bfce-7b7c6114563d" returned: 0 in 0.962s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a6c70edb-8d02-4595-9340-c68f20a7a95d tempest-VolumesTransfersTest-1935448358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-a5b5299f-cb5e-44e2-bfce-7b7c6114563d {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:41 devstack sudo[95609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-a5b5299f-cb5e-44e2-bfce-7b7c6114563d Jul 07 08:21:41 devstack sudo[95609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4d440292-aa2f-43c2-bd42-27655500889e tempest-VolumesDeleteCascade-1233200636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:21:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4d440292-aa2f-43c2-bd42-27655500889e tempest-VolumesDeleteCascade-1233200636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:21:41 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-4d440292-aa2f-43c2-bd42-27655500889e tempest-VolumesDeleteCascade-1233200636 None] Creating offline snapshot 294f124d-743d-4132-b735-67dc39773d06 of volume 1aff63b9-6e07-4d1e-a855-4234d0cf1e9c {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:21:41 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2011d3-c8dc-4f69-a42c-b7222e8e78c2]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:21:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4d440292-aa2f-43c2-bd42-27655500889e tempest-VolumesDeleteCascade-1233200636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:41 devstack sudo[95611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c Jul 07 08:21:41 devstack sudo[95611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:41 devstack sudo[95604]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a8eefc63-05ec-48b9-b3c9-2628ad52a9f5 tempest-GroupsV314Test-1651555741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29" returned: 0 in 1.115s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a8eefc63-05ec-48b9-b3c9-2628ad52a9f5 tempest-GroupsV314Test-1651555741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:41 devstack sudo[95618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29 Jul 07 08:21:41 devstack sudo[95618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:42 devstack sudo[95609]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a6c70edb-8d02-4595-9340-c68f20a7a95d tempest-VolumesTransfersTest-1935448358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-a5b5299f-cb5e-44e2-bfce-7b7c6114563d" returned: 0 in 0.773s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:42 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a6c70edb-8d02-4595-9340-c68f20a7a95d tempest-VolumesTransfersTest-1935448358 None] Lock "cinder-quobyte-a5b5299f-cb5e-44e2-bfce-7b7c6114563d" released by "delete_volume" :: held 1.811s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:21:42 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-a6c70edb-8d02-4595-9340-c68f20a7a95d tempest-VolumesTransfersTest-1935448358 None] Created reservations ['e9f6069d-766d-47cf-b509-d16e3af540cd', '3bfd5c10-1072-441d-93a8-0ffc5c5de47c', '6f76b475-58fa-4193-ac21-843f58ba66a7', '28c3d557-dbb8-4856-b462-2b0b759a3bb0'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:21:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a6c70edb-8d02-4595-9340-c68f20a7a95d tempest-VolumesTransfersTest-1935448358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:21:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a6c70edb-8d02-4595-9340-c68f20a7a95d tempest-VolumesTransfersTest-1935448358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:21:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a6c70edb-8d02-4595-9340-c68f20a7a95d tempest-VolumesTransfersTest-1935448358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:21:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a6c70edb-8d02-4595-9340-c68f20a7a95d tempest-VolumesTransfersTest-1935448358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:21:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a6c70edb-8d02-4595-9340-c68f20a7a95d tempest-VolumesTransfersTest-1935448358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:21:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a6c70edb-8d02-4595-9340-c68f20a7a95d tempest-VolumesTransfersTest-1935448358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:42 devstack sudo[95620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:21:42 devstack sudo[95620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:42 devstack sudo[95611]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4d440292-aa2f-43c2-bd42-27655500889e tempest-VolumesDeleteCascade-1233200636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c" returned: 0 in 1.146s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4d440292-aa2f-43c2-bd42-27655500889e tempest-VolumesDeleteCascade-1233200636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c.294f124d-743d-4132-b735-67dc39773d06 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:42 devstack sudo[95625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c.294f124d-743d-4132-b735-67dc39773d06 1G Jul 07 08:21:42 devstack sudo[95625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:42 devstack sudo[95618]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a8eefc63-05ec-48b9-b3c9-2628ad52a9f5 tempest-GroupsV314Test-1651555741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-35cac7f2-2952-4e01-aba5-e6dfbb696e29" returned: 0 in 1.012s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:43 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a8eefc63-05ec-48b9-b3c9-2628ad52a9f5 tempest-GroupsV314Test-1651555741 None] Lock "cinder-quobyte-35cac7f2-2952-4e01-aba5-e6dfbb696e29" released by "delete_volume" :: held 2.217s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:21:43 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-a8eefc63-05ec-48b9-b3c9-2628ad52a9f5 tempest-GroupsV314Test-1651555741 None] Created reservations ['9e72b61b-67e3-4b3f-8c7b-7943a4e84a6b'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:21:43 devstack sudo[95620]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a6c70edb-8d02-4595-9340-c68f20a7a95d tempest-VolumesTransfersTest-1935448358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.939s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:43 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-a6c70edb-8d02-4595-9340-c68f20a7a95d tempest-VolumesTransfersTest-1935448358 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:21:43 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-a6c70edb-8d02-4595-9340-c68f20a7a95d tempest-VolumesTransfersTest-1935448358 None] Deleted volume successfully. Jul 07 08:21:43 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-a8eefc63-05ec-48b9-b3c9-2628ad52a9f5 tempest-GroupsV314Test-1651555741 None] Created reservations ['0c41b924-413b-48b4-b64f-314d9db20fa8', 'a191129d-1354-4e2a-a9bc-b9fe5b2355f3', 'fe57f365-db61-47e3-8013-e2d0cc86d369', 'e05a2768-d8ee-4cb7-946a-60540cf6e648'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:21:43 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a6c70edb-8d02-4595-9340-c68f20a7a95d tempest-VolumesTransfersTest-1935448358 None] Lock "cinder-a5b5299f-cb5e-44e2-bfce-7b7c6114563d-delete_volume" released by "delete_volume" :: held 3.142s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:21:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a8eefc63-05ec-48b9-b3c9-2628ad52a9f5 tempest-GroupsV314Test-1651555741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:21:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a8eefc63-05ec-48b9-b3c9-2628ad52a9f5 tempest-GroupsV314Test-1651555741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:21:43 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a8eefc63-05ec-48b9-b3c9-2628ad52a9f5 tempest-GroupsV314Test-1651555741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:21:43 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a8eefc63-05ec-48b9-b3c9-2628ad52a9f5 tempest-GroupsV314Test-1651555741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:21:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a8eefc63-05ec-48b9-b3c9-2628ad52a9f5 tempest-GroupsV314Test-1651555741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:21:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a8eefc63-05ec-48b9-b3c9-2628ad52a9f5 tempest-GroupsV314Test-1651555741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:43 devstack sudo[95632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:21:43 devstack sudo[95632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:43 devstack sudo[95625]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4d440292-aa2f-43c2-bd42-27655500889e tempest-VolumesDeleteCascade-1233200636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c.294f124d-743d-4132-b735-67dc39773d06 1G" returned: 0 in 1.275s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4d440292-aa2f-43c2-bd42-27655500889e tempest-VolumesDeleteCascade-1233200636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c.294f124d-743d-4132-b735-67dc39773d06 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:43 devstack sudo[95635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c.294f124d-743d-4132-b735-67dc39773d06 Jul 07 08:21:43 devstack sudo[95635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:44 devstack sudo[95632]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a8eefc63-05ec-48b9-b3c9-2628ad52a9f5 tempest-GroupsV314Test-1651555741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.827s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:44 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-a8eefc63-05ec-48b9-b3c9-2628ad52a9f5 tempest-GroupsV314Test-1651555741 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:21:44 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-a8eefc63-05ec-48b9-b3c9-2628ad52a9f5 tempest-GroupsV314Test-1651555741 None] Delete group completed successfully. Jul 07 08:21:44 devstack sudo[95635]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4d440292-aa2f-43c2-bd42-27655500889e tempest-VolumesDeleteCascade-1233200636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c.294f124d-743d-4132-b735-67dc39773d06" returned: 0 in 0.928s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:44 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-4d440292-aa2f-43c2-bd42-27655500889e tempest-VolumesDeleteCascade-1233200636 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c.294f124d-743d-4132-b735-67dc39773d06 is being set with open permissions: ugo+rw Jul 07 08:21:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4d440292-aa2f-43c2-bd42-27655500889e tempest-VolumesDeleteCascade-1233200636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c.294f124d-743d-4132-b735-67dc39773d06 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:44 devstack sudo[95642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c.294f124d-743d-4132-b735-67dc39773d06 Jul 07 08:21:44 devstack sudo[95642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:45 devstack sudo[95642]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4d440292-aa2f-43c2-bd42-27655500889e tempest-VolumesDeleteCascade-1233200636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c.294f124d-743d-4132-b735-67dc39773d06" returned: 0 in 0.912s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4d440292-aa2f-43c2-bd42-27655500889e tempest-VolumesDeleteCascade-1233200636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:45 devstack sudo[95645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c.info Jul 07 08:21:45 devstack sudo[95645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:46 devstack sudo[95645]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4d440292-aa2f-43c2-bd42-27655500889e tempest-VolumesDeleteCascade-1233200636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c.info" returned: 0 in 0.947s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:46 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-4d440292-aa2f-43c2-bd42-27655500889e tempest-VolumesDeleteCascade-1233200636 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c.info is being set with open permissions: ugo+rw Jul 07 08:21:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4d440292-aa2f-43c2-bd42-27655500889e tempest-VolumesDeleteCascade-1233200636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:46 devstack sudo[95654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c.info Jul 07 08:21:46 devstack sudo[95654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:47 devstack sudo[95654]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4d440292-aa2f-43c2-bd42-27655500889e tempest-VolumesDeleteCascade-1233200636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c.info" returned: 0 in 0.750s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4d440292-aa2f-43c2-bd42-27655500889e tempest-VolumesDeleteCascade-1233200636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.106s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:21:47 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-4d440292-aa2f-43c2-bd42-27655500889e tempest-VolumesDeleteCascade-1233200636 None] Create snapshot completed successfully Jul 07 08:21:48 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-063b5ae3-26f9-47b4-9724-0935f712c2e7 tempest-VolumesDeleteCascade-1233200636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:21:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-063b5ae3-26f9-47b4-9724-0935f712c2e7 tempest-VolumesDeleteCascade-1233200636 None] Flow 'volume_create_manager' (195049b5-287d-4e0a-be20-f556acbb263e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:21:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-063b5ae3-26f9-47b4-9724-0935f712c2e7 tempest-VolumesDeleteCascade-1233200636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70aaf5bb-f915-4daf-abd5-8deeef6c31c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:21:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-063b5ae3-26f9-47b4-9724-0935f712c2e7 tempest-VolumesDeleteCascade-1233200636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70aaf5bb-f915-4daf-abd5-8deeef6c31c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:21:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1080050091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9e5c358-36e1-4005-827a-9eaba95d3fcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97188b0d72f54c39b53585699c758934',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=294f124d-743d-4132-b735-67dc39773d06,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:21:48Z,use_quota=True,user_id='f333b41c84eb421388e3b21cdc55b91d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:21:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-063b5ae3-26f9-47b4-9724-0935f712c2e7 tempest-VolumesDeleteCascade-1233200636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c869fd1b-9b78-4551-b670-49a56d3fb607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:21:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-063b5ae3-26f9-47b4-9724-0935f712c2e7 tempest-VolumesDeleteCascade-1233200636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c869fd1b-9b78-4551-b670-49a56d3fb607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:21:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-063b5ae3-26f9-47b4-9724-0935f712c2e7 tempest-VolumesDeleteCascade-1233200636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb6b2ba1-22eb-4b5c-ac89-5c489af33e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:21:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-063b5ae3-26f9-47b4-9724-0935f712c2e7 tempest-VolumesDeleteCascade-1233200636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb6b2ba1-22eb-4b5c-ac89-5c489af33e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f9e5c358-36e1-4005-827a-9eaba95d3fcd', 'volume_name': 'volume-f9e5c358-36e1-4005-827a-9eaba95d3fcd', 'volume_size': 1, 'snapshot_id': '294f124d-743d-4132-b735-67dc39773d06'}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:21:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-063b5ae3-26f9-47b4-9724-0935f712c2e7 tempest-VolumesDeleteCascade-1233200636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3d220db-4097-4770-829c-9feb00a840a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:21:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-063b5ae3-26f9-47b4-9724-0935f712c2e7 tempest-VolumesDeleteCascade-1233200636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3d220db-4097-4770-829c-9feb00a840a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:21:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-063b5ae3-26f9-47b4-9724-0935f712c2e7 tempest-VolumesDeleteCascade-1233200636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43ec22fc-9bd4-43c4-bea1-8489f3b56f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:21:48 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-063b5ae3-26f9-47b4-9724-0935f712c2e7 tempest-VolumesDeleteCascade-1233200636 None] Volume f9e5c358-36e1-4005-827a-9eaba95d3fcd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f9e5c358-36e1-4005-827a-9eaba95d3fcd', 'volume_size': 1, 'snapshot_id': '294f124d-743d-4132-b735-67dc39773d06'} Jul 07 08:21:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-063b5ae3-26f9-47b4-9724-0935f712c2e7 tempest-VolumesDeleteCascade-1233200636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:21:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-063b5ae3-26f9-47b4-9724-0935f712c2e7 tempest-VolumesDeleteCascade-1233200636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:21:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-063b5ae3-26f9-47b4-9724-0935f712c2e7 tempest-VolumesDeleteCascade-1233200636 None] Acquiring lock "cinder-quobyte-294f124d-743d-4132-b735-67dc39773d06-f9e5c358-36e1-4005-827a-9eaba95d3fcd" by "_create_volume_from_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:21:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-063b5ae3-26f9-47b4-9724-0935f712c2e7 tempest-VolumesDeleteCascade-1233200636 None] Lock "cinder-quobyte-294f124d-743d-4132-b735-67dc39773d06-f9e5c358-36e1-4005-827a-9eaba95d3fcd" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:21:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-063b5ae3-26f9-47b4-9724-0935f712c2e7 tempest-VolumesDeleteCascade-1233200636 None] Creating volume f9e5c358-36e1-4005-827a-9eaba95d3fcd from snapshot 294f124d-743d-4132-b735-67dc39773d06 {{(pid=87199) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 08:21:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-063b5ae3-26f9-47b4-9724-0935f712c2e7 tempest-VolumesDeleteCascade-1233200636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:21:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-063b5ae3-26f9-47b4-9724-0935f712c2e7 tempest-VolumesDeleteCascade-1233200636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:21:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-063b5ae3-26f9-47b4-9724-0935f712c2e7 tempest-VolumesDeleteCascade-1233200636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:21:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-063b5ae3-26f9-47b4-9724-0935f712c2e7 tempest-VolumesDeleteCascade-1233200636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:21:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-063b5ae3-26f9-47b4-9724-0935f712c2e7 tempest-VolumesDeleteCascade-1233200636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:21:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-063b5ae3-26f9-47b4-9724-0935f712c2e7 tempest-VolumesDeleteCascade-1233200636 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:21:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-063b5ae3-26f9-47b4-9724-0935f712c2e7 tempest-VolumesDeleteCascade-1233200636 None] Acquiring lock "cinder-quobyte-f9e5c358-36e1-4005-827a-9eaba95d3fcd" by "_copy_volume_from_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:21:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-063b5ae3-26f9-47b4-9724-0935f712c2e7 tempest-VolumesDeleteCascade-1233200636 None] Lock "cinder-quobyte-f9e5c358-36e1-4005-827a-9eaba95d3fcd" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:21:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-063b5ae3-26f9-47b4-9724-0935f712c2e7 tempest-VolumesDeleteCascade-1233200636 None] snapshot: 294f124d-743d-4132-b735-67dc39773d06, volume: f9e5c358-36e1-4005-827a-9eaba95d3fcd, {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 08:21:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-063b5ae3-26f9-47b4-9724-0935f712c2e7 tempest-VolumesDeleteCascade-1233200636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:21:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-063b5ae3-26f9-47b4-9724-0935f712c2e7 tempest-VolumesDeleteCascade-1233200636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:21:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-063b5ae3-26f9-47b4-9724-0935f712c2e7 tempest-VolumesDeleteCascade-1233200636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:21:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-063b5ae3-26f9-47b4-9724-0935f712c2e7 tempest-VolumesDeleteCascade-1233200636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:21:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-063b5ae3-26f9-47b4-9724-0935f712c2e7 tempest-VolumesDeleteCascade-1233200636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:21:48 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[4111507b-bdf6-4045-a729-1fbba0e80aca]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:21:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-063b5ae3-26f9-47b4-9724-0935f712c2e7 tempest-VolumesDeleteCascade-1233200636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c.294f124d-743d-4132-b735-67dc39773d06 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:48 devstack sudo[95657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c.294f124d-743d-4132-b735-67dc39773d06 Jul 07 08:21:48 devstack sudo[95657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:49 devstack sudo[95657]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-063b5ae3-26f9-47b4-9724-0935f712c2e7 tempest-VolumesDeleteCascade-1233200636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c.294f124d-743d-4132-b735-67dc39773d06" returned: 0 in 1.048s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:49 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-063b5ae3-26f9-47b4-9724-0935f712c2e7 tempest-VolumesDeleteCascade-1233200636 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:21:49 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-063b5ae3-26f9-47b4-9724-0935f712c2e7 tempest-VolumesDeleteCascade-1233200636 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 08:21:49 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-063b5ae3-26f9-47b4-9724-0935f712c2e7 tempest-VolumesDeleteCascade-1233200636 None] Creating direct copy from snapshot {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 08:21:49 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e89bb0-4b98-42e6-a154-93a3e1aac2c2]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:21:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-063b5ae3-26f9-47b4-9724-0935f712c2e7 tempest-VolumesDeleteCascade-1233200636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:49 devstack sudo[95662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c Jul 07 08:21:49 devstack sudo[95662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:50 devstack sudo[95662]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-063b5ae3-26f9-47b4-9724-0935f712c2e7 tempest-VolumesDeleteCascade-1233200636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c" returned: 0 in 0.981s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:50 devstack cinder-volume[87199]: DEBUG cinder.utils [None req-063b5ae3-26f9-47b4-9724-0935f712c2e7 tempest-VolumesDeleteCascade-1233200636 None] Path /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f9e5c358-36e1-4005-827a-9eaba95d3fcd not found in is_blk_device check {{(pid=87199) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 08:21:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-063b5ae3-26f9-47b4-9724-0935f712c2e7 tempest-VolumesDeleteCascade-1233200636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f9e5c358-36e1-4005-827a-9eaba95d3fcd {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:50 devstack sudo[95669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f9e5c358-36e1-4005-827a-9eaba95d3fcd Jul 07 08:21:50 devstack sudo[95669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:56 devstack sudo[95669]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-063b5ae3-26f9-47b4-9724-0935f712c2e7 tempest-VolumesDeleteCascade-1233200636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f9e5c358-36e1-4005-827a-9eaba95d3fcd" returned: 0 in 6.136s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:56 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[020c116e-ff34-4ae6-b492-d83cd523a81a]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:21:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-063b5ae3-26f9-47b4-9724-0935f712c2e7 tempest-VolumesDeleteCascade-1233200636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:57 devstack sudo[95685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c Jul 07 08:21:57 devstack sudo[95685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:57 devstack sudo[95685]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-063b5ae3-26f9-47b4-9724-0935f712c2e7 tempest-VolumesDeleteCascade-1233200636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c" returned: 0 in 1.036s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:57 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-063b5ae3-26f9-47b4-9724-0935f712c2e7 tempest-VolumesDeleteCascade-1233200636 None] Image conversion details: src /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c, size 1024.00 MB, duration 6.14 sec, destination /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f9e5c358-36e1-4005-827a-9eaba95d3fcd {{(pid=87199) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 08:21:57 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-063b5ae3-26f9-47b4-9724-0935f712c2e7 tempest-VolumesDeleteCascade-1233200636 None] Converted 1024.00 MB image at 166.85 MB/s Jul 07 08:21:57 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-063b5ae3-26f9-47b4-9724-0935f712c2e7 tempest-VolumesDeleteCascade-1233200636 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f9e5c358-36e1-4005-827a-9eaba95d3fcd is being set with open permissions: ugo+rw Jul 07 08:21:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-063b5ae3-26f9-47b4-9724-0935f712c2e7 tempest-VolumesDeleteCascade-1233200636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f9e5c358-36e1-4005-827a-9eaba95d3fcd {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:57 devstack sudo[95690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f9e5c358-36e1-4005-827a-9eaba95d3fcd Jul 07 08:21:57 devstack sudo[95690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:58 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:UPDATE=38,cinder:SELECT=28,cinder:INSERT=9,cinder:DELETE=2 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:21:58 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=76,cinder:UPDATE=93,cinder:DELETE=4,cinder:INSERT=25 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:21:58 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-85af6444-3654-403d-8b21-3dd7407645d4 tempest-VolumesTransfersV355Test-1212199370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:21:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-85af6444-3654-403d-8b21-3dd7407645d4 tempest-VolumesTransfersV355Test-1212199370 None] Flow 'volume_create_manager' (8366dd77-2f5d-4708-8fac-0d98631151cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:21:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-85af6444-3654-403d-8b21-3dd7407645d4 tempest-VolumesTransfersV355Test-1212199370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f9ac69a-f3c1-4ce0-8dc0-07279addcf91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:21:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-85af6444-3654-403d-8b21-3dd7407645d4 tempest-VolumesTransfersV355Test-1212199370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f9ac69a-f3c1-4ce0-8dc0-07279addcf91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-594553960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=312bd33d-1804-48e0-9307-29939e5bd5cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5560943e7c941709c0e5ffe8ab6582b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:21:59Z,use_quota=True,user_id='e5e8f1de6d5d498abc79a1cc425e716d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:21:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-85af6444-3654-403d-8b21-3dd7407645d4 tempest-VolumesTransfersV355Test-1212199370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d5c126e-5bce-4bb4-93da-4b19f2a2bdf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:21:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-85af6444-3654-403d-8b21-3dd7407645d4 tempest-VolumesTransfersV355Test-1212199370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d5c126e-5bce-4bb4-93da-4b19f2a2bdf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:21:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-85af6444-3654-403d-8b21-3dd7407645d4 tempest-VolumesTransfersV355Test-1212199370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0fa4307-849e-46e3-ae3c-8e3883942681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:21:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-85af6444-3654-403d-8b21-3dd7407645d4 tempest-VolumesTransfersV355Test-1212199370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0fa4307-849e-46e3-ae3c-8e3883942681) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '312bd33d-1804-48e0-9307-29939e5bd5cd', 'volume_name': 'volume-312bd33d-1804-48e0-9307-29939e5bd5cd', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:21:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-85af6444-3654-403d-8b21-3dd7407645d4 tempest-VolumesTransfersV355Test-1212199370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a1e4a32-ff6d-4f07-a09b-f94d3157c495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:21:58 devstack sudo[95690]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-85af6444-3654-403d-8b21-3dd7407645d4 tempest-VolumesTransfersV355Test-1212199370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a1e4a32-ff6d-4f07-a09b-f94d3157c495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:21:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-85af6444-3654-403d-8b21-3dd7407645d4 tempest-VolumesTransfersV355Test-1212199370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b6d15c6-9f91-406c-a934-fdb9e015fe2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:21:58 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-85af6444-3654-403d-8b21-3dd7407645d4 tempest-VolumesTransfersV355Test-1212199370 None] Volume 312bd33d-1804-48e0-9307-29939e5bd5cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-312bd33d-1804-48e0-9307-29939e5bd5cd', 'volume_size': 1} Jul 07 08:21:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-85af6444-3654-403d-8b21-3dd7407645d4 tempest-VolumesTransfersV355Test-1212199370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:21:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-063b5ae3-26f9-47b4-9724-0935f712c2e7 tempest-VolumesDeleteCascade-1233200636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f9e5c358-36e1-4005-827a-9eaba95d3fcd" returned: 0 in 0.824s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:58 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-063b5ae3-26f9-47b4-9724-0935f712c2e7 tempest-VolumesDeleteCascade-1233200636 None] Lock "cinder-quobyte-f9e5c358-36e1-4005-827a-9eaba95d3fcd" released by "_copy_volume_from_snapshot" :: held 10.161s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:21:58 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-063b5ae3-26f9-47b4-9724-0935f712c2e7 tempest-VolumesDeleteCascade-1233200636 None] Lock "cinder-quobyte-294f124d-743d-4132-b735-67dc39773d06-f9e5c358-36e1-4005-827a-9eaba95d3fcd" released by "_create_volume_from_snapshot" :: held 10.209s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:21:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-063b5ae3-26f9-47b4-9724-0935f712c2e7 tempest-VolumesDeleteCascade-1233200636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.227s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:21:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-85af6444-3654-403d-8b21-3dd7407645d4 tempest-VolumesTransfersV355Test-1212199370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.021s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:21:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-85af6444-3654-403d-8b21-3dd7407645d4 tempest-VolumesTransfersV355Test-1212199370 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-594553960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=312bd33d-1804-48e0-9307-29939e5bd5cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5560943e7c941709c0e5ffe8ab6582b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:21:59Z,use_quota=True,user_id='e5e8f1de6d5d498abc79a1cc425e716d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:21:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-85af6444-3654-403d-8b21-3dd7407645d4 tempest-VolumesTransfersV355Test-1212199370 None] Creating volume 312bd33d-1804-48e0-9307-29939e5bd5cd {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:21:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-85af6444-3654-403d-8b21-3dd7407645d4 tempest-VolumesTransfersV355Test-1212199370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:21:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-85af6444-3654-403d-8b21-3dd7407645d4 tempest-VolumesTransfersV355Test-1212199370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:21:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-85af6444-3654-403d-8b21-3dd7407645d4 tempest-VolumesTransfersV355Test-1212199370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:21:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-85af6444-3654-403d-8b21-3dd7407645d4 tempest-VolumesTransfersV355Test-1212199370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:21:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-85af6444-3654-403d-8b21-3dd7407645d4 tempest-VolumesTransfersV355Test-1212199370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:21:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-85af6444-3654-403d-8b21-3dd7407645d4 tempest-VolumesTransfersV355Test-1212199370 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:21:58 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-85af6444-3654-403d-8b21-3dd7407645d4 tempest-VolumesTransfersV355Test-1212199370 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:21:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-85af6444-3654-403d-8b21-3dd7407645d4 tempest-VolumesTransfersV355Test-1212199370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-312bd33d-1804-48e0-9307-29939e5bd5cd 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:58 devstack sudo[95695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-312bd33d-1804-48e0-9307-29939e5bd5cd 1073741824 Jul 07 08:21:58 devstack sudo[95695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-063b5ae3-26f9-47b4-9724-0935f712c2e7 tempest-VolumesDeleteCascade-1233200636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43ec22fc-9bd4-43c4-bea1-8489f3b56f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9e5c358-36e1-4005-827a-9eaba95d3fcd', 'volume_size': 1, 'snapshot_id': '294f124d-743d-4132-b735-67dc39773d06'}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:21:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-063b5ae3-26f9-47b4-9724-0935f712c2e7 tempest-VolumesDeleteCascade-1233200636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5756943e-0e16-4620-89c5-9d3c01fdeedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:21:58 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-063b5ae3-26f9-47b4-9724-0935f712c2e7 tempest-VolumesDeleteCascade-1233200636 None] Volume volume-f9e5c358-36e1-4005-827a-9eaba95d3fcd (f9e5c358-36e1-4005-827a-9eaba95d3fcd): created successfully Jul 07 08:21:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-063b5ae3-26f9-47b4-9724-0935f712c2e7 tempest-VolumesDeleteCascade-1233200636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5756943e-0e16-4620-89c5-9d3c01fdeedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:21:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-063b5ae3-26f9-47b4-9724-0935f712c2e7 tempest-VolumesDeleteCascade-1233200636 None] Flow 'volume_create_manager' (195049b5-287d-4e0a-be20-f556acbb263e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:21:58 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-063b5ae3-26f9-47b4-9724-0935f712c2e7 tempest-VolumesDeleteCascade-1233200636 None] Created volume successfully. Jul 07 08:21:59 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d6213719-b282-4ee6-879e-fd971ac67e7a tempest-VolumesDeleteCascade-1233200636 None] Acquiring lock "cinder-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:21:59 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d6213719-b282-4ee6-879e-fd971ac67e7a tempest-VolumesDeleteCascade-1233200636 None] Lock "cinder-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:21:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d6213719-b282-4ee6-879e-fd971ac67e7a tempest-VolumesDeleteCascade-1233200636 None] Performing cascade delete. {{(pid=87199) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 07 08:21:59 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d6213719-b282-4ee6-879e-fd971ac67e7a tempest-VolumesDeleteCascade-1233200636 None] Acquiring lock "cinder-294f124d-743d-4132-b735-67dc39773d06-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:21:59 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d6213719-b282-4ee6-879e-fd971ac67e7a tempest-VolumesDeleteCascade-1233200636 None] Lock "cinder-294f124d-743d-4132-b735-67dc39773d06-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:21:59 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d6213719-b282-4ee6-879e-fd971ac67e7a tempest-VolumesDeleteCascade-1233200636 None] Acquiring lock "cinder-quobyte-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:21:59 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d6213719-b282-4ee6-879e-fd971ac67e7a tempest-VolumesDeleteCascade-1233200636 None] Lock "cinder-quobyte-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:21:59 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d6213719-b282-4ee6-879e-fd971ac67e7a tempest-VolumesDeleteCascade-1233200636 None] Acquiring lock "cinder-quobyte-294f124d-743d-4132-b735-67dc39773d06" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:21:59 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d6213719-b282-4ee6-879e-fd971ac67e7a tempest-VolumesDeleteCascade-1233200636 None] Lock "cinder-quobyte-294f124d-743d-4132-b735-67dc39773d06" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:21:59 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-d6213719-b282-4ee6-879e-fd971ac67e7a tempest-VolumesDeleteCascade-1233200636 None] Deleting offline snapshot 294f124d-743d-4132-b735-67dc39773d06 of volume 1aff63b9-6e07-4d1e-a855-4234d0cf1e9c {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:21:59 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-d6213719-b282-4ee6-879e-fd971ac67e7a tempest-VolumesDeleteCascade-1233200636 None] snapshot_file for this snap is: volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c.294f124d-743d-4132-b735-67dc39773d06 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:21:59 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[06db0630-13b6-4259-af17-a6fb4938faa6]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:21:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d6213719-b282-4ee6-879e-fd971ac67e7a tempest-VolumesDeleteCascade-1233200636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c.294f124d-743d-4132-b735-67dc39773d06 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:59 devstack sudo[95695]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-85af6444-3654-403d-8b21-3dd7407645d4 tempest-VolumesTransfersV355Test-1212199370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-312bd33d-1804-48e0-9307-29939e5bd5cd 1073741824" returned: 0 in 1.101s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-85af6444-3654-403d-8b21-3dd7407645d4 tempest-VolumesTransfersV355Test-1212199370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-312bd33d-1804-48e0-9307-29939e5bd5cd {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:59 devstack sudo[95704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c.294f124d-743d-4132-b735-67dc39773d06 Jul 07 08:21:59 devstack sudo[95704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:59 devstack sudo[95705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-312bd33d-1804-48e0-9307-29939e5bd5cd Jul 07 08:21:59 devstack sudo[95705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:00 devstack sudo[95705]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-85af6444-3654-403d-8b21-3dd7407645d4 tempest-VolumesTransfersV355Test-1212199370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-312bd33d-1804-48e0-9307-29939e5bd5cd" returned: 0 in 0.643s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:00 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-85af6444-3654-403d-8b21-3dd7407645d4 tempest-VolumesTransfersV355Test-1212199370 None] <== create_volume: return (1790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:22:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-85af6444-3654-403d-8b21-3dd7407645d4 tempest-VolumesTransfersV355Test-1212199370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.793s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:22:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-85af6444-3654-403d-8b21-3dd7407645d4 tempest-VolumesTransfersV355Test-1212199370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b6d15c6-9f91-406c-a934-fdb9e015fe2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-312bd33d-1804-48e0-9307-29939e5bd5cd', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-85af6444-3654-403d-8b21-3dd7407645d4 tempest-VolumesTransfersV355Test-1212199370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f38737da-4515-4923-b75d-3598193dbfe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:00 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-85af6444-3654-403d-8b21-3dd7407645d4 tempest-VolumesTransfersV355Test-1212199370 None] Volume volume-312bd33d-1804-48e0-9307-29939e5bd5cd (312bd33d-1804-48e0-9307-29939e5bd5cd): created successfully Jul 07 08:22:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-85af6444-3654-403d-8b21-3dd7407645d4 tempest-VolumesTransfersV355Test-1212199370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f38737da-4515-4923-b75d-3598193dbfe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-85af6444-3654-403d-8b21-3dd7407645d4 tempest-VolumesTransfersV355Test-1212199370 None] Flow 'volume_create_manager' (8366dd77-2f5d-4708-8fac-0d98631151cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:22:00 devstack sudo[95704]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:00 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-85af6444-3654-403d-8b21-3dd7407645d4 tempest-VolumesTransfersV355Test-1212199370 None] Created volume successfully. Jul 07 08:22:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d6213719-b282-4ee6-879e-fd971ac67e7a tempest-VolumesDeleteCascade-1233200636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c.294f124d-743d-4132-b735-67dc39773d06" returned: 0 in 0.845s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:00 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-d6213719-b282-4ee6-879e-fd971ac67e7a tempest-VolumesDeleteCascade-1233200636 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:22:00 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b5d239-e9c4-42cd-b3cc-55f6fad94309]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:22:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d6213719-b282-4ee6-879e-fd971ac67e7a tempest-VolumesDeleteCascade-1233200636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:00 devstack sudo[95713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c Jul 07 08:22:00 devstack sudo[95713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:01 devstack sudo[95713]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d6213719-b282-4ee6-879e-fd971ac67e7a tempest-VolumesDeleteCascade-1233200636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c" returned: 0 in 0.813s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d6213719-b282-4ee6-879e-fd971ac67e7a tempest-VolumesDeleteCascade-1233200636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c.294f124d-743d-4132-b735-67dc39773d06 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:01 devstack sudo[95720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c.294f124d-743d-4132-b735-67dc39773d06 Jul 07 08:22:01 devstack sudo[95720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:02 devstack sudo[95720]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d6213719-b282-4ee6-879e-fd971ac67e7a tempest-VolumesDeleteCascade-1233200636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c.294f124d-743d-4132-b735-67dc39773d06" returned: 0 in 0.891s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d6213719-b282-4ee6-879e-fd971ac67e7a tempest-VolumesDeleteCascade-1233200636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c.294f124d-743d-4132-b735-67dc39773d06 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:02 devstack sudo[95726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c.294f124d-743d-4132-b735-67dc39773d06 Jul 07 08:22:02 devstack sudo[95726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:02 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-f6194372-be57-430b-99d3-c29e2c47ed51 tempest-VolumesTransfersV355Test-1490263414 None] Transfer volume completed successfully. Jul 07 08:22:03 devstack sudo[95726]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d6213719-b282-4ee6-879e-fd971ac67e7a tempest-VolumesDeleteCascade-1233200636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c.294f124d-743d-4132-b735-67dc39773d06" returned: 0 in 0.851s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:03 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d6213719-b282-4ee6-879e-fd971ac67e7a tempest-VolumesDeleteCascade-1233200636 None] Lock "cinder-quobyte-294f124d-743d-4132-b735-67dc39773d06" released by "_delete_snapshot" :: held 3.512s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:22:03 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d6213719-b282-4ee6-879e-fd971ac67e7a tempest-VolumesDeleteCascade-1233200636 None] Lock "cinder-quobyte-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c" released by "delete_snapshot" :: held 3.553s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:22:03 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-d6213719-b282-4ee6-879e-fd971ac67e7a tempest-VolumesDeleteCascade-1233200636 None] Created reservations ['3c33fc1d-c9d0-431d-a295-91b9933467e9', 'a9aeb21e-f984-437d-9520-4b0aba335a8c', '384447b5-b9ec-4ccb-93bc-afd6b591fb7b', '76c7e4c7-404a-4878-a4dd-ef4f494ea676'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:22:03 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-d6213719-b282-4ee6-879e-fd971ac67e7a tempest-VolumesDeleteCascade-1233200636 None] Delete snapshot completed successfully. Jul 07 08:22:03 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d6213719-b282-4ee6-879e-fd971ac67e7a tempest-VolumesDeleteCascade-1233200636 None] Lock "cinder-294f124d-743d-4132-b735-67dc39773d06-delete_snapshot" released by "delete_snapshot" :: held 3.756s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:22:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d6213719-b282-4ee6-879e-fd971ac67e7a tempest-VolumesDeleteCascade-1233200636 None] Snapshots deleted, issuing volume delete {{(pid=87199) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 07 08:22:03 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d6213719-b282-4ee6-879e-fd971ac67e7a tempest-VolumesDeleteCascade-1233200636 None] Acquiring lock "cinder-quobyte-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:22:03 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d6213719-b282-4ee6-879e-fd971ac67e7a tempest-VolumesDeleteCascade-1233200636 None] Lock "cinder-quobyte-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c" acquired by "delete_volume" :: waited 0.023s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:22:03 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48f9dad-2838-4430-92fc-d57a840d47f5]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:22:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d6213719-b282-4ee6-879e-fd971ac67e7a tempest-VolumesDeleteCascade-1233200636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:03 devstack sudo[95730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c Jul 07 08:22:03 devstack sudo[95730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:03 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e6e21396-544e-4236-9805-dfe58bf27c4a tempest-VolumesTransfersV355Test-516792902 None] Acquiring lock "cinder-312bd33d-1804-48e0-9307-29939e5bd5cd-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:22:04 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e6e21396-544e-4236-9805-dfe58bf27c4a tempest-VolumesTransfersV355Test-516792902 None] Lock "cinder-312bd33d-1804-48e0-9307-29939e5bd5cd-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:22:04 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e6e21396-544e-4236-9805-dfe58bf27c4a tempest-VolumesTransfersV355Test-516792902 None] Acquiring lock "cinder-quobyte-312bd33d-1804-48e0-9307-29939e5bd5cd" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:22:04 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e6e21396-544e-4236-9805-dfe58bf27c4a tempest-VolumesTransfersV355Test-516792902 None] Lock "cinder-quobyte-312bd33d-1804-48e0-9307-29939e5bd5cd" acquired by "delete_volume" :: waited 0.032s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:22:04 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce9a7c9-3091-4b3b-963d-77819ca494e7]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:22:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e6e21396-544e-4236-9805-dfe58bf27c4a tempest-VolumesTransfersV355Test-516792902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-312bd33d-1804-48e0-9307-29939e5bd5cd {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:04 devstack sudo[95742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-312bd33d-1804-48e0-9307-29939e5bd5cd Jul 07 08:22:04 devstack sudo[95742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:04 devstack sudo[95730]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d6213719-b282-4ee6-879e-fd971ac67e7a tempest-VolumesDeleteCascade-1233200636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c" returned: 0 in 1.175s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d6213719-b282-4ee6-879e-fd971ac67e7a tempest-VolumesDeleteCascade-1233200636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:04 devstack sudo[95752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c Jul 07 08:22:04 devstack sudo[95752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:05 devstack sudo[95742]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e6e21396-544e-4236-9805-dfe58bf27c4a tempest-VolumesTransfersV355Test-516792902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-312bd33d-1804-48e0-9307-29939e5bd5cd" returned: 0 in 0.945s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e6e21396-544e-4236-9805-dfe58bf27c4a tempest-VolumesTransfersV355Test-516792902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-312bd33d-1804-48e0-9307-29939e5bd5cd {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:05 devstack sudo[95757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-312bd33d-1804-48e0-9307-29939e5bd5cd Jul 07 08:22:05 devstack sudo[95757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:05 devstack sudo[95752]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d6213719-b282-4ee6-879e-fd971ac67e7a tempest-VolumesDeleteCascade-1233200636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c" returned: 0 in 0.707s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d6213719-b282-4ee6-879e-fd971ac67e7a tempest-VolumesDeleteCascade-1233200636 None] Lock "cinder-quobyte-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c" released by "delete_volume" :: held 1.982s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:22:05 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-d6213719-b282-4ee6-879e-fd971ac67e7a tempest-VolumesDeleteCascade-1233200636 None] Created reservations ['89245243-e49d-4df2-a1e1-f45c8ad12aba', 'f0bee2f1-1e2c-4273-8fa3-6afc0c77e860', '058a687d-a689-4ea9-a4b6-04e3c05354ef', '7ab5699b-1df2-498f-bed0-d49b9fc83cf3'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:22:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d6213719-b282-4ee6-879e-fd971ac67e7a tempest-VolumesDeleteCascade-1233200636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:22:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d6213719-b282-4ee6-879e-fd971ac67e7a tempest-VolumesDeleteCascade-1233200636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:22:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d6213719-b282-4ee6-879e-fd971ac67e7a tempest-VolumesDeleteCascade-1233200636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:22:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d6213719-b282-4ee6-879e-fd971ac67e7a tempest-VolumesDeleteCascade-1233200636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:22:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d6213719-b282-4ee6-879e-fd971ac67e7a tempest-VolumesDeleteCascade-1233200636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:22:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d6213719-b282-4ee6-879e-fd971ac67e7a tempest-VolumesDeleteCascade-1233200636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:05 devstack sudo[95760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:22:05 devstack sudo[95760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:05 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:22:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:22:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:22:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:22:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:22:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:22:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:05 devstack sudo[95763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:22:05 devstack sudo[95763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:06 devstack sudo[95757]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e6e21396-544e-4236-9805-dfe58bf27c4a tempest-VolumesTransfersV355Test-516792902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-312bd33d-1804-48e0-9307-29939e5bd5cd" returned: 0 in 0.878s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:06 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e6e21396-544e-4236-9805-dfe58bf27c4a tempest-VolumesTransfersV355Test-516792902 None] Lock "cinder-quobyte-312bd33d-1804-48e0-9307-29939e5bd5cd" released by "delete_volume" :: held 1.902s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:22:06 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-e6e21396-544e-4236-9805-dfe58bf27c4a tempest-VolumesTransfersV355Test-516792902 None] Created reservations ['07818326-dc6c-4468-b187-0fdb398f75bd', '11cd581a-2420-4415-b09f-1b600e59a5ee', 'f469e464-8b61-4d72-b566-941249bc1530', '11811e63-917b-4fb5-968e-6be7b0289aba'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:22:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e6e21396-544e-4236-9805-dfe58bf27c4a tempest-VolumesTransfersV355Test-516792902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:22:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e6e21396-544e-4236-9805-dfe58bf27c4a tempest-VolumesTransfersV355Test-516792902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:22:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e6e21396-544e-4236-9805-dfe58bf27c4a tempest-VolumesTransfersV355Test-516792902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:22:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e6e21396-544e-4236-9805-dfe58bf27c4a tempest-VolumesTransfersV355Test-516792902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:22:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e6e21396-544e-4236-9805-dfe58bf27c4a tempest-VolumesTransfersV355Test-516792902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:22:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e6e21396-544e-4236-9805-dfe58bf27c4a tempest-VolumesTransfersV355Test-516792902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:06 devstack sudo[95765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:22:06 devstack sudo[95765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:06 devstack sudo[95760]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d6213719-b282-4ee6-879e-fd971ac67e7a tempest-VolumesDeleteCascade-1233200636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.911s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:06 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-d6213719-b282-4ee6-879e-fd971ac67e7a tempest-VolumesDeleteCascade-1233200636 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:22:06 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-d6213719-b282-4ee6-879e-fd971ac67e7a tempest-VolumesDeleteCascade-1233200636 None] Deleted volume successfully. Jul 07 08:22:06 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d6213719-b282-4ee6-879e-fd971ac67e7a tempest-VolumesDeleteCascade-1233200636 None] Lock "cinder-1aff63b9-6e07-4d1e-a855-4234d0cf1e9c-delete_volume" released by "delete_volume" :: held 6.969s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:22:06 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-61ac4493-270f-400b-8527-2a1963b036eb tempest-VolumesDeleteCascade-1233200636 None] Acquiring lock "cinder-f9e5c358-36e1-4005-827a-9eaba95d3fcd-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:22:06 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-61ac4493-270f-400b-8527-2a1963b036eb tempest-VolumesDeleteCascade-1233200636 None] Lock "cinder-f9e5c358-36e1-4005-827a-9eaba95d3fcd-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:22:06 devstack sudo[95763]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:06 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-61ac4493-270f-400b-8527-2a1963b036eb tempest-VolumesDeleteCascade-1233200636 None] Acquiring lock "cinder-quobyte-f9e5c358-36e1-4005-827a-9eaba95d3fcd" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:22:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.927s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:06 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:22:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running periodic task VolumeManager._thread_info {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:22:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] thread count: 28 {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 08:22:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] thread info: [<_MainThread(MainThread, started 133056092332160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 08:22:06 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-61ac4493-270f-400b-8527-2a1963b036eb tempest-VolumesDeleteCascade-1233200636 None] Lock "cinder-quobyte-f9e5c358-36e1-4005-827a-9eaba95d3fcd" acquired by "delete_volume" :: waited 0.055s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:22:06 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[457331d2-b1cd-49f5-a8e5-66b57edfc90c]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:22:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-61ac4493-270f-400b-8527-2a1963b036eb tempest-VolumesDeleteCascade-1233200636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f9e5c358-36e1-4005-827a-9eaba95d3fcd {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:07 devstack sudo[95769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f9e5c358-36e1-4005-827a-9eaba95d3fcd Jul 07 08:22:07 devstack sudo[95769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:07 devstack sudo[95765]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e6e21396-544e-4236-9805-dfe58bf27c4a tempest-VolumesTransfersV355Test-516792902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 1.132s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:07 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-e6e21396-544e-4236-9805-dfe58bf27c4a tempest-VolumesTransfersV355Test-516792902 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:22:07 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-e6e21396-544e-4236-9805-dfe58bf27c4a tempest-VolumesTransfersV355Test-516792902 None] Deleted volume successfully. Jul 07 08:22:07 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce1868df-8565-4df1-a8db-a322c42d4c7b tempest-VolumesTransfersV355Test-1212199370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:22:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ce1868df-8565-4df1-a8db-a322c42d4c7b tempest-VolumesTransfersV355Test-1212199370 None] Flow 'volume_create_manager' (a5e9ac7f-994a-45da-8b49-36a70ef34cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:22:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ce1868df-8565-4df1-a8db-a322c42d4c7b tempest-VolumesTransfersV355Test-1212199370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fee3742-0442-4c53-bdcc-d2e3d932f8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ce1868df-8565-4df1-a8db-a322c42d4c7b tempest-VolumesTransfersV355Test-1212199370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fee3742-0442-4c53-bdcc-d2e3d932f8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-846009040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed19240a-e603-496a-a027-610d2b422325,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5560943e7c941709c0e5ffe8ab6582b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:22:07Z,use_quota=True,user_id='e5e8f1de6d5d498abc79a1cc425e716d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ce1868df-8565-4df1-a8db-a322c42d4c7b tempest-VolumesTransfersV355Test-1212199370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e32ff3f4-b1a6-432e-a1c2-8cd970e8c5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ce1868df-8565-4df1-a8db-a322c42d4c7b tempest-VolumesTransfersV355Test-1212199370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e32ff3f4-b1a6-432e-a1c2-8cd970e8c5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ce1868df-8565-4df1-a8db-a322c42d4c7b tempest-VolumesTransfersV355Test-1212199370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55f6cb30-cbee-4720-b57f-44dbeb4ddce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ce1868df-8565-4df1-a8db-a322c42d4c7b tempest-VolumesTransfersV355Test-1212199370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55f6cb30-cbee-4720-b57f-44dbeb4ddce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed19240a-e603-496a-a027-610d2b422325', 'volume_name': 'volume-ed19240a-e603-496a-a027-610d2b422325', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ce1868df-8565-4df1-a8db-a322c42d4c7b tempest-VolumesTransfersV355Test-1212199370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb466e9b-25c3-43a3-84b1-ffb7ad4b300b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ce1868df-8565-4df1-a8db-a322c42d4c7b tempest-VolumesTransfersV355Test-1212199370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb466e9b-25c3-43a3-84b1-ffb7ad4b300b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ce1868df-8565-4df1-a8db-a322c42d4c7b tempest-VolumesTransfersV355Test-1212199370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3afd642-2142-4cfd-95ec-5841b46a4874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:07 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-ce1868df-8565-4df1-a8db-a322c42d4c7b tempest-VolumesTransfersV355Test-1212199370 None] Volume ed19240a-e603-496a-a027-610d2b422325: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed19240a-e603-496a-a027-610d2b422325', 'volume_size': 1} Jul 07 08:22:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ce1868df-8565-4df1-a8db-a322c42d4c7b tempest-VolumesTransfersV355Test-1212199370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:22:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ce1868df-8565-4df1-a8db-a322c42d4c7b tempest-VolumesTransfersV355Test-1212199370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:22:07 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ce1868df-8565-4df1-a8db-a322c42d4c7b tempest-VolumesTransfersV355Test-1212199370 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-846009040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed19240a-e603-496a-a027-610d2b422325,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5560943e7c941709c0e5ffe8ab6582b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:22:07Z,use_quota=True,user_id='e5e8f1de6d5d498abc79a1cc425e716d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:22:07 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-ce1868df-8565-4df1-a8db-a322c42d4c7b tempest-VolumesTransfersV355Test-1212199370 None] Creating volume ed19240a-e603-496a-a027-610d2b422325 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:22:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ce1868df-8565-4df1-a8db-a322c42d4c7b tempest-VolumesTransfersV355Test-1212199370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:22:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ce1868df-8565-4df1-a8db-a322c42d4c7b tempest-VolumesTransfersV355Test-1212199370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:22:07 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ce1868df-8565-4df1-a8db-a322c42d4c7b tempest-VolumesTransfersV355Test-1212199370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:22:07 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ce1868df-8565-4df1-a8db-a322c42d4c7b tempest-VolumesTransfersV355Test-1212199370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:22:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ce1868df-8565-4df1-a8db-a322c42d4c7b tempest-VolumesTransfersV355Test-1212199370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:22:07 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ce1868df-8565-4df1-a8db-a322c42d4c7b tempest-VolumesTransfersV355Test-1212199370 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:22:07 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-ce1868df-8565-4df1-a8db-a322c42d4c7b tempest-VolumesTransfersV355Test-1212199370 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:22:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ce1868df-8565-4df1-a8db-a322c42d4c7b tempest-VolumesTransfersV355Test-1212199370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ed19240a-e603-496a-a027-610d2b422325 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:07 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e6e21396-544e-4236-9805-dfe58bf27c4a tempest-VolumesTransfersV355Test-516792902 None] Lock "cinder-312bd33d-1804-48e0-9307-29939e5bd5cd-delete_volume" released by "delete_volume" :: held 3.511s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:22:07 devstack sudo[95781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ed19240a-e603-496a-a027-610d2b422325 1073741824 Jul 07 08:22:07 devstack sudo[95781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:08 devstack sudo[95769]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-61ac4493-270f-400b-8527-2a1963b036eb tempest-VolumesDeleteCascade-1233200636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f9e5c358-36e1-4005-827a-9eaba95d3fcd" returned: 0 in 1.233s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-61ac4493-270f-400b-8527-2a1963b036eb tempest-VolumesDeleteCascade-1233200636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f9e5c358-36e1-4005-827a-9eaba95d3fcd {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:08 devstack sudo[95815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f9e5c358-36e1-4005-827a-9eaba95d3fcd Jul 07 08:22:08 devstack sudo[95815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:08 devstack sudo[95781]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ce1868df-8565-4df1-a8db-a322c42d4c7b tempest-VolumesTransfersV355Test-1212199370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ed19240a-e603-496a-a027-610d2b422325 1073741824" returned: 0 in 1.428s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ce1868df-8565-4df1-a8db-a322c42d4c7b tempest-VolumesTransfersV355Test-1212199370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ed19240a-e603-496a-a027-610d2b422325 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:09 devstack sudo[95831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ed19240a-e603-496a-a027-610d2b422325 Jul 07 08:22:09 devstack sudo[95831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:09 devstack sudo[95815]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-61ac4493-270f-400b-8527-2a1963b036eb tempest-VolumesDeleteCascade-1233200636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f9e5c358-36e1-4005-827a-9eaba95d3fcd" returned: 0 in 0.872s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:09 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-61ac4493-270f-400b-8527-2a1963b036eb tempest-VolumesDeleteCascade-1233200636 None] Lock "cinder-quobyte-f9e5c358-36e1-4005-827a-9eaba95d3fcd" released by "delete_volume" :: held 2.203s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:22:09 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-61ac4493-270f-400b-8527-2a1963b036eb tempest-VolumesDeleteCascade-1233200636 None] Created reservations ['d1bc0b99-78ab-42b1-8b66-aa4e1ae2a54b', '7dd4f3af-c6d8-4c3d-878d-ab365f9c4e07', '401817ee-20e1-487c-90f2-1d2fc1e018aa', 'e9a52e0e-073d-47ee-ac43-d713789ebfe3'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:22:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-61ac4493-270f-400b-8527-2a1963b036eb tempest-VolumesDeleteCascade-1233200636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:22:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-61ac4493-270f-400b-8527-2a1963b036eb tempest-VolumesDeleteCascade-1233200636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:22:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-61ac4493-270f-400b-8527-2a1963b036eb tempest-VolumesDeleteCascade-1233200636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:22:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-61ac4493-270f-400b-8527-2a1963b036eb tempest-VolumesDeleteCascade-1233200636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:22:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-61ac4493-270f-400b-8527-2a1963b036eb tempest-VolumesDeleteCascade-1233200636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:22:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-61ac4493-270f-400b-8527-2a1963b036eb tempest-VolumesDeleteCascade-1233200636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:09 devstack sudo[95842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:22:09 devstack sudo[95842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:09 devstack sudo[95831]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ce1868df-8565-4df1-a8db-a322c42d4c7b tempest-VolumesTransfersV355Test-1212199370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ed19240a-e603-496a-a027-610d2b422325" returned: 0 in 0.887s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ce1868df-8565-4df1-a8db-a322c42d4c7b tempest-VolumesTransfersV355Test-1212199370 None] <== create_volume: return (2385ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:22:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ce1868df-8565-4df1-a8db-a322c42d4c7b tempest-VolumesTransfersV355Test-1212199370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.390s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:22:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ce1868df-8565-4df1-a8db-a322c42d4c7b tempest-VolumesTransfersV355Test-1212199370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3afd642-2142-4cfd-95ec-5841b46a4874) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed19240a-e603-496a-a027-610d2b422325', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ce1868df-8565-4df1-a8db-a322c42d4c7b tempest-VolumesTransfersV355Test-1212199370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc6a64fc-85ba-4541-b075-5a75cabfc257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:09 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-ce1868df-8565-4df1-a8db-a322c42d4c7b tempest-VolumesTransfersV355Test-1212199370 None] Volume volume-ed19240a-e603-496a-a027-610d2b422325 (ed19240a-e603-496a-a027-610d2b422325): created successfully Jul 07 08:22:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ce1868df-8565-4df1-a8db-a322c42d4c7b tempest-VolumesTransfersV355Test-1212199370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc6a64fc-85ba-4541-b075-5a75cabfc257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ce1868df-8565-4df1-a8db-a322c42d4c7b tempest-VolumesTransfersV355Test-1212199370 None] Flow 'volume_create_manager' (a5e9ac7f-994a-45da-8b49-36a70ef34cf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:22:09 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-ce1868df-8565-4df1-a8db-a322c42d4c7b tempest-VolumesTransfersV355Test-1212199370 None] Created volume successfully. Jul 07 08:22:10 devstack sudo[95842]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-61ac4493-270f-400b-8527-2a1963b036eb tempest-VolumesDeleteCascade-1233200636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.934s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:10 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-61ac4493-270f-400b-8527-2a1963b036eb tempest-VolumesDeleteCascade-1233200636 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:22:10 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-61ac4493-270f-400b-8527-2a1963b036eb tempest-VolumesDeleteCascade-1233200636 None] Deleted volume successfully. Jul 07 08:22:10 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-61ac4493-270f-400b-8527-2a1963b036eb tempest-VolumesDeleteCascade-1233200636 None] Lock "cinder-f9e5c358-36e1-4005-827a-9eaba95d3fcd-delete_volume" released by "delete_volume" :: held 3.483s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:22:10 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-98eaae54-52af-4706-89b7-084e97652b6b tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:22:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-98eaae54-52af-4706-89b7-084e97652b6b tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] Flow 'volume_create_manager' (7b312276-bbf9-4daa-84d9-60645e1e3a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:22:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-98eaae54-52af-4706-89b7-084e97652b6b tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (358abfb4-bea6-474f-9e2b-82548f621538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:11 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cde0c330-92ca-4097-a6a5-8134c22eccc1 tempest-VolumesTransfersV355Test-516792902 None] Acquiring lock "cinder-ed19240a-e603-496a-a027-610d2b422325-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:22:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-98eaae54-52af-4706-89b7-084e97652b6b tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (358abfb4-bea6-474f-9e2b-82548f621538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-806616441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cec16af4-afb7-41af-851d-1733628f4e6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fb475a5eb1049228f8dd8d25642ef36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:22:11Z,use_quota=True,user_id='0cb50f8c0cb74e63aed6e57c4f8d8afb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f5d672-6677-446d-8bc4-6fbda40ac696),volume_type_id=62f5d672-6677-446d-8bc4-6fbda40ac696)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-98eaae54-52af-4706-89b7-084e97652b6b tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (121acdfd-5748-4bc1-a0fc-8c8f0e1d741c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-98eaae54-52af-4706-89b7-084e97652b6b tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (121acdfd-5748-4bc1-a0fc-8c8f0e1d741c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-98eaae54-52af-4706-89b7-084e97652b6b tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73aad19f-1a3f-47fc-b4ec-5ec88aa002a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-98eaae54-52af-4706-89b7-084e97652b6b tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73aad19f-1a3f-47fc-b4ec-5ec88aa002a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cec16af4-afb7-41af-851d-1733628f4e6d', 'volume_name': 'volume-cec16af4-afb7-41af-851d-1733628f4e6d', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-98eaae54-52af-4706-89b7-084e97652b6b tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0be9e9ea-d321-48a8-8487-5090a24b218d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-98eaae54-52af-4706-89b7-084e97652b6b tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0be9e9ea-d321-48a8-8487-5090a24b218d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-98eaae54-52af-4706-89b7-084e97652b6b tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e69665a-4a2e-4fcc-9732-45a7728fd5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:11 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-98eaae54-52af-4706-89b7-084e97652b6b tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] Volume cec16af4-afb7-41af-851d-1733628f4e6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cec16af4-afb7-41af-851d-1733628f4e6d', 'volume_size': 1} Jul 07 08:22:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-98eaae54-52af-4706-89b7-084e97652b6b tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:22:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-98eaae54-52af-4706-89b7-084e97652b6b tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:22:11 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-98eaae54-52af-4706-89b7-084e97652b6b tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-806616441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cec16af4-afb7-41af-851d-1733628f4e6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fb475a5eb1049228f8dd8d25642ef36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:22:11Z,use_quota=True,user_id='0cb50f8c0cb74e63aed6e57c4f8d8afb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f5d672-6677-446d-8bc4-6fbda40ac696),volume_type_id=62f5d672-6677-446d-8bc4-6fbda40ac696)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:22:11 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-98eaae54-52af-4706-89b7-084e97652b6b tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] Creating volume cec16af4-afb7-41af-851d-1733628f4e6d {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:22:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-98eaae54-52af-4706-89b7-084e97652b6b tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:22:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-98eaae54-52af-4706-89b7-084e97652b6b tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:22:11 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-98eaae54-52af-4706-89b7-084e97652b6b tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:22:11 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-98eaae54-52af-4706-89b7-084e97652b6b tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:22:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-98eaae54-52af-4706-89b7-084e97652b6b tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:22:11 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-98eaae54-52af-4706-89b7-084e97652b6b tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:22:11 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-98eaae54-52af-4706-89b7-084e97652b6b tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:22:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-98eaae54-52af-4706-89b7-084e97652b6b tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cec16af4-afb7-41af-851d-1733628f4e6d 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:11 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cde0c330-92ca-4097-a6a5-8134c22eccc1 tempest-VolumesTransfersV355Test-516792902 None] Lock "cinder-ed19240a-e603-496a-a027-610d2b422325-delete_volume" acquired by "delete_volume" :: waited 0.123s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:22:11 devstack sudo[95859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cec16af4-afb7-41af-851d-1733628f4e6d 1073741824 Jul 07 08:22:11 devstack sudo[95859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:11 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cde0c330-92ca-4097-a6a5-8134c22eccc1 tempest-VolumesTransfersV355Test-516792902 None] Acquiring lock "cinder-quobyte-ed19240a-e603-496a-a027-610d2b422325" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:22:11 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cde0c330-92ca-4097-a6a5-8134c22eccc1 tempest-VolumesTransfersV355Test-516792902 None] Lock "cinder-quobyte-ed19240a-e603-496a-a027-610d2b422325" acquired by "delete_volume" :: waited 0.019s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:22:11 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[c148d4d3-3057-41b9-aa71-b203c89b8bf1]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:22:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cde0c330-92ca-4097-a6a5-8134c22eccc1 tempest-VolumesTransfersV355Test-516792902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ed19240a-e603-496a-a027-610d2b422325 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:11 devstack sudo[95861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ed19240a-e603-496a-a027-610d2b422325 Jul 07 08:22:11 devstack sudo[95861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:12 devstack sudo[95859]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-98eaae54-52af-4706-89b7-084e97652b6b tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cec16af4-afb7-41af-851d-1733628f4e6d 1073741824" returned: 0 in 1.279s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-98eaae54-52af-4706-89b7-084e97652b6b tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cec16af4-afb7-41af-851d-1733628f4e6d {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:12 devstack sudo[95867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cec16af4-afb7-41af-851d-1733628f4e6d Jul 07 08:22:12 devstack sudo[95867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:12 devstack sudo[95861]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cde0c330-92ca-4097-a6a5-8134c22eccc1 tempest-VolumesTransfersV355Test-516792902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ed19240a-e603-496a-a027-610d2b422325" returned: 0 in 1.511s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cde0c330-92ca-4097-a6a5-8134c22eccc1 tempest-VolumesTransfersV355Test-516792902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ed19240a-e603-496a-a027-610d2b422325 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:12 devstack sudo[95872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ed19240a-e603-496a-a027-610d2b422325 Jul 07 08:22:12 devstack sudo[95872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:13 devstack sudo[95867]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-98eaae54-52af-4706-89b7-084e97652b6b tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cec16af4-afb7-41af-851d-1733628f4e6d" returned: 0 in 1.022s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-98eaae54-52af-4706-89b7-084e97652b6b tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] <== create_volume: return (2372ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:22:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-98eaae54-52af-4706-89b7-084e97652b6b tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.376s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:22:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-98eaae54-52af-4706-89b7-084e97652b6b tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e69665a-4a2e-4fcc-9732-45a7728fd5ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cec16af4-afb7-41af-851d-1733628f4e6d', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-98eaae54-52af-4706-89b7-084e97652b6b tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f69508d-f3a3-44ae-8b1a-a24496d5a9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:13 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-98eaae54-52af-4706-89b7-084e97652b6b tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] Volume volume-cec16af4-afb7-41af-851d-1733628f4e6d (cec16af4-afb7-41af-851d-1733628f4e6d): created successfully Jul 07 08:22:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-98eaae54-52af-4706-89b7-084e97652b6b tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f69508d-f3a3-44ae-8b1a-a24496d5a9dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-98eaae54-52af-4706-89b7-084e97652b6b tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] Flow 'volume_create_manager' (7b312276-bbf9-4daa-84d9-60645e1e3a09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:22:13 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-98eaae54-52af-4706-89b7-084e97652b6b tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] Created volume successfully. Jul 07 08:22:13 devstack sudo[95872]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cde0c330-92ca-4097-a6a5-8134c22eccc1 tempest-VolumesTransfersV355Test-516792902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ed19240a-e603-496a-a027-610d2b422325" returned: 0 in 1.057s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:13 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cde0c330-92ca-4097-a6a5-8134c22eccc1 tempest-VolumesTransfersV355Test-516792902 None] Lock "cinder-quobyte-ed19240a-e603-496a-a027-610d2b422325" released by "delete_volume" :: held 2.658s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:22:13 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-cde0c330-92ca-4097-a6a5-8134c22eccc1 tempest-VolumesTransfersV355Test-516792902 None] Created reservations ['2ae88e3a-85ed-4866-8a51-c6ed7b6c7396', '01ed5104-f967-4296-ae5e-4d4abbf50912', 'b2e8f03e-9bc5-4c3a-8141-6ba409603130', 'ad7969b1-0d9c-41f1-a84f-de7f462d843c'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:22:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cde0c330-92ca-4097-a6a5-8134c22eccc1 tempest-VolumesTransfersV355Test-516792902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:22:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cde0c330-92ca-4097-a6a5-8134c22eccc1 tempest-VolumesTransfersV355Test-516792902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:22:14 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-cde0c330-92ca-4097-a6a5-8134c22eccc1 tempest-VolumesTransfersV355Test-516792902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:22:14 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-cde0c330-92ca-4097-a6a5-8134c22eccc1 tempest-VolumesTransfersV355Test-516792902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:22:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cde0c330-92ca-4097-a6a5-8134c22eccc1 tempest-VolumesTransfersV355Test-516792902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:22:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cde0c330-92ca-4097-a6a5-8134c22eccc1 tempest-VolumesTransfersV355Test-516792902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:14 devstack sudo[95876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:22:14 devstack sudo[95876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ec7b7dd4-43a1-4ad5-9783-9e8d4535f1cb tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:22:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ec7b7dd4-43a1-4ad5-9783-9e8d4535f1cb tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:22:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ec7b7dd4-43a1-4ad5-9783-9e8d4535f1cb tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:22:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ec7b7dd4-43a1-4ad5-9783-9e8d4535f1cb tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:22:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ec7b7dd4-43a1-4ad5-9783-9e8d4535f1cb tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:22:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ec7b7dd4-43a1-4ad5-9783-9e8d4535f1cb tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:15 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-453b146d-12d9-47be-8128-92eb6f0bc055 tempest-VolumesMetadataTest-1249609039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:22:15 devstack sudo[95879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:22:15 devstack sudo[95879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-453b146d-12d9-47be-8128-92eb6f0bc055 tempest-VolumesMetadataTest-1249609039 None] Flow 'volume_create_manager' (98d0ccc7-62b1-47af-b3b1-ec92267f21bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:22:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-453b146d-12d9-47be-8128-92eb6f0bc055 tempest-VolumesMetadataTest-1249609039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbe6f216-216f-42c5-b91c-07826af0a41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-453b146d-12d9-47be-8128-92eb6f0bc055 tempest-VolumesMetadataTest-1249609039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbe6f216-216f-42c5-b91c-07826af0a41a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-912718477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adca11b5-50dc-4a12-b92c-bcac7dc35575,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ef1ba11f3ed47eba8bbfaea1f78fb56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:22:15Z,use_quota=True,user_id='027d224118204c28a428fc9383c37f10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-453b146d-12d9-47be-8128-92eb6f0bc055 tempest-VolumesMetadataTest-1249609039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (057f7df3-be8e-451c-ac65-9f9fa6df6fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-453b146d-12d9-47be-8128-92eb6f0bc055 tempest-VolumesMetadataTest-1249609039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (057f7df3-be8e-451c-ac65-9f9fa6df6fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-453b146d-12d9-47be-8128-92eb6f0bc055 tempest-VolumesMetadataTest-1249609039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caae2098-c9a4-4781-a5bf-b45f65d16908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-453b146d-12d9-47be-8128-92eb6f0bc055 tempest-VolumesMetadataTest-1249609039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caae2098-c9a4-4781-a5bf-b45f65d16908) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adca11b5-50dc-4a12-b92c-bcac7dc35575', 'volume_name': 'volume-adca11b5-50dc-4a12-b92c-bcac7dc35575', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-453b146d-12d9-47be-8128-92eb6f0bc055 tempest-VolumesMetadataTest-1249609039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (966c35b2-ef9e-49b4-8d37-fbd505cd6cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-453b146d-12d9-47be-8128-92eb6f0bc055 tempest-VolumesMetadataTest-1249609039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (966c35b2-ef9e-49b4-8d37-fbd505cd6cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-453b146d-12d9-47be-8128-92eb6f0bc055 tempest-VolumesMetadataTest-1249609039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daa7fe34-0aef-4f01-8e50-6fed70c00ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:15 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-453b146d-12d9-47be-8128-92eb6f0bc055 tempest-VolumesMetadataTest-1249609039 None] Volume adca11b5-50dc-4a12-b92c-bcac7dc35575: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adca11b5-50dc-4a12-b92c-bcac7dc35575', 'volume_size': 1} Jul 07 08:22:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-453b146d-12d9-47be-8128-92eb6f0bc055 tempest-VolumesMetadataTest-1249609039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:22:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-453b146d-12d9-47be-8128-92eb6f0bc055 tempest-VolumesMetadataTest-1249609039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:22:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-453b146d-12d9-47be-8128-92eb6f0bc055 tempest-VolumesMetadataTest-1249609039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-912718477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adca11b5-50dc-4a12-b92c-bcac7dc35575,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ef1ba11f3ed47eba8bbfaea1f78fb56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:22:15Z,use_quota=True,user_id='027d224118204c28a428fc9383c37f10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:22:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-453b146d-12d9-47be-8128-92eb6f0bc055 tempest-VolumesMetadataTest-1249609039 None] Creating volume adca11b5-50dc-4a12-b92c-bcac7dc35575 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:22:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-453b146d-12d9-47be-8128-92eb6f0bc055 tempest-VolumesMetadataTest-1249609039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:22:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-453b146d-12d9-47be-8128-92eb6f0bc055 tempest-VolumesMetadataTest-1249609039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:22:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-453b146d-12d9-47be-8128-92eb6f0bc055 tempest-VolumesMetadataTest-1249609039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:22:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-453b146d-12d9-47be-8128-92eb6f0bc055 tempest-VolumesMetadataTest-1249609039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:22:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-453b146d-12d9-47be-8128-92eb6f0bc055 tempest-VolumesMetadataTest-1249609039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:22:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-453b146d-12d9-47be-8128-92eb6f0bc055 tempest-VolumesMetadataTest-1249609039 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:22:15 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-453b146d-12d9-47be-8128-92eb6f0bc055 tempest-VolumesMetadataTest-1249609039 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:22:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-453b146d-12d9-47be-8128-92eb6f0bc055 tempest-VolumesMetadataTest-1249609039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-adca11b5-50dc-4a12-b92c-bcac7dc35575 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:15 devstack sudo[95881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-adca11b5-50dc-4a12-b92c-bcac7dc35575 1073741824 Jul 07 08:22:15 devstack sudo[95881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:15 devstack sudo[95876]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cde0c330-92ca-4097-a6a5-8134c22eccc1 tempest-VolumesTransfersV355Test-516792902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 1.743s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:15 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-cde0c330-92ca-4097-a6a5-8134c22eccc1 tempest-VolumesTransfersV355Test-516792902 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:22:15 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-cde0c330-92ca-4097-a6a5-8134c22eccc1 tempest-VolumesTransfersV355Test-516792902 None] Deleted volume successfully. Jul 07 08:22:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cde0c330-92ca-4097-a6a5-8134c22eccc1 tempest-VolumesTransfersV355Test-516792902 None] Lock "cinder-ed19240a-e603-496a-a027-610d2b422325-delete_volume" released by "delete_volume" :: held 4.754s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:22:16 devstack sudo[95879]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ec7b7dd4-43a1-4ad5-9783-9e8d4535f1cb tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 1.317s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:16 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ec7b7dd4-43a1-4ad5-9783-9e8d4535f1cb tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:22:16 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-ec7b7dd4-43a1-4ad5-9783-9e8d4535f1cb tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] Retype volume completed successfully. Jul 07 08:22:16 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fa4edc27-b0cb-4dfc-b087-f56589653e51 tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] Acquiring lock "cinder-cec16af4-afb7-41af-851d-1733628f4e6d-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:22:16 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fa4edc27-b0cb-4dfc-b087-f56589653e51 tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] Lock "cinder-cec16af4-afb7-41af-851d-1733628f4e6d-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:22:16 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fa4edc27-b0cb-4dfc-b087-f56589653e51 tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] Acquiring lock "cinder-quobyte-cec16af4-afb7-41af-851d-1733628f4e6d" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:22:16 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fa4edc27-b0cb-4dfc-b087-f56589653e51 tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] Lock "cinder-quobyte-cec16af4-afb7-41af-851d-1733628f4e6d" acquired by "delete_volume" :: waited 0.038s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:22:16 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7798158-f47f-497d-aab2-a43bb833de30]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:22:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fa4edc27-b0cb-4dfc-b087-f56589653e51 tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cec16af4-afb7-41af-851d-1733628f4e6d {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:16 devstack sudo[95889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cec16af4-afb7-41af-851d-1733628f4e6d Jul 07 08:22:16 devstack sudo[95889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:17 devstack sudo[95881]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-453b146d-12d9-47be-8128-92eb6f0bc055 tempest-VolumesMetadataTest-1249609039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-adca11b5-50dc-4a12-b92c-bcac7dc35575 1073741824" returned: 0 in 1.977s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-453b146d-12d9-47be-8128-92eb6f0bc055 tempest-VolumesMetadataTest-1249609039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-adca11b5-50dc-4a12-b92c-bcac7dc35575 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:17 devstack sudo[95891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-adca11b5-50dc-4a12-b92c-bcac7dc35575 Jul 07 08:22:17 devstack sudo[95891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:17 devstack sudo[95889]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fa4edc27-b0cb-4dfc-b087-f56589653e51 tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cec16af4-afb7-41af-851d-1733628f4e6d" returned: 0 in 1.206s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fa4edc27-b0cb-4dfc-b087-f56589653e51 tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cec16af4-afb7-41af-851d-1733628f4e6d {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:17 devstack sudo[95896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cec16af4-afb7-41af-851d-1733628f4e6d Jul 07 08:22:17 devstack sudo[95896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:18 devstack sudo[95891]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-453b146d-12d9-47be-8128-92eb6f0bc055 tempest-VolumesMetadataTest-1249609039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-adca11b5-50dc-4a12-b92c-bcac7dc35575" returned: 0 in 1.017s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:18 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-453b146d-12d9-47be-8128-92eb6f0bc055 tempest-VolumesMetadataTest-1249609039 None] <== create_volume: return (3061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:22:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-453b146d-12d9-47be-8128-92eb6f0bc055 tempest-VolumesMetadataTest-1249609039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.065s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:22:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-453b146d-12d9-47be-8128-92eb6f0bc055 tempest-VolumesMetadataTest-1249609039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daa7fe34-0aef-4f01-8e50-6fed70c00ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adca11b5-50dc-4a12-b92c-bcac7dc35575', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-453b146d-12d9-47be-8128-92eb6f0bc055 tempest-VolumesMetadataTest-1249609039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08bc1264-7076-48b0-a438-8f5288897df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:18 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-453b146d-12d9-47be-8128-92eb6f0bc055 tempest-VolumesMetadataTest-1249609039 None] Volume volume-adca11b5-50dc-4a12-b92c-bcac7dc35575 (adca11b5-50dc-4a12-b92c-bcac7dc35575): created successfully Jul 07 08:22:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-453b146d-12d9-47be-8128-92eb6f0bc055 tempest-VolumesMetadataTest-1249609039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08bc1264-7076-48b0-a438-8f5288897df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-453b146d-12d9-47be-8128-92eb6f0bc055 tempest-VolumesMetadataTest-1249609039 None] Flow 'volume_create_manager' (98d0ccc7-62b1-47af-b3b1-ec92267f21bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:22:18 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-453b146d-12d9-47be-8128-92eb6f0bc055 tempest-VolumesMetadataTest-1249609039 None] Created volume successfully. Jul 07 08:22:18 devstack sudo[95896]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fa4edc27-b0cb-4dfc-b087-f56589653e51 tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cec16af4-afb7-41af-851d-1733628f4e6d" returned: 0 in 0.876s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:18 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fa4edc27-b0cb-4dfc-b087-f56589653e51 tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] Lock "cinder-quobyte-cec16af4-afb7-41af-851d-1733628f4e6d" released by "delete_volume" :: held 2.161s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:22:18 devstack cinder-volume[87199]: WARNING cinder.quota [None req-fa4edc27-b0cb-4dfc-b087-f56589653e51 tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:22:18 devstack cinder-volume[87199]: WARNING cinder.quota [None req-fa4edc27-b0cb-4dfc-b087-f56589653e51 tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:22:18 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-fa4edc27-b0cb-4dfc-b087-f56589653e51 tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] Created reservations ['74f72318-420b-447d-acdd-9139b5404870', 'fe6b5ca8-f4da-4c40-b5d4-50d55cc8d89a', '85ddab43-2cec-4594-a15a-ccb7cb0add2e', 'edaad1f1-fcbb-4101-81e7-d127c13823d6'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:22:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-fa4edc27-b0cb-4dfc-b087-f56589653e51 tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:22:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-fa4edc27-b0cb-4dfc-b087-f56589653e51 tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:22:19 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-fa4edc27-b0cb-4dfc-b087-f56589653e51 tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:22:19 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-fa4edc27-b0cb-4dfc-b087-f56589653e51 tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:22:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-fa4edc27-b0cb-4dfc-b087-f56589653e51 tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:22:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fa4edc27-b0cb-4dfc-b087-f56589653e51 tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:19 devstack sudo[95900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:22:19 devstack sudo[95900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:19 devstack sudo[95900]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fa4edc27-b0cb-4dfc-b087-f56589653e51 tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.874s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:19 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-fa4edc27-b0cb-4dfc-b087-f56589653e51 tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:22:19 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-fa4edc27-b0cb-4dfc-b087-f56589653e51 tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] Deleted volume successfully. Jul 07 08:22:19 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fa4edc27-b0cb-4dfc-b087-f56589653e51 tempest-VolumeRetypeWithoutMigrationTest-1274082876 None] Lock "cinder-cec16af4-afb7-41af-851d-1733628f4e6d-delete_volume" released by "delete_volume" :: held 3.419s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:22:20 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d49e5d1a-5f06-4153-a233-ac560d5ed0ec tempest-VolumesMetadataTest-1249609039 None] Acquiring lock "cinder-adca11b5-50dc-4a12-b92c-bcac7dc35575-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:22:20 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d49e5d1a-5f06-4153-a233-ac560d5ed0ec tempest-VolumesMetadataTest-1249609039 None] Lock "cinder-adca11b5-50dc-4a12-b92c-bcac7dc35575-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:22:20 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d49e5d1a-5f06-4153-a233-ac560d5ed0ec tempest-VolumesMetadataTest-1249609039 None] Acquiring lock "cinder-quobyte-adca11b5-50dc-4a12-b92c-bcac7dc35575" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:22:20 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d49e5d1a-5f06-4153-a233-ac560d5ed0ec tempest-VolumesMetadataTest-1249609039 None] Lock "cinder-quobyte-adca11b5-50dc-4a12-b92c-bcac7dc35575" acquired by "delete_volume" :: waited 0.041s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:22:20 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[2277833a-c3fa-4c19-9198-58727f684bb5]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:22:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d49e5d1a-5f06-4153-a233-ac560d5ed0ec tempest-VolumesMetadataTest-1249609039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-adca11b5-50dc-4a12-b92c-bcac7dc35575 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:20 devstack sudo[95904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-adca11b5-50dc-4a12-b92c-bcac7dc35575 Jul 07 08:22:20 devstack sudo[95904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:21 devstack sudo[95904]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d49e5d1a-5f06-4153-a233-ac560d5ed0ec tempest-VolumesMetadataTest-1249609039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-adca11b5-50dc-4a12-b92c-bcac7dc35575" returned: 0 in 1.131s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d49e5d1a-5f06-4153-a233-ac560d5ed0ec tempest-VolumesMetadataTest-1249609039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-adca11b5-50dc-4a12-b92c-bcac7dc35575 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:21 devstack sudo[95910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-adca11b5-50dc-4a12-b92c-bcac7dc35575 Jul 07 08:22:21 devstack sudo[95910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:22 devstack sudo[95910]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d49e5d1a-5f06-4153-a233-ac560d5ed0ec tempest-VolumesMetadataTest-1249609039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-adca11b5-50dc-4a12-b92c-bcac7dc35575" returned: 0 in 0.886s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:22 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d49e5d1a-5f06-4153-a233-ac560d5ed0ec tempest-VolumesMetadataTest-1249609039 None] Lock "cinder-quobyte-adca11b5-50dc-4a12-b92c-bcac7dc35575" released by "delete_volume" :: held 2.075s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:22:22 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-d49e5d1a-5f06-4153-a233-ac560d5ed0ec tempest-VolumesMetadataTest-1249609039 None] Created reservations ['37f47439-97e2-4252-bfda-c51f028b8d3a', '9acdc613-bd7e-4a43-8b19-36b96310cecb', '5de10487-917c-4089-9e59-e9c01adef8af', 'e0335880-28e3-4b3f-a25d-193d97df94e6'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:22:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d49e5d1a-5f06-4153-a233-ac560d5ed0ec tempest-VolumesMetadataTest-1249609039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:22:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d49e5d1a-5f06-4153-a233-ac560d5ed0ec tempest-VolumesMetadataTest-1249609039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:22:22 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d49e5d1a-5f06-4153-a233-ac560d5ed0ec tempest-VolumesMetadataTest-1249609039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:22:22 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d49e5d1a-5f06-4153-a233-ac560d5ed0ec tempest-VolumesMetadataTest-1249609039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:22:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d49e5d1a-5f06-4153-a233-ac560d5ed0ec tempest-VolumesMetadataTest-1249609039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:22:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d49e5d1a-5f06-4153-a233-ac560d5ed0ec tempest-VolumesMetadataTest-1249609039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:22 devstack sudo[95927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:22:22 devstack sudo[95927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:23 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-01427bac-5add-4e4a-bb43-22066f5e4353 tempest-VolumesGetTest-684624965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:22:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-01427bac-5add-4e4a-bb43-22066f5e4353 tempest-VolumesGetTest-684624965 None] Flow 'volume_create_manager' (a97ad021-6e3d-453b-9bdf-e03de4a557b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:22:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-01427bac-5add-4e4a-bb43-22066f5e4353 tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (359ed148-c9fe-4978-bd21-32abc08bc93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:23 devstack sudo[95927]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d49e5d1a-5f06-4153-a233-ac560d5ed0ec tempest-VolumesMetadataTest-1249609039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.741s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:23 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-d49e5d1a-5f06-4153-a233-ac560d5ed0ec tempest-VolumesMetadataTest-1249609039 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:22:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-01427bac-5add-4e4a-bb43-22066f5e4353 tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (359ed148-c9fe-4978-bd21-32abc08bc93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:22:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-324727950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00aa0ea0-03b5-4dae-af42-2e13185e84f1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a2c16b6b1b494f40ab8446df3b7cafb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:22:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:22:24Z,use_quota=True,user_id='7f12dfe390174445ac6a473704f10545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-01427bac-5add-4e4a-bb43-22066f5e4353 tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (214ecea9-578a-4fd5-9ddb-041ce4c1d951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-01427bac-5add-4e4a-bb43-22066f5e4353 tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (214ecea9-578a-4fd5-9ddb-041ce4c1d951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-01427bac-5add-4e4a-bb43-22066f5e4353 tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e5ee303-d501-409c-9817-235f39b367f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-01427bac-5add-4e4a-bb43-22066f5e4353 tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e5ee303-d501-409c-9817-235f39b367f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00aa0ea0-03b5-4dae-af42-2e13185e84f1', 'volume_name': 'volume-00aa0ea0-03b5-4dae-af42-2e13185e84f1', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-01427bac-5add-4e4a-bb43-22066f5e4353 tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b49b0545-776f-4577-bb67-46d53599dcc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-01427bac-5add-4e4a-bb43-22066f5e4353 tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b49b0545-776f-4577-bb67-46d53599dcc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-01427bac-5add-4e4a-bb43-22066f5e4353 tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81d5be9c-17fb-4402-9c81-9ec165169736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:23 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-01427bac-5add-4e4a-bb43-22066f5e4353 tempest-VolumesGetTest-684624965 None] Volume 00aa0ea0-03b5-4dae-af42-2e13185e84f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00aa0ea0-03b5-4dae-af42-2e13185e84f1', 'volume_size': 1} Jul 07 08:22:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-01427bac-5add-4e4a-bb43-22066f5e4353 tempest-VolumesGetTest-684624965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:22:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-01427bac-5add-4e4a-bb43-22066f5e4353 tempest-VolumesGetTest-684624965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:22:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-01427bac-5add-4e4a-bb43-22066f5e4353 tempest-VolumesGetTest-684624965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:22:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-324727950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00aa0ea0-03b5-4dae-af42-2e13185e84f1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a2c16b6b1b494f40ab8446df3b7cafb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:22:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:22:24Z,use_quota=True,user_id='7f12dfe390174445ac6a473704f10545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:22:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-01427bac-5add-4e4a-bb43-22066f5e4353 tempest-VolumesGetTest-684624965 None] Creating volume 00aa0ea0-03b5-4dae-af42-2e13185e84f1 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:22:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-01427bac-5add-4e4a-bb43-22066f5e4353 tempest-VolumesGetTest-684624965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:22:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-01427bac-5add-4e4a-bb43-22066f5e4353 tempest-VolumesGetTest-684624965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:22:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-01427bac-5add-4e4a-bb43-22066f5e4353 tempest-VolumesGetTest-684624965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:22:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-01427bac-5add-4e4a-bb43-22066f5e4353 tempest-VolumesGetTest-684624965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:22:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-01427bac-5add-4e4a-bb43-22066f5e4353 tempest-VolumesGetTest-684624965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:22:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-01427bac-5add-4e4a-bb43-22066f5e4353 tempest-VolumesGetTest-684624965 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:22:23 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-01427bac-5add-4e4a-bb43-22066f5e4353 tempest-VolumesGetTest-684624965 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:22:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-01427bac-5add-4e4a-bb43-22066f5e4353 tempest-VolumesGetTest-684624965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-00aa0ea0-03b5-4dae-af42-2e13185e84f1 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:23 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-d49e5d1a-5f06-4153-a233-ac560d5ed0ec tempest-VolumesMetadataTest-1249609039 None] Deleted volume successfully. Jul 07 08:22:23 devstack sudo[95930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-00aa0ea0-03b5-4dae-af42-2e13185e84f1 1073741824 Jul 07 08:22:23 devstack sudo[95930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:23 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d49e5d1a-5f06-4153-a233-ac560d5ed0ec tempest-VolumesMetadataTest-1249609039 None] Lock "cinder-adca11b5-50dc-4a12-b92c-bcac7dc35575-delete_volume" released by "delete_volume" :: held 3.241s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:22:24 devstack sudo[95930]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-01427bac-5add-4e4a-bb43-22066f5e4353 tempest-VolumesGetTest-684624965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-00aa0ea0-03b5-4dae-af42-2e13185e84f1 1073741824" returned: 0 in 1.010s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-01427bac-5add-4e4a-bb43-22066f5e4353 tempest-VolumesGetTest-684624965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-00aa0ea0-03b5-4dae-af42-2e13185e84f1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:24 devstack sudo[95936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-00aa0ea0-03b5-4dae-af42-2e13185e84f1 Jul 07 08:22:24 devstack sudo[95936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:25 devstack sudo[95936]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-01427bac-5add-4e4a-bb43-22066f5e4353 tempest-VolumesGetTest-684624965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-00aa0ea0-03b5-4dae-af42-2e13185e84f1" returned: 0 in 0.794s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:25 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-01427bac-5add-4e4a-bb43-22066f5e4353 tempest-VolumesGetTest-684624965 None] <== create_volume: return (1853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:22:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-01427bac-5add-4e4a-bb43-22066f5e4353 tempest-VolumesGetTest-684624965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.856s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:22:25 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-01427bac-5add-4e4a-bb43-22066f5e4353 tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81d5be9c-17fb-4402-9c81-9ec165169736) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00aa0ea0-03b5-4dae-af42-2e13185e84f1', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:25 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-01427bac-5add-4e4a-bb43-22066f5e4353 tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a3b7f7c-c611-4556-a875-87a40776710d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:25 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-01427bac-5add-4e4a-bb43-22066f5e4353 tempest-VolumesGetTest-684624965 None] Volume volume-00aa0ea0-03b5-4dae-af42-2e13185e84f1 (00aa0ea0-03b5-4dae-af42-2e13185e84f1): created successfully Jul 07 08:22:25 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-01427bac-5add-4e4a-bb43-22066f5e4353 tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a3b7f7c-c611-4556-a875-87a40776710d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:25 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-01427bac-5add-4e4a-bb43-22066f5e4353 tempest-VolumesGetTest-684624965 None] Flow 'volume_create_manager' (a97ad021-6e3d-453b-9bdf-e03de4a557b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:22:25 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-01427bac-5add-4e4a-bb43-22066f5e4353 tempest-VolumesGetTest-684624965 None] Created volume successfully. Jul 07 08:22:27 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-b558f9da-f053-4db9-87f3-62d87c00fc30 tempest-VolumesServicesTestJSON-447625768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:22:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b558f9da-f053-4db9-87f3-62d87c00fc30 tempest-VolumesServicesTestJSON-447625768 None] Flow 'volume_create_manager' (cdf6f8e0-f4d8-40de-a2b3-6067b83eb274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:22:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b558f9da-f053-4db9-87f3-62d87c00fc30 tempest-VolumesServicesTestJSON-447625768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c944994f-7593-4f67-9526-0efc3d5aab5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b558f9da-f053-4db9-87f3-62d87c00fc30 tempest-VolumesServicesTestJSON-447625768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c944994f-7593-4f67-9526-0efc3d5aab5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:22:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-499405812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=386c23c7-ae47-4898-b29a-893f4c95e226,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='563e238302fc45c3ae6c44dca37592ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:22:28Z,use_quota=True,user_id='a4ae5d6d01a545bb86c0dd0e0a37d4ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b558f9da-f053-4db9-87f3-62d87c00fc30 tempest-VolumesServicesTestJSON-447625768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6136764-27ff-4687-8816-fdde690dd0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b558f9da-f053-4db9-87f3-62d87c00fc30 tempest-VolumesServicesTestJSON-447625768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6136764-27ff-4687-8816-fdde690dd0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b558f9da-f053-4db9-87f3-62d87c00fc30 tempest-VolumesServicesTestJSON-447625768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30bad851-2ef4-49a3-adb6-6f3c570a7f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b558f9da-f053-4db9-87f3-62d87c00fc30 tempest-VolumesServicesTestJSON-447625768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30bad851-2ef4-49a3-adb6-6f3c570a7f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '386c23c7-ae47-4898-b29a-893f4c95e226', 'volume_name': 'volume-386c23c7-ae47-4898-b29a-893f4c95e226', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b558f9da-f053-4db9-87f3-62d87c00fc30 tempest-VolumesServicesTestJSON-447625768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3858714-aafe-419d-b684-84dab4ac3e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b558f9da-f053-4db9-87f3-62d87c00fc30 tempest-VolumesServicesTestJSON-447625768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3858714-aafe-419d-b684-84dab4ac3e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b558f9da-f053-4db9-87f3-62d87c00fc30 tempest-VolumesServicesTestJSON-447625768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80aab7ab-aca7-46c8-be64-643461a4c3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:27 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-b558f9da-f053-4db9-87f3-62d87c00fc30 tempest-VolumesServicesTestJSON-447625768 None] Volume 386c23c7-ae47-4898-b29a-893f4c95e226: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-386c23c7-ae47-4898-b29a-893f4c95e226', 'volume_size': 1} Jul 07 08:22:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b558f9da-f053-4db9-87f3-62d87c00fc30 tempest-VolumesServicesTestJSON-447625768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:22:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b558f9da-f053-4db9-87f3-62d87c00fc30 tempest-VolumesServicesTestJSON-447625768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:22:27 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b558f9da-f053-4db9-87f3-62d87c00fc30 tempest-VolumesServicesTestJSON-447625768 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:22:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-499405812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=386c23c7-ae47-4898-b29a-893f4c95e226,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='563e238302fc45c3ae6c44dca37592ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:22:28Z,use_quota=True,user_id='a4ae5d6d01a545bb86c0dd0e0a37d4ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:22:27 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-b558f9da-f053-4db9-87f3-62d87c00fc30 tempest-VolumesServicesTestJSON-447625768 None] Creating volume 386c23c7-ae47-4898-b29a-893f4c95e226 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:22:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b558f9da-f053-4db9-87f3-62d87c00fc30 tempest-VolumesServicesTestJSON-447625768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:22:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b558f9da-f053-4db9-87f3-62d87c00fc30 tempest-VolumesServicesTestJSON-447625768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:22:27 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b558f9da-f053-4db9-87f3-62d87c00fc30 tempest-VolumesServicesTestJSON-447625768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:22:27 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b558f9da-f053-4db9-87f3-62d87c00fc30 tempest-VolumesServicesTestJSON-447625768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:22:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b558f9da-f053-4db9-87f3-62d87c00fc30 tempest-VolumesServicesTestJSON-447625768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:22:27 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b558f9da-f053-4db9-87f3-62d87c00fc30 tempest-VolumesServicesTestJSON-447625768 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:22:27 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-b558f9da-f053-4db9-87f3-62d87c00fc30 tempest-VolumesServicesTestJSON-447625768 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:22:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b558f9da-f053-4db9-87f3-62d87c00fc30 tempest-VolumesServicesTestJSON-447625768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-386c23c7-ae47-4898-b29a-893f4c95e226 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:27 devstack sudo[95960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-386c23c7-ae47-4898-b29a-893f4c95e226 1073741824 Jul 07 08:22:27 devstack sudo[95960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:27 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1eb2b1e-dfdd-4365-b1c1-a24c7ba26f67 tempest-VolumesGetTest-684624965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:22:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a1eb2b1e-dfdd-4365-b1c1-a24c7ba26f67 tempest-VolumesGetTest-684624965 None] Flow 'volume_create_manager' (abf3ffba-0824-41ee-abad-f9730bf1907b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:22:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a1eb2b1e-dfdd-4365-b1c1-a24c7ba26f67 tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c97ba3b7-34b1-4541-a5e9-4305a0bc8acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a1eb2b1e-dfdd-4365-b1c1-a24c7ba26f67 tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c97ba3b7-34b1-4541-a5e9-4305a0bc8acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:22:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-208030112',display_name='tempest-VolumesGetTest-Volume-799745813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaa92489-2dd7-4e62-826b-b241a4993f7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2c16b6b1b494f40ab8446df3b7cafb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:22:28Z,use_quota=True,user_id='7f12dfe390174445ac6a473704f10545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a1eb2b1e-dfdd-4365-b1c1-a24c7ba26f67 tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01ee9f8c-b3f4-4dc6-bbaa-6fc62126c028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a1eb2b1e-dfdd-4365-b1c1-a24c7ba26f67 tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01ee9f8c-b3f4-4dc6-bbaa-6fc62126c028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a1eb2b1e-dfdd-4365-b1c1-a24c7ba26f67 tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f9ba323-8709-4210-b01b-4bb755dbda72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a1eb2b1e-dfdd-4365-b1c1-a24c7ba26f67 tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f9ba323-8709-4210-b01b-4bb755dbda72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aaa92489-2dd7-4e62-826b-b241a4993f7e', 'volume_name': 'volume-aaa92489-2dd7-4e62-826b-b241a4993f7e', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a1eb2b1e-dfdd-4365-b1c1-a24c7ba26f67 tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7251a5ae-0934-402e-82bb-055e6d51d686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a1eb2b1e-dfdd-4365-b1c1-a24c7ba26f67 tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7251a5ae-0934-402e-82bb-055e6d51d686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a1eb2b1e-dfdd-4365-b1c1-a24c7ba26f67 tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (275f0e39-6b92-4450-9195-da56c2c133d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:27 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-a1eb2b1e-dfdd-4365-b1c1-a24c7ba26f67 tempest-VolumesGetTest-684624965 None] Volume aaa92489-2dd7-4e62-826b-b241a4993f7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aaa92489-2dd7-4e62-826b-b241a4993f7e', 'volume_size': 1} Jul 07 08:22:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a1eb2b1e-dfdd-4365-b1c1-a24c7ba26f67 tempest-VolumesGetTest-684624965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:22:28 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:22:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] Flow 'volume_create_manager' (bf36ff5b-28df-4dcf-a3a8-5d3e17128ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:22:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dfb30d8-4032-4b2b-9e63-ca70d7cf7a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dfb30d8-4032-4b2b-9e63-ca70d7cf7a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-505013408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6fcb14b-9e56-40ce-aff8-f0ef870d5dff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce7d9e0352bf46058a2ed9f3a70ac272',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:22:28Z,use_quota=True,user_id='4dc6f80aed874192a7a7b50f72e03b43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (568700cf-aaef-4052-8a43-31b68d0566f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (568700cf-aaef-4052-8a43-31b68d0566f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cceb285-116d-499a-b0a6-5a52c4dce769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:28 devstack cinder-volume[87199]: DEBUG cinder.image.glance [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] Creating Keystone auth plugin from conf {{(pid=87199) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 08:22:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cceb285-116d-499a-b0a6-5a52c4dce769) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b6fcb14b-9e56-40ce-aff8-f0ef870d5dff', 'volume_name': 'volume-b6fcb14b-9e56-40ce-aff8-f0ef870d5dff', 'volume_size': 1, 'image_id': '276bad5d-feb0-4ba2-a219-18ecf721ff14', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/276bad5d-feb0-4ba2-a219-18ecf721ff14', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '616624e32aa447818ca627e0bb0985c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '276bad5d-feb0-4ba2-a219-18ecf721ff14', 'created_at': datetime.datetime(2026, 7, 7, 6, 6, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 6, 6, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/276bad5d-feb0-4ba2-a219-18ecf721ff14/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4f82e28-f45a-47c6-af42-bf24f729a6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4f82e28-f45a-47c6-af42-bf24f729a6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15a3fce4-4589-40f4-965a-857821448109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:28 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] Volume b6fcb14b-9e56-40ce-aff8-f0ef870d5dff: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b6fcb14b-9e56-40ce-aff8-f0ef870d5dff', 'volume_size': 1, 'image_id': '276bad5d-feb0-4ba2-a219-18ecf721ff14', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/276bad5d-feb0-4ba2-a219-18ecf721ff14', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '616624e32aa447818ca627e0bb0985c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '276bad5d-feb0-4ba2-a219-18ecf721ff14', 'created_at': datetime.datetime(2026, 7, 7, 6, 6, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 6, 6, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/276bad5d-feb0-4ba2-a219-18ecf721ff14/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 07 08:22:28 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] Trying to clone b6fcb14b-9e56-40ce-aff8-f0ef870d5dff from image 276bad5d-feb0-4ba2-a219-18ecf721ff14 at location (None, [{'url': 'file:///opt/stack/data/glance/images/276bad5d-feb0-4ba2-a219-18ecf721ff14', 'metadata': {}}]). {{(pid=87199) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 08:22:28 devstack sudo[95960]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b558f9da-f053-4db9-87f3-62d87c00fc30 tempest-VolumesServicesTestJSON-447625768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-386c23c7-ae47-4898-b29a-893f4c95e226 1073741824" returned: 0 in 1.247s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:28 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_276bad5d-feb0-4ba2-a219-18ecf721ff14_ba8ieon4devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87199) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 08:22:28 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] Image download 20.69 MB at 20.69 MB/s Jul 07 08:22:29 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[6747a09e-b2ea-4c8f-aab2-8bcc0a58d9ec]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:22:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_276bad5d-feb0-4ba2-a219-18ecf721ff14_ba8ieon4devstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b558f9da-f053-4db9-87f3-62d87c00fc30 tempest-VolumesServicesTestJSON-447625768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-386c23c7-ae47-4898-b29a-893f4c95e226 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:29 devstack sudo[95989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-386c23c7-ae47-4898-b29a-893f4c95e226 Jul 07 08:22:29 devstack sudo[95989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:29 devstack sudo[95988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_276bad5d-feb0-4ba2-a219-18ecf721ff14_ba8ieon4devstack@QuobyteHD Jul 07 08:22:29 devstack sudo[95988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:29 devstack sudo[95989]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b558f9da-f053-4db9-87f3-62d87c00fc30 tempest-VolumesServicesTestJSON-447625768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-386c23c7-ae47-4898-b29a-893f4c95e226" returned: 0 in 0.672s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:29 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b558f9da-f053-4db9-87f3-62d87c00fc30 tempest-VolumesServicesTestJSON-447625768 None] <== create_volume: return (2018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:22:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b558f9da-f053-4db9-87f3-62d87c00fc30 tempest-VolumesServicesTestJSON-447625768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.021s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:22:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a1eb2b1e-dfdd-4365-b1c1-a24c7ba26f67 tempest-VolumesGetTest-684624965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.783s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:22:29 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a1eb2b1e-dfdd-4365-b1c1-a24c7ba26f67 tempest-VolumesGetTest-684624965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:22:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-208030112',display_name='tempest-VolumesGetTest-Volume-799745813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaa92489-2dd7-4e62-826b-b241a4993f7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2c16b6b1b494f40ab8446df3b7cafb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:22:28Z,use_quota=True,user_id='7f12dfe390174445ac6a473704f10545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:22:29 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-a1eb2b1e-dfdd-4365-b1c1-a24c7ba26f67 tempest-VolumesGetTest-684624965 None] Creating volume aaa92489-2dd7-4e62-826b-b241a4993f7e {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:22:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a1eb2b1e-dfdd-4365-b1c1-a24c7ba26f67 tempest-VolumesGetTest-684624965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:22:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a1eb2b1e-dfdd-4365-b1c1-a24c7ba26f67 tempest-VolumesGetTest-684624965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:22:29 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a1eb2b1e-dfdd-4365-b1c1-a24c7ba26f67 tempest-VolumesGetTest-684624965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:22:29 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a1eb2b1e-dfdd-4365-b1c1-a24c7ba26f67 tempest-VolumesGetTest-684624965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:22:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a1eb2b1e-dfdd-4365-b1c1-a24c7ba26f67 tempest-VolumesGetTest-684624965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:22:29 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a1eb2b1e-dfdd-4365-b1c1-a24c7ba26f67 tempest-VolumesGetTest-684624965 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:22:29 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-a1eb2b1e-dfdd-4365-b1c1-a24c7ba26f67 tempest-VolumesGetTest-684624965 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:22:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a1eb2b1e-dfdd-4365-b1c1-a24c7ba26f67 tempest-VolumesGetTest-684624965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-aaa92489-2dd7-4e62-826b-b241a4993f7e 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:29 devstack sudo[95993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-aaa92489-2dd7-4e62-826b-b241a4993f7e 1073741824 Jul 07 08:22:29 devstack sudo[95993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b558f9da-f053-4db9-87f3-62d87c00fc30 tempest-VolumesServicesTestJSON-447625768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80aab7ab-aca7-46c8-be64-643461a4c3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-386c23c7-ae47-4898-b29a-893f4c95e226', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b558f9da-f053-4db9-87f3-62d87c00fc30 tempest-VolumesServicesTestJSON-447625768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (361abdb2-8c6a-4d6d-afec-6dfe4a578a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:29 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-b558f9da-f053-4db9-87f3-62d87c00fc30 tempest-VolumesServicesTestJSON-447625768 None] Volume volume-386c23c7-ae47-4898-b29a-893f4c95e226 (386c23c7-ae47-4898-b29a-893f4c95e226): created successfully Jul 07 08:22:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b558f9da-f053-4db9-87f3-62d87c00fc30 tempest-VolumesServicesTestJSON-447625768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (361abdb2-8c6a-4d6d-afec-6dfe4a578a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b558f9da-f053-4db9-87f3-62d87c00fc30 tempest-VolumesServicesTestJSON-447625768 None] Flow 'volume_create_manager' (cdf6f8e0-f4d8-40de-a2b3-6067b83eb274) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:22:29 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-b558f9da-f053-4db9-87f3-62d87c00fc30 tempest-VolumesServicesTestJSON-447625768 None] Created volume successfully. Jul 07 08:22:29 devstack sudo[95988]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_276bad5d-feb0-4ba2-a219-18ecf721ff14_ba8ieon4devstack@QuobyteHD" returned: 0 in 0.853s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:29 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] Temporary image 276bad5d-feb0-4ba2-a219-18ecf721ff14 is fetched for user 4dc6f80aed874192a7a7b50f72e03b43. {{(pid=87199) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 08:22:29 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[94725250-c6f4-4d81-8250-8cefc85f6860]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:22:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_276bad5d-feb0-4ba2-a219-18ecf721ff14_ba8ieon4devstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:30 devstack sudo[95998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_276bad5d-feb0-4ba2-a219-18ecf721ff14_ba8ieon4devstack@QuobyteHD Jul 07 08:22:30 devstack sudo[95998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:30 devstack sudo[95993]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a1eb2b1e-dfdd-4365-b1c1-a24c7ba26f67 tempest-VolumesGetTest-684624965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-aaa92489-2dd7-4e62-826b-b241a4993f7e 1073741824" returned: 0 in 0.851s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a1eb2b1e-dfdd-4365-b1c1-a24c7ba26f67 tempest-VolumesGetTest-684624965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-aaa92489-2dd7-4e62-826b-b241a4993f7e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:30 devstack sudo[96003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-aaa92489-2dd7-4e62-826b-b241a4993f7e Jul 07 08:22:30 devstack sudo[96003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:30 devstack sudo[95998]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_276bad5d-feb0-4ba2-a219-18ecf721ff14_ba8ieon4devstack@QuobyteHD" returned: 0 in 0.840s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:22:30 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-1080fb50-b4d8-434f-8783-663d036a2073 tempest-VolumesServicesTestJSON-447625768 None] Acquiring lock "cinder-386c23c7-ae47-4898-b29a-893f4c95e226-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:22:30 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-1080fb50-b4d8-434f-8783-663d036a2073 tempest-VolumesServicesTestJSON-447625768 None] Lock "cinder-386c23c7-ae47-4898-b29a-893f4c95e226-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:22:30 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-1080fb50-b4d8-434f-8783-663d036a2073 tempest-VolumesServicesTestJSON-447625768 None] Acquiring lock "cinder-quobyte-386c23c7-ae47-4898-b29a-893f4c95e226" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:22:30 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-1080fb50-b4d8-434f-8783-663d036a2073 tempest-VolumesServicesTestJSON-447625768 None] Lock "cinder-quobyte-386c23c7-ae47-4898-b29a-893f4c95e226" acquired by "delete_volume" :: waited 0.024s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:22:31 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[a980cb26-f9ac-49b3-9d91-afbb3d025339]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:22:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1080fb50-b4d8-434f-8783-663d036a2073 tempest-VolumesServicesTestJSON-447625768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-386c23c7-ae47-4898-b29a-893f4c95e226 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:31 devstack sudo[96009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-386c23c7-ae47-4898-b29a-893f4c95e226 Jul 07 08:22:31 devstack sudo[96009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:31 devstack sudo[96003]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a1eb2b1e-dfdd-4365-b1c1-a24c7ba26f67 tempest-VolumesGetTest-684624965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-aaa92489-2dd7-4e62-826b-b241a4993f7e" returned: 0 in 0.711s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:31 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a1eb2b1e-dfdd-4365-b1c1-a24c7ba26f67 tempest-VolumesGetTest-684624965 None] <== create_volume: return (1608ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:22:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a1eb2b1e-dfdd-4365-b1c1-a24c7ba26f67 tempest-VolumesGetTest-684624965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.611s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:22:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.539s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:22:31 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-505013408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6fcb14b-9e56-40ce-aff8-f0ef870d5dff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce7d9e0352bf46058a2ed9f3a70ac272',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:22:28Z,use_quota=True,user_id='4dc6f80aed874192a7a7b50f72e03b43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:22:31 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] Creating volume b6fcb14b-9e56-40ce-aff8-f0ef870d5dff {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:22:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:22:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:22:31 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:22:31 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:22:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:22:31 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:22:31 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:22:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b6fcb14b-9e56-40ce-aff8-f0ef870d5dff 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:31 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a1eb2b1e-dfdd-4365-b1c1-a24c7ba26f67 tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (275f0e39-6b92-4450-9195-da56c2c133d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aaa92489-2dd7-4e62-826b-b241a4993f7e', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:31 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a1eb2b1e-dfdd-4365-b1c1-a24c7ba26f67 tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c2ea9bd-be26-41aa-959c-3c1f760d5039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:31 devstack sudo[96012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b6fcb14b-9e56-40ce-aff8-f0ef870d5dff 1073741824 Jul 07 08:22:31 devstack sudo[96012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:31 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-a1eb2b1e-dfdd-4365-b1c1-a24c7ba26f67 tempest-VolumesGetTest-684624965 None] Volume volume-aaa92489-2dd7-4e62-826b-b241a4993f7e (aaa92489-2dd7-4e62-826b-b241a4993f7e): created successfully Jul 07 08:22:31 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a1eb2b1e-dfdd-4365-b1c1-a24c7ba26f67 tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c2ea9bd-be26-41aa-959c-3c1f760d5039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:31 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a1eb2b1e-dfdd-4365-b1c1-a24c7ba26f67 tempest-VolumesGetTest-684624965 None] Flow 'volume_create_manager' (abf3ffba-0824-41ee-abad-f9730bf1907b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:22:31 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-a1eb2b1e-dfdd-4365-b1c1-a24c7ba26f67 tempest-VolumesGetTest-684624965 None] Created volume successfully. Jul 07 08:22:31 devstack sudo[96009]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1080fb50-b4d8-434f-8783-663d036a2073 tempest-VolumesServicesTestJSON-447625768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-386c23c7-ae47-4898-b29a-893f4c95e226" returned: 0 in 0.834s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1080fb50-b4d8-434f-8783-663d036a2073 tempest-VolumesServicesTestJSON-447625768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-386c23c7-ae47-4898-b29a-893f4c95e226 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:31 devstack sudo[96017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-386c23c7-ae47-4898-b29a-893f4c95e226 Jul 07 08:22:31 devstack sudo[96017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:32 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-50b7e74a-2d04-468d-ae6e-e3289e81206f tempest-VolumesGetTest-684624965 None] Acquiring lock "cinder-aaa92489-2dd7-4e62-826b-b241a4993f7e-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:22:32 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-50b7e74a-2d04-468d-ae6e-e3289e81206f tempest-VolumesGetTest-684624965 None] Lock "cinder-aaa92489-2dd7-4e62-826b-b241a4993f7e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:22:32 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-50b7e74a-2d04-468d-ae6e-e3289e81206f tempest-VolumesGetTest-684624965 None] Acquiring lock "cinder-quobyte-aaa92489-2dd7-4e62-826b-b241a4993f7e" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:22:32 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-50b7e74a-2d04-468d-ae6e-e3289e81206f tempest-VolumesGetTest-684624965 None] Lock "cinder-quobyte-aaa92489-2dd7-4e62-826b-b241a4993f7e" acquired by "delete_volume" :: waited 0.025s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:22:32 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a46b64-8820-4711-9fed-fe03911747ae]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:22:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-50b7e74a-2d04-468d-ae6e-e3289e81206f tempest-VolumesGetTest-684624965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-aaa92489-2dd7-4e62-826b-b241a4993f7e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:32 devstack sudo[96023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-aaa92489-2dd7-4e62-826b-b241a4993f7e Jul 07 08:22:32 devstack sudo[96023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:32 devstack sudo[96012]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b6fcb14b-9e56-40ce-aff8-f0ef870d5dff 1073741824" returned: 0 in 0.923s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b6fcb14b-9e56-40ce-aff8-f0ef870d5dff {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:32 devstack sudo[96025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b6fcb14b-9e56-40ce-aff8-f0ef870d5dff Jul 07 08:22:32 devstack sudo[96025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:32 devstack sudo[96017]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1080fb50-b4d8-434f-8783-663d036a2073 tempest-VolumesServicesTestJSON-447625768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-386c23c7-ae47-4898-b29a-893f4c95e226" returned: 0 in 0.709s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:32 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-1080fb50-b4d8-434f-8783-663d036a2073 tempest-VolumesServicesTestJSON-447625768 None] Lock "cinder-quobyte-386c23c7-ae47-4898-b29a-893f4c95e226" released by "delete_volume" :: held 1.586s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:22:32 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-1080fb50-b4d8-434f-8783-663d036a2073 tempest-VolumesServicesTestJSON-447625768 None] Created reservations ['110d6580-2756-433b-8096-9e48c64d1cc5', '557a3d8d-7f82-411d-abac-e41584d0d57a', '5f13a478-bcee-4d10-a3a3-860263d24028', '708d7955-70a2-422b-876b-8516311a8871'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:22:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1080fb50-b4d8-434f-8783-663d036a2073 tempest-VolumesServicesTestJSON-447625768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:22:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1080fb50-b4d8-434f-8783-663d036a2073 tempest-VolumesServicesTestJSON-447625768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:22:32 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1080fb50-b4d8-434f-8783-663d036a2073 tempest-VolumesServicesTestJSON-447625768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:22:32 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1080fb50-b4d8-434f-8783-663d036a2073 tempest-VolumesServicesTestJSON-447625768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:22:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1080fb50-b4d8-434f-8783-663d036a2073 tempest-VolumesServicesTestJSON-447625768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:22:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1080fb50-b4d8-434f-8783-663d036a2073 tempest-VolumesServicesTestJSON-447625768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:32 devstack sudo[96028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:22:32 devstack sudo[96028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:33 devstack sudo[96025]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b6fcb14b-9e56-40ce-aff8-f0ef870d5dff" returned: 0 in 0.654s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:33 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] <== create_volume: return (1641ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:22:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.645s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:22:33 devstack sudo[96023]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-50b7e74a-2d04-468d-ae6e-e3289e81206f tempest-VolumesGetTest-684624965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-aaa92489-2dd7-4e62-826b-b241a4993f7e" returned: 0 in 0.850s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-50b7e74a-2d04-468d-ae6e-e3289e81206f tempest-VolumesGetTest-684624965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-aaa92489-2dd7-4e62-826b-b241a4993f7e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:33 devstack cinder-volume[87199]: DEBUG cinder.volume.volume_utils [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] Attempting download of 276bad5d-feb0-4ba2-a219-18ecf721ff14 ((None, [{'url': 'file:///opt/stack/data/glance/images/276bad5d-feb0-4ba2-a219-18ecf721ff14', 'metadata': {}}])) to volume b6fcb14b-9e56-40ce-aff8-f0ef870d5dff. {{(pid=87199) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 08:22:33 devstack sudo[96034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-aaa92489-2dd7-4e62-826b-b241a4993f7e Jul 07 08:22:33 devstack sudo[96034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:33 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8beba3b-93e4-4070-8172-86578d5bb592]: (4, 'raw') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:22:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_276bad5d-feb0-4ba2-a219-18ecf721ff14_xu82ldz5 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:33 devstack sudo[96036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_276bad5d-feb0-4ba2-a219-18ecf721ff14_xu82ldz5 Jul 07 08:22:33 devstack sudo[96036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:33 devstack sudo[96028]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1080fb50-b4d8-434f-8783-663d036a2073 tempest-VolumesServicesTestJSON-447625768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.738s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:33 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-1080fb50-b4d8-434f-8783-663d036a2073 tempest-VolumesServicesTestJSON-447625768 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:22:33 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-1080fb50-b4d8-434f-8783-663d036a2073 tempest-VolumesServicesTestJSON-447625768 None] Deleted volume successfully. Jul 07 08:22:33 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-1080fb50-b4d8-434f-8783-663d036a2073 tempest-VolumesServicesTestJSON-447625768 None] Lock "cinder-386c23c7-ae47-4898-b29a-893f4c95e226-delete_volume" released by "delete_volume" :: held 2.561s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:22:33 devstack sudo[96034]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-50b7e74a-2d04-468d-ae6e-e3289e81206f tempest-VolumesGetTest-684624965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-aaa92489-2dd7-4e62-826b-b241a4993f7e" returned: 0 in 0.763s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:33 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-50b7e74a-2d04-468d-ae6e-e3289e81206f tempest-VolumesGetTest-684624965 None] Lock "cinder-quobyte-aaa92489-2dd7-4e62-826b-b241a4993f7e" released by "delete_volume" :: held 1.658s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:22:33 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-50b7e74a-2d04-468d-ae6e-e3289e81206f tempest-VolumesGetTest-684624965 None] Created reservations ['c0922c28-17b2-4173-84ae-d2400c12c15b', 'ae562a81-cb28-403b-9386-a4dad5f22579', 'e6ed4f60-86cb-4334-a5f5-d0bbe6c28d36', 'ea8e72a6-4e66-4bc0-b4af-d56fca41b9c0'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:22:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-50b7e74a-2d04-468d-ae6e-e3289e81206f tempest-VolumesGetTest-684624965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:22:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-50b7e74a-2d04-468d-ae6e-e3289e81206f tempest-VolumesGetTest-684624965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:22:33 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-50b7e74a-2d04-468d-ae6e-e3289e81206f tempest-VolumesGetTest-684624965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:22:33 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-50b7e74a-2d04-468d-ae6e-e3289e81206f tempest-VolumesGetTest-684624965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:22:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-50b7e74a-2d04-468d-ae6e-e3289e81206f tempest-VolumesGetTest-684624965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:22:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-50b7e74a-2d04-468d-ae6e-e3289e81206f tempest-VolumesGetTest-684624965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:33 devstack sudo[96042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:22:33 devstack sudo[96042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:34 devstack sudo[96036]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_276bad5d-feb0-4ba2-a219-18ecf721ff14_xu82ldz5" returned: 0 in 0.905s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_276bad5d-feb0-4ba2-a219-18ecf721ff14_xu82ldz5 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:34 devstack sudo[96044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_276bad5d-feb0-4ba2-a219-18ecf721ff14_xu82ldz5 Jul 07 08:22:34 devstack sudo[96044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:34 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cd73bfd4-863b-416e-ae3c-24d79afa6251 tempest-VolumesGetTest-684624965 None] Acquiring lock "cinder-00aa0ea0-03b5-4dae-af42-2e13185e84f1-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:22:34 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cd73bfd4-863b-416e-ae3c-24d79afa6251 tempest-VolumesGetTest-684624965 None] Lock "cinder-00aa0ea0-03b5-4dae-af42-2e13185e84f1-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:22:34 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cd73bfd4-863b-416e-ae3c-24d79afa6251 tempest-VolumesGetTest-684624965 None] Acquiring lock "cinder-quobyte-00aa0ea0-03b5-4dae-af42-2e13185e84f1" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:22:34 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cd73bfd4-863b-416e-ae3c-24d79afa6251 tempest-VolumesGetTest-684624965 None] Lock "cinder-quobyte-00aa0ea0-03b5-4dae-af42-2e13185e84f1" acquired by "delete_volume" :: waited 0.020s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:22:34 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5ab8ab-2bf8-46bb-b6e5-c9fa6c4553db]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:22:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cd73bfd4-863b-416e-ae3c-24d79afa6251 tempest-VolumesGetTest-684624965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-00aa0ea0-03b5-4dae-af42-2e13185e84f1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:34 devstack sudo[96042]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-50b7e74a-2d04-468d-ae6e-e3289e81206f tempest-VolumesGetTest-684624965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.780s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:34 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-50b7e74a-2d04-468d-ae6e-e3289e81206f tempest-VolumesGetTest-684624965 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:22:34 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-50b7e74a-2d04-468d-ae6e-e3289e81206f tempest-VolumesGetTest-684624965 None] Deleted volume successfully. Jul 07 08:22:34 devstack sudo[96047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-00aa0ea0-03b5-4dae-af42-2e13185e84f1 Jul 07 08:22:34 devstack sudo[96047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:34 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-50b7e74a-2d04-468d-ae6e-e3289e81206f tempest-VolumesGetTest-684624965 None] Lock "cinder-aaa92489-2dd7-4e62-826b-b241a4993f7e-delete_volume" released by "delete_volume" :: held 2.699s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:22:34 devstack sudo[96044]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_276bad5d-feb0-4ba2-a219-18ecf721ff14_xu82ldz5" returned: 1 in 0.949s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_276bad5d-feb0-4ba2-a219-18ecf721ff14_xu82ldz5' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:22:34 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[91748d66-b797-476f-95dd-90d2d241dd81]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:22:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_276bad5d-feb0-4ba2-a219-18ecf721ff14_ba8ieon4devstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:35 devstack sudo[96051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_276bad5d-feb0-4ba2-a219-18ecf721ff14_ba8ieon4devstack@QuobyteHD Jul 07 08:22:35 devstack sudo[96051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:35 devstack sudo[96047]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cd73bfd4-863b-416e-ae3c-24d79afa6251 tempest-VolumesGetTest-684624965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-00aa0ea0-03b5-4dae-af42-2e13185e84f1" returned: 0 in 0.851s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cd73bfd4-863b-416e-ae3c-24d79afa6251 tempest-VolumesGetTest-684624965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-00aa0ea0-03b5-4dae-af42-2e13185e84f1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:35 devstack sudo[96058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-00aa0ea0-03b5-4dae-af42-2e13185e84f1 Jul 07 08:22:35 devstack sudo[96058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:35 devstack sudo[96051]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_276bad5d-feb0-4ba2-a219-18ecf721ff14_ba8ieon4devstack@QuobyteHD" returned: 0 in 0.936s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:35 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] 276bad5d-feb0-4ba2-a219-18ecf721ff14 was qcow2, converting to raw {{(pid=87199) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 08:22:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_276bad5d-feb0-4ba2-a219-18ecf721ff14_ba8ieon4devstack@QuobyteHD /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b6fcb14b-9e56-40ce-aff8-f0ef870d5dff {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:35 devstack sudo[96063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_276bad5d-feb0-4ba2-a219-18ecf721ff14_ba8ieon4devstack@QuobyteHD /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b6fcb14b-9e56-40ce-aff8-f0ef870d5dff Jul 07 08:22:35 devstack sudo[96063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:36 devstack sudo[96058]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cd73bfd4-863b-416e-ae3c-24d79afa6251 tempest-VolumesGetTest-684624965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-00aa0ea0-03b5-4dae-af42-2e13185e84f1" returned: 0 in 0.885s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:36 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cd73bfd4-863b-416e-ae3c-24d79afa6251 tempest-VolumesGetTest-684624965 None] Lock "cinder-quobyte-00aa0ea0-03b5-4dae-af42-2e13185e84f1" released by "delete_volume" :: held 1.808s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:22:36 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-cd73bfd4-863b-416e-ae3c-24d79afa6251 tempest-VolumesGetTest-684624965 None] Created reservations ['b274a2cf-bf1a-4185-8cfc-ccd8418a4b8c', 'f8709b6e-7452-4557-bfd2-de365d914ed2', 'abbfbc0c-55cf-497d-98e4-b69021832fb7', 'e98f7419-3f8a-4706-a3da-ad1b262e82d4'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:22:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cd73bfd4-863b-416e-ae3c-24d79afa6251 tempest-VolumesGetTest-684624965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:22:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cd73bfd4-863b-416e-ae3c-24d79afa6251 tempest-VolumesGetTest-684624965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:22:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-cd73bfd4-863b-416e-ae3c-24d79afa6251 tempest-VolumesGetTest-684624965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:22:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-cd73bfd4-863b-416e-ae3c-24d79afa6251 tempest-VolumesGetTest-684624965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:22:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cd73bfd4-863b-416e-ae3c-24d79afa6251 tempest-VolumesGetTest-684624965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:22:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cd73bfd4-863b-416e-ae3c-24d79afa6251 tempest-VolumesGetTest-684624965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:36 devstack sudo[96069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:22:36 devstack sudo[96069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:36 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-f11ea3d2-61e1-480b-974f-67ef6e3e9f46 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:22:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f11ea3d2-61e1-480b-974f-67ef6e3e9f46 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] Flow 'volume_create_manager' (0d9a2376-124e-427d-a8e1-8f9590d32364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:22:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f11ea3d2-61e1-480b-974f-67ef6e3e9f46 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be1241e4-a241-45a0-a3a5-bba7d9641b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f11ea3d2-61e1-480b-974f-67ef6e3e9f46 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be1241e4-a241-45a0-a3a5-bba7d9641b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:22:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1605371120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82109665-1ac4-4779-a324-03d89f9901bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ddd5622cc8a456891814d385aa32c5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:22:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:22:37Z,use_quota=True,user_id='18f184506bdc4e44a2972fe300e8f62b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f11ea3d2-61e1-480b-974f-67ef6e3e9f46 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (038ee3f4-143b-4fc2-9f67-b9125f5def3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f11ea3d2-61e1-480b-974f-67ef6e3e9f46 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (038ee3f4-143b-4fc2-9f67-b9125f5def3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f11ea3d2-61e1-480b-974f-67ef6e3e9f46 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0dba154-f288-4f7d-8786-752730cc9296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f11ea3d2-61e1-480b-974f-67ef6e3e9f46 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0dba154-f288-4f7d-8786-752730cc9296) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82109665-1ac4-4779-a324-03d89f9901bd', 'volume_name': 'volume-82109665-1ac4-4779-a324-03d89f9901bd', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f11ea3d2-61e1-480b-974f-67ef6e3e9f46 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65d3a0fc-e0d8-45d7-bd39-9fe7b1f40b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f11ea3d2-61e1-480b-974f-67ef6e3e9f46 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65d3a0fc-e0d8-45d7-bd39-9fe7b1f40b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f11ea3d2-61e1-480b-974f-67ef6e3e9f46 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07c03c18-c39a-4e26-95ba-0ff085676c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:36 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-f11ea3d2-61e1-480b-974f-67ef6e3e9f46 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] Volume 82109665-1ac4-4779-a324-03d89f9901bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82109665-1ac4-4779-a324-03d89f9901bd', 'volume_size': 1} Jul 07 08:22:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f11ea3d2-61e1-480b-974f-67ef6e3e9f46 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:22:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f11ea3d2-61e1-480b-974f-67ef6e3e9f46 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:22:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f11ea3d2-61e1-480b-974f-67ef6e3e9f46 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:22:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1605371120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82109665-1ac4-4779-a324-03d89f9901bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ddd5622cc8a456891814d385aa32c5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:22:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:22:37Z,use_quota=True,user_id='18f184506bdc4e44a2972fe300e8f62b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:22:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-f11ea3d2-61e1-480b-974f-67ef6e3e9f46 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] Creating volume 82109665-1ac4-4779-a324-03d89f9901bd {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:22:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f11ea3d2-61e1-480b-974f-67ef6e3e9f46 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:22:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f11ea3d2-61e1-480b-974f-67ef6e3e9f46 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:22:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f11ea3d2-61e1-480b-974f-67ef6e3e9f46 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:22:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f11ea3d2-61e1-480b-974f-67ef6e3e9f46 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:22:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f11ea3d2-61e1-480b-974f-67ef6e3e9f46 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:22:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f11ea3d2-61e1-480b-974f-67ef6e3e9f46 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:22:36 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-f11ea3d2-61e1-480b-974f-67ef6e3e9f46 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:22:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f11ea3d2-61e1-480b-974f-67ef6e3e9f46 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-82109665-1ac4-4779-a324-03d89f9901bd 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:36 devstack sudo[96078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-82109665-1ac4-4779-a324-03d89f9901bd 1073741824 Jul 07 08:22:36 devstack sudo[96078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:37 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-5abf4e1a-c3b9-4d01-9711-0697545f988e tempest-VolumesGetTest-684624965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:22:37 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5abf4e1a-c3b9-4d01-9711-0697545f988e tempest-VolumesGetTest-684624965 None] Flow 'volume_create_manager' (8515d71d-d331-4da4-a60d-b8e7d087dd36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:22:37 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5abf4e1a-c3b9-4d01-9711-0697545f988e tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da1c47dd-450f-44ea-9503-89475ef98c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:37 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5abf4e1a-c3b9-4d01-9711-0697545f988e tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da1c47dd-450f-44ea-9503-89475ef98c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:22:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2055382120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecf0c72a-8899-4ede-83ba-1a4b3a5aceab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2c16b6b1b494f40ab8446df3b7cafb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:22:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:22:37Z,use_quota=True,user_id='7f12dfe390174445ac6a473704f10545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:37 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5abf4e1a-c3b9-4d01-9711-0697545f988e tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e312f959-058d-48c7-a2c5-e0006e97d36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:37 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5abf4e1a-c3b9-4d01-9711-0697545f988e tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e312f959-058d-48c7-a2c5-e0006e97d36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:37 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5abf4e1a-c3b9-4d01-9711-0697545f988e tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a50cc47a-fced-4a1b-9de6-76a8eda420d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:37 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5abf4e1a-c3b9-4d01-9711-0697545f988e tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a50cc47a-fced-4a1b-9de6-76a8eda420d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecf0c72a-8899-4ede-83ba-1a4b3a5aceab', 'volume_name': 'volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:37 devstack sudo[96069]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:37 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5abf4e1a-c3b9-4d01-9711-0697545f988e tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc4af333-f713-4163-8019-56094807f07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:37 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5abf4e1a-c3b9-4d01-9711-0697545f988e tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc4af333-f713-4163-8019-56094807f07b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:37 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5abf4e1a-c3b9-4d01-9711-0697545f988e tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4ccaea1-0a6e-430e-bf25-f366c496c3ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:37 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-5abf4e1a-c3b9-4d01-9711-0697545f988e tempest-VolumesGetTest-684624965 None] Volume ecf0c72a-8899-4ede-83ba-1a4b3a5aceab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab', 'volume_size': 1} Jul 07 08:22:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-5abf4e1a-c3b9-4d01-9711-0697545f988e tempest-VolumesGetTest-684624965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:22:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cd73bfd4-863b-416e-ae3c-24d79afa6251 tempest-VolumesGetTest-684624965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 1.039s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:37 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-cd73bfd4-863b-416e-ae3c-24d79afa6251 tempest-VolumesGetTest-684624965 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:22:37 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-cd73bfd4-863b-416e-ae3c-24d79afa6251 tempest-VolumesGetTest-684624965 None] Deleted volume successfully. Jul 07 08:22:37 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cd73bfd4-863b-416e-ae3c-24d79afa6251 tempest-VolumesGetTest-684624965 None] Lock "cinder-00aa0ea0-03b5-4dae-af42-2e13185e84f1-delete_volume" released by "delete_volume" :: held 3.226s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:22:38 devstack sudo[96078]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f11ea3d2-61e1-480b-974f-67ef6e3e9f46 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-82109665-1ac4-4779-a324-03d89f9901bd 1073741824" returned: 0 in 1.145s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f11ea3d2-61e1-480b-974f-67ef6e3e9f46 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-82109665-1ac4-4779-a324-03d89f9901bd {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:38 devstack sudo[96086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-82109665-1ac4-4779-a324-03d89f9901bd Jul 07 08:22:38 devstack sudo[96086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:38 devstack sudo[96063]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_276bad5d-feb0-4ba2-a219-18ecf721ff14_ba8ieon4devstack@QuobyteHD /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b6fcb14b-9e56-40ce-aff8-f0ef870d5dff" returned: 0 in 2.448s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:38 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_276bad5d-feb0-4ba2-a219-18ecf721ff14_ba8ieon4devstack@QuobyteHD, size 112.00 MB, duration 2.45 sec, destination /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b6fcb14b-9e56-40ce-aff8-f0ef870d5dff {{(pid=87199) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 08:22:38 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] Converted 112.00 MB image at 45.73 MB/s Jul 07 08:22:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b6fcb14b-9e56-40ce-aff8-f0ef870d5dff 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:38 devstack sudo[96088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b6fcb14b-9e56-40ce-aff8-f0ef870d5dff 1G Jul 07 08:22:38 devstack sudo[96088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:38 devstack sudo[96086]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f11ea3d2-61e1-480b-974f-67ef6e3e9f46 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-82109665-1ac4-4779-a324-03d89f9901bd" returned: 0 in 0.712s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:38 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f11ea3d2-61e1-480b-974f-67ef6e3e9f46 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] <== create_volume: return (1906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:22:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f11ea3d2-61e1-480b-974f-67ef6e3e9f46 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.909s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:22:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-5abf4e1a-c3b9-4d01-9711-0697545f988e tempest-VolumesGetTest-684624965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.144s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:22:38 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-5abf4e1a-c3b9-4d01-9711-0697545f988e tempest-VolumesGetTest-684624965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:22:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2055382120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecf0c72a-8899-4ede-83ba-1a4b3a5aceab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2c16b6b1b494f40ab8446df3b7cafb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:22:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:22:37Z,use_quota=True,user_id='7f12dfe390174445ac6a473704f10545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:22:38 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-5abf4e1a-c3b9-4d01-9711-0697545f988e tempest-VolumesGetTest-684624965 None] Creating volume ecf0c72a-8899-4ede-83ba-1a4b3a5aceab {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:22:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-5abf4e1a-c3b9-4d01-9711-0697545f988e tempest-VolumesGetTest-684624965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:22:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-5abf4e1a-c3b9-4d01-9711-0697545f988e tempest-VolumesGetTest-684624965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:22:38 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-5abf4e1a-c3b9-4d01-9711-0697545f988e tempest-VolumesGetTest-684624965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:22:38 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-5abf4e1a-c3b9-4d01-9711-0697545f988e tempest-VolumesGetTest-684624965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:22:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-5abf4e1a-c3b9-4d01-9711-0697545f988e tempest-VolumesGetTest-684624965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:22:38 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-5abf4e1a-c3b9-4d01-9711-0697545f988e tempest-VolumesGetTest-684624965 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:22:38 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-5abf4e1a-c3b9-4d01-9711-0697545f988e tempest-VolumesGetTest-684624965 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:22:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5abf4e1a-c3b9-4d01-9711-0697545f988e tempest-VolumesGetTest-684624965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:38 devstack sudo[96091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab 1073741824 Jul 07 08:22:38 devstack sudo[96091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f11ea3d2-61e1-480b-974f-67ef6e3e9f46 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07c03c18-c39a-4e26-95ba-0ff085676c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82109665-1ac4-4779-a324-03d89f9901bd', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f11ea3d2-61e1-480b-974f-67ef6e3e9f46 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d429e62a-d7f3-436b-bcc4-8c1d1ad8314b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:38 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-f11ea3d2-61e1-480b-974f-67ef6e3e9f46 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] Volume volume-82109665-1ac4-4779-a324-03d89f9901bd (82109665-1ac4-4779-a324-03d89f9901bd): created successfully Jul 07 08:22:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f11ea3d2-61e1-480b-974f-67ef6e3e9f46 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d429e62a-d7f3-436b-bcc4-8c1d1ad8314b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f11ea3d2-61e1-480b-974f-67ef6e3e9f46 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] Flow 'volume_create_manager' (0d9a2376-124e-427d-a8e1-8f9590d32364) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:22:38 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-f11ea3d2-61e1-480b-974f-67ef6e3e9f46 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] Created volume successfully. Jul 07 08:22:39 devstack sudo[96088]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b6fcb14b-9e56-40ce-aff8-f0ef870d5dff 1G" returned: 0 in 0.815s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:39 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[77805818-18fa-4145-a293-2cbb4067d518]: (4, 'raw') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:22:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b6fcb14b-9e56-40ce-aff8-f0ef870d5dff {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:39 devstack sudo[96096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b6fcb14b-9e56-40ce-aff8-f0ef870d5dff Jul 07 08:22:39 devstack sudo[96096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:39 devstack sudo[96091]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5abf4e1a-c3b9-4d01-9711-0697545f988e tempest-VolumesGetTest-684624965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab 1073741824" returned: 0 in 0.941s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5abf4e1a-c3b9-4d01-9711-0697545f988e tempest-VolumesGetTest-684624965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:39 devstack sudo[96101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab Jul 07 08:22:39 devstack sudo[96101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:40 devstack sudo[96096]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b6fcb14b-9e56-40ce-aff8-f0ef870d5dff" returned: 0 in 0.883s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b6fcb14b-9e56-40ce-aff8-f0ef870d5dff {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:40 devstack sudo[96108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b6fcb14b-9e56-40ce-aff8-f0ef870d5dff Jul 07 08:22:40 devstack sudo[96108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:40 devstack sudo[96101]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5abf4e1a-c3b9-4d01-9711-0697545f988e tempest-VolumesGetTest-684624965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab" returned: 0 in 0.761s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:40 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-5abf4e1a-c3b9-4d01-9711-0697545f988e tempest-VolumesGetTest-684624965 None] <== create_volume: return (1769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:22:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-5abf4e1a-c3b9-4d01-9711-0697545f988e tempest-VolumesGetTest-684624965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.772s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:22:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5abf4e1a-c3b9-4d01-9711-0697545f988e tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4ccaea1-0a6e-430e-bf25-f366c496c3ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5abf4e1a-c3b9-4d01-9711-0697545f988e tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee73265c-e97f-41f2-99ec-f0b49994db8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:40 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-5abf4e1a-c3b9-4d01-9711-0697545f988e tempest-VolumesGetTest-684624965 None] Volume volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab (ecf0c72a-8899-4ede-83ba-1a4b3a5aceab): created successfully Jul 07 08:22:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5abf4e1a-c3b9-4d01-9711-0697545f988e tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee73265c-e97f-41f2-99ec-f0b49994db8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5abf4e1a-c3b9-4d01-9711-0697545f988e tempest-VolumesGetTest-684624965 None] Flow 'volume_create_manager' (8515d71d-d331-4da4-a60d-b8e7d087dd36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:22:40 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-5abf4e1a-c3b9-4d01-9711-0697545f988e tempest-VolumesGetTest-684624965 None] Created volume successfully. Jul 07 08:22:40 devstack sudo[96108]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b6fcb14b-9e56-40ce-aff8-f0ef870d5dff" returned: 1 in 0.838s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b6fcb14b-9e56-40ce-aff8-f0ef870d5dff' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:22:40 devstack cinder-volume[87199]: DEBUG cinder.volume.volume_utils [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] Downloaded image 276bad5d-feb0-4ba2-a219-18ecf721ff14 ((None, [{'url': 'file:///opt/stack/data/glance/images/276bad5d-feb0-4ba2-a219-18ecf721ff14', 'metadata': {}}])) to volume b6fcb14b-9e56-40ce-aff8-f0ef870d5dff successfully. {{(pid=87199) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 08:22:40 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] Temporary image 276bad5d-feb0-4ba2-a219-18ecf721ff14 for user 4dc6f80aed874192a7a7b50f72e03b43 is deleted. {{(pid=87199) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 08:22:40 devstack cinder-volume[87199]: DEBUG cinder.volume.volume_utils [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] Marking volume b6fcb14b-9e56-40ce-aff8-f0ef870d5dff as bootable. {{(pid=87199) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 08:22:40 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] Copying metadata from image 276bad5d-feb0-4ba2-a219-18ecf721ff14 to b6fcb14b-9e56-40ce-aff8-f0ef870d5dff. {{(pid=87199) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 08:22:40 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] Creating volume glance metadata for volume b6fcb14b-9e56-40ce-aff8-f0ef870d5dff backed by image 276bad5d-feb0-4ba2-a219-18ecf721ff14 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '276bad5d-feb0-4ba2-a219-18ecf721ff14', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87199) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 08:22:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15a3fce4-4589-40f4-965a-857821448109) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6fcb14b-9e56-40ce-aff8-f0ef870d5dff', 'volume_size': 1, 'image_id': '276bad5d-feb0-4ba2-a219-18ecf721ff14', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/276bad5d-feb0-4ba2-a219-18ecf721ff14', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '616624e32aa447818ca627e0bb0985c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '276bad5d-feb0-4ba2-a219-18ecf721ff14', 'created_at': datetime.datetime(2026, 7, 7, 6, 6, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 6, 6, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/276bad5d-feb0-4ba2-a219-18ecf721ff14/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (854d9915-566a-4db5-8bf3-33c4c954e78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:41 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] Volume volume-b6fcb14b-9e56-40ce-aff8-f0ef870d5dff (b6fcb14b-9e56-40ce-aff8-f0ef870d5dff): created successfully Jul 07 08:22:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (854d9915-566a-4db5-8bf3-33c4c954e78d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] Flow 'volume_create_manager' (bf36ff5b-28df-4dcf-a3a8-5d3e17128ebf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:22:41 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-c685ab9f-6660-496d-9421-db41f35d2e34 tempest-VolumesExtendTest-1655891662 None] Created volume successfully. Jul 07 08:22:42 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:22:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] Flow 'volume_create_manager' (e66537fd-5826-4763-b598-5da6c163703d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:22:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3539077d-6de2-4caa-8340-41bcba35d127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3539077d-6de2-4caa-8340-41bcba35d127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:22:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-529936166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c906b66a-f05f-4daf-b13e-e21b76ee4830,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a2c16b6b1b494f40ab8446df3b7cafb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=ecf0c72a-8899-4ede-83ba-1a4b3a5aceab,status='creating',terminated_at=None,updated_at=2026-07-07T06:22:42Z,use_quota=True,user_id='7f12dfe390174445ac6a473704f10545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26b4f230-ad7d-4e37-8430-e7bcfa2e0a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26b4f230-ad7d-4e37-8430-e7bcfa2e0a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3b9cba6-1bc2-4f3c-86ab-228da367ceb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3b9cba6-1bc2-4f3c-86ab-228da367ceb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c906b66a-f05f-4daf-b13e-e21b76ee4830', 'volume_name': 'volume-c906b66a-f05f-4daf-b13e-e21b76ee4830', 'volume_size': 1, 'source_volid': 'ecf0c72a-8899-4ede-83ba-1a4b3a5aceab', 'source_volstatus': 'available'}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0b72aed-eac0-4a26-9075-229cad40ab38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0b72aed-eac0-4a26-9075-229cad40ab38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a7f13e6-1c6e-4834-9836-ee7912b540cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:42 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] Volume c906b66a-f05f-4daf-b13e-e21b76ee4830: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c906b66a-f05f-4daf-b13e-e21b76ee4830', 'volume_size': 1, 'source_volid': 'ecf0c72a-8899-4ede-83ba-1a4b3a5aceab', 'source_volstatus': 'available'} Jul 07 08:22:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:22:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:22:42 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] Cloning volume ecf0c72a-8899-4ede-83ba-1a4b3a5aceab to volume c906b66a-f05f-4daf-b13e-e21b76ee4830 Jul 07 08:22:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] Creating offline snapshot b0049d86-c54b-440b-b083-b4d15f4848be of volume ecf0c72a-8899-4ede-83ba-1a4b3a5aceab {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:22:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-630b2471-9323-49a2-98b7-c46c1cf34712 tempest-VolumesExtendTest-1655891662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:22:42 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c82f20d-38a8-45a7-a9ed-1f5cce117358]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:22:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:42 devstack sudo[96115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab Jul 07 08:22:42 devstack sudo[96115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:43 devstack sudo[96115]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab" returned: 0 in 0.832s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab.b0049d86-c54b-440b-b083-b4d15f4848be 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:43 devstack sudo[96128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab.b0049d86-c54b-440b-b083-b4d15f4848be 1G Jul 07 08:22:43 devstack sudo[96128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-aef5e75a-b7ff-406a-863b-5553d0d307e0 req-7e38fcb1-ba8f-4cf5-847a-3a57adf18e45 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:22:44 devstack sudo[96128]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab.b0049d86-c54b-440b-b083-b4d15f4848be 1G" returned: 0 in 0.870s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab.b0049d86-c54b-440b-b083-b4d15f4848be {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:44 devstack sudo[96134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab.b0049d86-c54b-440b-b083-b4d15f4848be Jul 07 08:22:44 devstack sudo[96134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:44 devstack sudo[96134]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab.b0049d86-c54b-440b-b083-b4d15f4848be" returned: 0 in 0.688s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:44 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab.b0049d86-c54b-440b-b083-b4d15f4848be is being set with open permissions: ugo+rw Jul 07 08:22:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab.b0049d86-c54b-440b-b083-b4d15f4848be {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:44 devstack sudo[96141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab.b0049d86-c54b-440b-b083-b4d15f4848be Jul 07 08:22:44 devstack sudo[96141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:45 devstack sudo[96141]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab.b0049d86-c54b-440b-b083-b4d15f4848be" returned: 0 in 0.716s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:45 devstack sudo[96144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab.info Jul 07 08:22:45 devstack sudo[96144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:46 devstack sudo[96144]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab.info" returned: 0 in 0.756s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:46 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab.info is being set with open permissions: ugo+rw Jul 07 08:22:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:46 devstack sudo[96153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab.info Jul 07 08:22:46 devstack sudo[96153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:47 devstack sudo[96153]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab.info" returned: 0 in 0.677s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:47 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] Acquiring lock "cinder-quobyte-c906b66a-f05f-4daf-b13e-e21b76ee4830" by "_copy_volume_from_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:22:47 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] Lock "cinder-quobyte-c906b66a-f05f-4daf-b13e-e21b76ee4830" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:22:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] snapshot: b0049d86-c54b-440b-b083-b4d15f4848be, volume: c906b66a-f05f-4daf-b13e-e21b76ee4830, {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 08:22:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:22:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:22:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:22:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:22:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:22:47 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[b326f3d7-329e-4f5f-a0f3-8f506c133498]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:22:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab.b0049d86-c54b-440b-b083-b4d15f4848be {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:47 devstack sudo[96156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab.b0049d86-c54b-440b-b083-b4d15f4848be Jul 07 08:22:47 devstack sudo[96156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:47 devstack sudo[96156]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab.b0049d86-c54b-440b-b083-b4d15f4848be" returned: 0 in 0.814s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:22:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 08:22:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] Creating direct copy from snapshot {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 08:22:47 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ee953f-ee85-4e94-add5-18449c0e27f8]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:22:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:48 devstack sudo[96161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab Jul 07 08:22:48 devstack sudo[96161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:48 devstack sudo[96161]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab" returned: 0 in 0.891s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:48 devstack cinder-volume[87199]: DEBUG cinder.utils [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] Path /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c906b66a-f05f-4daf-b13e-e21b76ee4830 not found in is_blk_device check {{(pid=87199) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 08:22:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c906b66a-f05f-4daf-b13e-e21b76ee4830 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:48 devstack sudo[96167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c906b66a-f05f-4daf-b13e-e21b76ee4830 Jul 07 08:22:48 devstack sudo[96167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:54 devstack sudo[96167]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c906b66a-f05f-4daf-b13e-e21b76ee4830" returned: 0 in 5.424s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:54 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5896ffd-1e66-44d4-9f2b-5266a6edf80d]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:22:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:54 devstack sudo[96181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab Jul 07 08:22:54 devstack sudo[96181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:55 devstack sudo[96181]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab" returned: 0 in 0.985s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:55 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] Image conversion details: src /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab, size 1024.00 MB, duration 5.43 sec, destination /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c906b66a-f05f-4daf-b13e-e21b76ee4830 {{(pid=87199) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 08:22:55 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] Converted 1024.00 MB image at 188.72 MB/s Jul 07 08:22:55 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c906b66a-f05f-4daf-b13e-e21b76ee4830 is being set with open permissions: ugo+rw Jul 07 08:22:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c906b66a-f05f-4daf-b13e-e21b76ee4830 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:55 devstack sudo[96186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c906b66a-f05f-4daf-b13e-e21b76ee4830 Jul 07 08:22:55 devstack sudo[96186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:55 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=94,cinder:UPDATE=112,cinder:DELETE=11,cinder:INSERT=34 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:22:55 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:UPDATE=120,cinder:SELECT=88,cinder:INSERT=31,cinder:DELETE=9 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:22:56 devstack sudo[96186]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c906b66a-f05f-4daf-b13e-e21b76ee4830" returned: 0 in 0.750s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] Lock "cinder-quobyte-c906b66a-f05f-4daf-b13e-e21b76ee4830" released by "_copy_volume_from_snapshot" :: held 8.955s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:22:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] Acquiring lock "cinder-quobyte-b0049d86-c54b-440b-b083-b4d15f4848be" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:22:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] Lock "cinder-quobyte-b0049d86-c54b-440b-b083-b4d15f4848be" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:22:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] Deleting offline snapshot b0049d86-c54b-440b-b083-b4d15f4848be of volume ecf0c72a-8899-4ede-83ba-1a4b3a5aceab {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:22:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] snapshot_file for this snap is: volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab.b0049d86-c54b-440b-b083-b4d15f4848be {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:22:56 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd79085-821e-4d20-9b5b-5601eee12941]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:22:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab.b0049d86-c54b-440b-b083-b4d15f4848be {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:56 devstack sudo[96189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab.b0049d86-c54b-440b-b083-b4d15f4848be Jul 07 08:22:56 devstack sudo[96189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:56 devstack sudo[96189]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab.b0049d86-c54b-440b-b083-b4d15f4848be" returned: 0 in 0.771s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:22:56 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[7634241a-0f5c-4a01-a080-bb6339ff2ce2]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:22:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:57 devstack sudo[96194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab Jul 07 08:22:57 devstack sudo[96194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:57 devstack sudo[96194]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab" returned: 0 in 0.831s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab.b0049d86-c54b-440b-b083-b4d15f4848be {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:57 devstack sudo[96199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab.b0049d86-c54b-440b-b083-b4d15f4848be Jul 07 08:22:57 devstack sudo[96199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:58 devstack sudo[96199]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab.b0049d86-c54b-440b-b083-b4d15f4848be" returned: 0 in 0.753s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab.b0049d86-c54b-440b-b083-b4d15f4848be {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:58 devstack sudo[96205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab.b0049d86-c54b-440b-b083-b4d15f4848be Jul 07 08:22:58 devstack sudo[96205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:59 devstack sudo[96205]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab.b0049d86-c54b-440b-b083-b4d15f4848be" returned: 0 in 0.674s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:59 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] Lock "cinder-quobyte-b0049d86-c54b-440b-b083-b4d15f4848be" released by "_delete_snapshot" :: held 3.149s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:22:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.849s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:22:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-630b2471-9323-49a2-98b7-c46c1cf34712 tempest-VolumesExtendTest-1655891662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 16.806s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:22:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a7f13e6-1c6e-4834-9836-ee7912b540cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c906b66a-f05f-4daf-b13e-e21b76ee4830', 'volume_size': 1, 'source_volid': 'ecf0c72a-8899-4ede-83ba-1a4b3a5aceab', 'source_volstatus': 'available'}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71bbb289-b70f-4ca8-8678-97f4fd263430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:59 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eae3f6f-4dad-4faa-87c9-8e697632d325]: (4, 'raw') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:22:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-630b2471-9323-49a2-98b7-c46c1cf34712 tempest-VolumesExtendTest-1655891662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b6fcb14b-9e56-40ce-aff8-f0ef870d5dff {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:59 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] Volume volume-c906b66a-f05f-4daf-b13e-e21b76ee4830 (c906b66a-f05f-4daf-b13e-e21b76ee4830): created successfully Jul 07 08:22:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71bbb289-b70f-4ca8-8678-97f4fd263430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] Flow 'volume_create_manager' (e66537fd-5826-4763-b598-5da6c163703d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:22:59 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-381af8cf-0eda-4aa7-9a55-ac9f3ccd4783 tempest-VolumesGetTest-684624965 None] Created volume successfully. Jul 07 08:22:59 devstack sudo[96210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b6fcb14b-9e56-40ce-aff8-f0ef870d5dff Jul 07 08:22:59 devstack sudo[96210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:00 devstack sudo[96210]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-630b2471-9323-49a2-98b7-c46c1cf34712 tempest-VolumesExtendTest-1655891662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b6fcb14b-9e56-40ce-aff8-f0ef870d5dff" returned: 0 in 0.843s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-630b2471-9323-49a2-98b7-c46c1cf34712 tempest-VolumesExtendTest-1655891662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b6fcb14b-9e56-40ce-aff8-f0ef870d5dff {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:00 devstack sudo[96214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b6fcb14b-9e56-40ce-aff8-f0ef870d5dff Jul 07 08:23:00 devstack sudo[96214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:00 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d66fe95-3a21-4c59-a1f3-2be6c0dce479 tempest-VolumesGetTest-684624965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:23:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7d66fe95-3a21-4c59-a1f3-2be6c0dce479 tempest-VolumesGetTest-684624965 None] Flow 'volume_create_manager' (c70aefee-90fc-48ac-9127-f1030bc1f315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:23:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7d66fe95-3a21-4c59-a1f3-2be6c0dce479 tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34ed84f3-915e-4d0a-b8dd-04cc2c94daf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7d66fe95-3a21-4c59-a1f3-2be6c0dce479 tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34ed84f3-915e-4d0a-b8dd-04cc2c94daf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:23:00Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1449770207',display_name='tempest-VolumesGetTest-Volume-184805364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd8cfb90-d967-4cd4-bf7c-35104d18304b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2c16b6b1b494f40ab8446df3b7cafb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:23:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:23:01Z,use_quota=True,user_id='7f12dfe390174445ac6a473704f10545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7d66fe95-3a21-4c59-a1f3-2be6c0dce479 tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b04342f-ea25-46ea-a295-7d6b4fa4b043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7d66fe95-3a21-4c59-a1f3-2be6c0dce479 tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b04342f-ea25-46ea-a295-7d6b4fa4b043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7d66fe95-3a21-4c59-a1f3-2be6c0dce479 tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2fe6d6c-af3f-4a7a-ad5f-5ae8611873f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7d66fe95-3a21-4c59-a1f3-2be6c0dce479 tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2fe6d6c-af3f-4a7a-ad5f-5ae8611873f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd8cfb90-d967-4cd4-bf7c-35104d18304b', 'volume_name': 'volume-cd8cfb90-d967-4cd4-bf7c-35104d18304b', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7d66fe95-3a21-4c59-a1f3-2be6c0dce479 tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4efb8c0-831f-42f6-a29c-a50553fc085f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7d66fe95-3a21-4c59-a1f3-2be6c0dce479 tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4efb8c0-831f-42f6-a29c-a50553fc085f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7d66fe95-3a21-4c59-a1f3-2be6c0dce479 tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51a5f3ba-7240-4083-b46c-acb76323f18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:00 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-7d66fe95-3a21-4c59-a1f3-2be6c0dce479 tempest-VolumesGetTest-684624965 None] Volume cd8cfb90-d967-4cd4-bf7c-35104d18304b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd8cfb90-d967-4cd4-bf7c-35104d18304b', 'volume_size': 1} Jul 07 08:23:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7d66fe95-3a21-4c59-a1f3-2be6c0dce479 tempest-VolumesGetTest-684624965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:01 devstack sudo[96214]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-630b2471-9323-49a2-98b7-c46c1cf34712 tempest-VolumesExtendTest-1655891662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b6fcb14b-9e56-40ce-aff8-f0ef870d5dff" returned: 1 in 0.868s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-630b2471-9323-49a2-98b7-c46c1cf34712 tempest-VolumesExtendTest-1655891662 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b6fcb14b-9e56-40ce-aff8-f0ef870d5dff' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:23:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-630b2471-9323-49a2-98b7-c46c1cf34712 tempest-VolumesExtendTest-1655891662 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b6fcb14b-9e56-40ce-aff8-f0ef870d5dff 2G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-630b2471-9323-49a2-98b7-c46c1cf34712 tempest-VolumesExtendTest-1655891662 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b6fcb14b-9e56-40ce-aff8-f0ef870d5dff 2G" returned: 0 in 0.065s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-630b2471-9323-49a2-98b7-c46c1cf34712 tempest-VolumesExtendTest-1655891662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.823s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-aef5e75a-b7ff-406a-863b-5553d0d307e0 req-7e38fcb1-ba8f-4cf5-847a-3a57adf18e45 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 17.716s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:01 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc182117-054a-4bc1-bf01-cf3568d036be]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:23:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-aef5e75a-b7ff-406a-863b-5553d0d307e0 req-7e38fcb1-ba8f-4cf5-847a-3a57adf18e45 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-82109665-1ac4-4779-a324-03d89f9901bd {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:01 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-630b2471-9323-49a2-98b7-c46c1cf34712 tempest-VolumesExtendTest-1655891662 None] Extend volume completed successfully. Jul 07 08:23:01 devstack sudo[96223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-82109665-1ac4-4779-a324-03d89f9901bd Jul 07 08:23:01 devstack sudo[96223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:01 devstack sudo[96223]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-aef5e75a-b7ff-406a-863b-5553d0d307e0 req-7e38fcb1-ba8f-4cf5-847a-3a57adf18e45 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-82109665-1ac4-4779-a324-03d89f9901bd" returned: 0 in 0.802s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-aef5e75a-b7ff-406a-863b-5553d0d307e0 req-7e38fcb1-ba8f-4cf5-847a-3a57adf18e45 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.829s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7d66fe95-3a21-4c59-a1f3-2be6c0dce479 tempest-VolumesGetTest-684624965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.258s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:01 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-7d66fe95-3a21-4c59-a1f3-2be6c0dce479 tempest-VolumesGetTest-684624965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:23:00Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1449770207',display_name='tempest-VolumesGetTest-Volume-184805364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd8cfb90-d967-4cd4-bf7c-35104d18304b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2c16b6b1b494f40ab8446df3b7cafb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:23:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:23:01Z,use_quota=True,user_id='7f12dfe390174445ac6a473704f10545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:23:01 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-7d66fe95-3a21-4c59-a1f3-2be6c0dce479 tempest-VolumesGetTest-684624965 None] Creating volume cd8cfb90-d967-4cd4-bf7c-35104d18304b {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:23:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7d66fe95-3a21-4c59-a1f3-2be6c0dce479 tempest-VolumesGetTest-684624965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7d66fe95-3a21-4c59-a1f3-2be6c0dce479 tempest-VolumesGetTest-684624965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:01 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-7d66fe95-3a21-4c59-a1f3-2be6c0dce479 tempest-VolumesGetTest-684624965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:23:01 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-7d66fe95-3a21-4c59-a1f3-2be6c0dce479 tempest-VolumesGetTest-684624965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:23:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7d66fe95-3a21-4c59-a1f3-2be6c0dce479 tempest-VolumesGetTest-684624965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:01 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-7d66fe95-3a21-4c59-a1f3-2be6c0dce479 tempest-VolumesGetTest-684624965 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:23:01 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-7d66fe95-3a21-4c59-a1f3-2be6c0dce479 tempest-VolumesGetTest-684624965 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:23:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7d66fe95-3a21-4c59-a1f3-2be6c0dce479 tempest-VolumesGetTest-684624965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cd8cfb90-d967-4cd4-bf7c-35104d18304b 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:01 devstack sudo[96230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cd8cfb90-d967-4cd4-bf7c-35104d18304b 1073741824 Jul 07 08:23:01 devstack sudo[96230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-aef5e75a-b7ff-406a-863b-5553d0d307e0 req-7e38fcb1-ba8f-4cf5-847a-3a57adf18e45 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b', 'name': 'volume-82109665-1ac4-4779-a324-03d89f9901bd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd1f94829-507e-46c9-a077-2cc23d931c9e', 'enforce_multipath': True} {{(pid=87199) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 08:23:02 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-aef5e75a-b7ff-406a-863b-5553d0d307e0 req-7e38fcb1-ba8f-4cf5-847a-3a57adf18e45 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] attachment_update completed successfully. Jul 07 08:23:02 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-87103107-a554-4f97-b07d-6aa74e387981 tempest-VolumesExtendTest-1655891662 None] Acquiring lock "cinder-b6fcb14b-9e56-40ce-aff8-f0ef870d5dff-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:23:02 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-87103107-a554-4f97-b07d-6aa74e387981 tempest-VolumesExtendTest-1655891662 None] Lock "cinder-b6fcb14b-9e56-40ce-aff8-f0ef870d5dff-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:23:02 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-87103107-a554-4f97-b07d-6aa74e387981 tempest-VolumesExtendTest-1655891662 None] Acquiring lock "cinder-quobyte-b6fcb14b-9e56-40ce-aff8-f0ef870d5dff" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:23:02 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-87103107-a554-4f97-b07d-6aa74e387981 tempest-VolumesExtendTest-1655891662 None] Lock "cinder-quobyte-b6fcb14b-9e56-40ce-aff8-f0ef870d5dff" acquired by "delete_volume" :: waited 0.019s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:23:02 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ceb7339-4908-4b4b-ae57-957250385128]: (4, 'raw') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:23:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-87103107-a554-4f97-b07d-6aa74e387981 tempest-VolumesExtendTest-1655891662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b6fcb14b-9e56-40ce-aff8-f0ef870d5dff {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:02 devstack sudo[96233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b6fcb14b-9e56-40ce-aff8-f0ef870d5dff Jul 07 08:23:02 devstack sudo[96233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:03 devstack sudo[96230]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7d66fe95-3a21-4c59-a1f3-2be6c0dce479 tempest-VolumesGetTest-684624965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cd8cfb90-d967-4cd4-bf7c-35104d18304b 1073741824" returned: 0 in 1.207s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7d66fe95-3a21-4c59-a1f3-2be6c0dce479 tempest-VolumesGetTest-684624965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cd8cfb90-d967-4cd4-bf7c-35104d18304b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:03 devstack sudo[96305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cd8cfb90-d967-4cd4-bf7c-35104d18304b Jul 07 08:23:03 devstack sudo[96305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:03 devstack sudo[96233]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-87103107-a554-4f97-b07d-6aa74e387981 tempest-VolumesExtendTest-1655891662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b6fcb14b-9e56-40ce-aff8-f0ef870d5dff" returned: 0 in 1.094s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-87103107-a554-4f97-b07d-6aa74e387981 tempest-VolumesExtendTest-1655891662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b6fcb14b-9e56-40ce-aff8-f0ef870d5dff {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:03 devstack sudo[96625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b6fcb14b-9e56-40ce-aff8-f0ef870d5dff Jul 07 08:23:03 devstack sudo[96625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:04 devstack sudo[96305]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7d66fe95-3a21-4c59-a1f3-2be6c0dce479 tempest-VolumesGetTest-684624965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cd8cfb90-d967-4cd4-bf7c-35104d18304b" returned: 0 in 1.022s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-7d66fe95-3a21-4c59-a1f3-2be6c0dce479 tempest-VolumesGetTest-684624965 None] <== create_volume: return (2298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:23:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7d66fe95-3a21-4c59-a1f3-2be6c0dce479 tempest-VolumesGetTest-684624965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.302s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7d66fe95-3a21-4c59-a1f3-2be6c0dce479 tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51a5f3ba-7240-4083-b46c-acb76323f18f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd8cfb90-d967-4cd4-bf7c-35104d18304b', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7d66fe95-3a21-4c59-a1f3-2be6c0dce479 tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b53b7838-e638-4c87-870c-849722eb2177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:04 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-7d66fe95-3a21-4c59-a1f3-2be6c0dce479 tempest-VolumesGetTest-684624965 None] Volume volume-cd8cfb90-d967-4cd4-bf7c-35104d18304b (cd8cfb90-d967-4cd4-bf7c-35104d18304b): created successfully Jul 07 08:23:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7d66fe95-3a21-4c59-a1f3-2be6c0dce479 tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b53b7838-e638-4c87-870c-849722eb2177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7d66fe95-3a21-4c59-a1f3-2be6c0dce479 tempest-VolumesGetTest-684624965 None] Flow 'volume_create_manager' (c70aefee-90fc-48ac-9127-f1030bc1f315) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:23:04 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-7d66fe95-3a21-4c59-a1f3-2be6c0dce479 tempest-VolumesGetTest-684624965 None] Created volume successfully. Jul 07 08:23:04 devstack sudo[96625]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-87103107-a554-4f97-b07d-6aa74e387981 tempest-VolumesExtendTest-1655891662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b6fcb14b-9e56-40ce-aff8-f0ef870d5dff" returned: 1 in 0.991s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-87103107-a554-4f97-b07d-6aa74e387981 tempest-VolumesExtendTest-1655891662 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b6fcb14b-9e56-40ce-aff8-f0ef870d5dff' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:23:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-87103107-a554-4f97-b07d-6aa74e387981 tempest-VolumesExtendTest-1655891662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b6fcb14b-9e56-40ce-aff8-f0ef870d5dff {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:04 devstack sudo[96631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b6fcb14b-9e56-40ce-aff8-f0ef870d5dff Jul 07 08:23:04 devstack sudo[96631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-356672f5-d17e-4961-b2aa-188f08feaf83 tempest-VolumesGetTest-684624965 None] Acquiring lock "cinder-cd8cfb90-d967-4cd4-bf7c-35104d18304b-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:23:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-356672f5-d17e-4961-b2aa-188f08feaf83 tempest-VolumesGetTest-684624965 None] Lock "cinder-cd8cfb90-d967-4cd4-bf7c-35104d18304b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:23:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-356672f5-d17e-4961-b2aa-188f08feaf83 tempest-VolumesGetTest-684624965 None] Acquiring lock "cinder-quobyte-cd8cfb90-d967-4cd4-bf7c-35104d18304b" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:23:05 devstack sudo[96631]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-87103107-a554-4f97-b07d-6aa74e387981 tempest-VolumesExtendTest-1655891662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b6fcb14b-9e56-40ce-aff8-f0ef870d5dff" returned: 0 in 0.818s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-87103107-a554-4f97-b07d-6aa74e387981 tempest-VolumesExtendTest-1655891662 None] Lock "cinder-quobyte-b6fcb14b-9e56-40ce-aff8-f0ef870d5dff" released by "delete_volume" :: held 3.005s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:23:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-356672f5-d17e-4961-b2aa-188f08feaf83 tempest-VolumesGetTest-684624965 None] Lock "cinder-quobyte-cd8cfb90-d967-4cd4-bf7c-35104d18304b" acquired by "delete_volume" :: waited 0.030s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:23:05 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eca6fd3-2996-44e1-856b-6fc9e44e03a4]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:23:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-356672f5-d17e-4961-b2aa-188f08feaf83 tempest-VolumesGetTest-684624965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cd8cfb90-d967-4cd4-bf7c-35104d18304b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:05 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-87103107-a554-4f97-b07d-6aa74e387981 tempest-VolumesExtendTest-1655891662 None] Created reservations ['226e5c0e-6181-470d-b3b6-71e6291a0f0d', '179ef018-b3c6-472e-a684-6b7635da45f6', '37b9d874-a96f-4814-b22c-15d5fa921a30', 'f0fd93bc-2065-4f5f-a00d-32d118eb0c7f'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:23:05 devstack sudo[96634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cd8cfb90-d967-4cd4-bf7c-35104d18304b Jul 07 08:23:05 devstack sudo[96634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-87103107-a554-4f97-b07d-6aa74e387981 tempest-VolumesExtendTest-1655891662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-87103107-a554-4f97-b07d-6aa74e387981 tempest-VolumesExtendTest-1655891662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-87103107-a554-4f97-b07d-6aa74e387981 tempest-VolumesExtendTest-1655891662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:23:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-87103107-a554-4f97-b07d-6aa74e387981 tempest-VolumesExtendTest-1655891662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:23:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-87103107-a554-4f97-b07d-6aa74e387981 tempest-VolumesExtendTest-1655891662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-87103107-a554-4f97-b07d-6aa74e387981 tempest-VolumesExtendTest-1655891662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:05 devstack sudo[96636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:23:05 devstack sudo[96636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:05 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:23:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:23:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:23:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:05 devstack sudo[96638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:23:05 devstack sudo[96638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:06 devstack sudo[96636]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-87103107-a554-4f97-b07d-6aa74e387981 tempest-VolumesExtendTest-1655891662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.959s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:06 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-87103107-a554-4f97-b07d-6aa74e387981 tempest-VolumesExtendTest-1655891662 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:23:06 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-87103107-a554-4f97-b07d-6aa74e387981 tempest-VolumesExtendTest-1655891662 None] Deleted volume successfully. Jul 07 08:23:06 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-87103107-a554-4f97-b07d-6aa74e387981 tempest-VolumesExtendTest-1655891662 None] Lock "cinder-b6fcb14b-9e56-40ce-aff8-f0ef870d5dff-delete_volume" released by "delete_volume" :: held 4.246s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:23:06 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-34c74946-d9a0-4fe2-9d83-b1b8704cc08f tempest-VolumesExtendTest-1655891662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:23:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-34c74946-d9a0-4fe2-9d83-b1b8704cc08f tempest-VolumesExtendTest-1655891662 None] Flow 'volume_create_manager' (1f418d1c-e4b4-4f01-9b52-06c61a2ab19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:23:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-34c74946-d9a0-4fe2-9d83-b1b8704cc08f tempest-VolumesExtendTest-1655891662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9581015-216b-4a49-8d8f-5103abd71233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-34c74946-d9a0-4fe2-9d83-b1b8704cc08f tempest-VolumesExtendTest-1655891662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9581015-216b-4a49-8d8f-5103abd71233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-140246273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50d6885b-69bf-4181-9e06-da612776448d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce7d9e0352bf46058a2ed9f3a70ac272',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:23:07Z,use_quota=True,user_id='4dc6f80aed874192a7a7b50f72e03b43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-34c74946-d9a0-4fe2-9d83-b1b8704cc08f tempest-VolumesExtendTest-1655891662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4661931b-b27b-4dcf-aa8a-938763b799ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-34c74946-d9a0-4fe2-9d83-b1b8704cc08f tempest-VolumesExtendTest-1655891662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4661931b-b27b-4dcf-aa8a-938763b799ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-34c74946-d9a0-4fe2-9d83-b1b8704cc08f tempest-VolumesExtendTest-1655891662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0c661e9-cbd5-4d14-801b-125b1641a295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-34c74946-d9a0-4fe2-9d83-b1b8704cc08f tempest-VolumesExtendTest-1655891662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0c661e9-cbd5-4d14-801b-125b1641a295) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50d6885b-69bf-4181-9e06-da612776448d', 'volume_name': 'volume-50d6885b-69bf-4181-9e06-da612776448d', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-34c74946-d9a0-4fe2-9d83-b1b8704cc08f tempest-VolumesExtendTest-1655891662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b174240-47ae-4625-8591-9050c3c6fbfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-34c74946-d9a0-4fe2-9d83-b1b8704cc08f tempest-VolumesExtendTest-1655891662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b174240-47ae-4625-8591-9050c3c6fbfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:06 devstack sudo[96634]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-34c74946-d9a0-4fe2-9d83-b1b8704cc08f tempest-VolumesExtendTest-1655891662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfdac55a-2d90-470c-bd47-601e5446834d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:06 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-34c74946-d9a0-4fe2-9d83-b1b8704cc08f tempest-VolumesExtendTest-1655891662 None] Volume 50d6885b-69bf-4181-9e06-da612776448d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50d6885b-69bf-4181-9e06-da612776448d', 'volume_size': 1} Jul 07 08:23:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-34c74946-d9a0-4fe2-9d83-b1b8704cc08f tempest-VolumesExtendTest-1655891662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-34c74946-d9a0-4fe2-9d83-b1b8704cc08f tempest-VolumesExtendTest-1655891662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-34c74946-d9a0-4fe2-9d83-b1b8704cc08f tempest-VolumesExtendTest-1655891662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-140246273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50d6885b-69bf-4181-9e06-da612776448d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce7d9e0352bf46058a2ed9f3a70ac272',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:23:07Z,use_quota=True,user_id='4dc6f80aed874192a7a7b50f72e03b43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:23:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-34c74946-d9a0-4fe2-9d83-b1b8704cc08f tempest-VolumesExtendTest-1655891662 None] Creating volume 50d6885b-69bf-4181-9e06-da612776448d {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:23:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-34c74946-d9a0-4fe2-9d83-b1b8704cc08f tempest-VolumesExtendTest-1655891662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-34c74946-d9a0-4fe2-9d83-b1b8704cc08f tempest-VolumesExtendTest-1655891662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-34c74946-d9a0-4fe2-9d83-b1b8704cc08f tempest-VolumesExtendTest-1655891662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:23:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-34c74946-d9a0-4fe2-9d83-b1b8704cc08f tempest-VolumesExtendTest-1655891662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:23:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-34c74946-d9a0-4fe2-9d83-b1b8704cc08f tempest-VolumesExtendTest-1655891662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-34c74946-d9a0-4fe2-9d83-b1b8704cc08f tempest-VolumesExtendTest-1655891662 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:23:06 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-34c74946-d9a0-4fe2-9d83-b1b8704cc08f tempest-VolumesExtendTest-1655891662 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:23:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-34c74946-d9a0-4fe2-9d83-b1b8704cc08f tempest-VolumesExtendTest-1655891662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-50d6885b-69bf-4181-9e06-da612776448d 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-356672f5-d17e-4961-b2aa-188f08feaf83 tempest-VolumesGetTest-684624965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cd8cfb90-d967-4cd4-bf7c-35104d18304b" returned: 0 in 1.325s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-356672f5-d17e-4961-b2aa-188f08feaf83 tempest-VolumesGetTest-684624965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cd8cfb90-d967-4cd4-bf7c-35104d18304b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:06 devstack sudo[96644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-50d6885b-69bf-4181-9e06-da612776448d 1073741824 Jul 07 08:23:06 devstack sudo[96644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:06 devstack sudo[96645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cd8cfb90-d967-4cd4-bf7c-35104d18304b Jul 07 08:23:06 devstack sudo[96645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:07 devstack sudo[96638]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 1.258s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:07 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:23:07 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running periodic task VolumeManager._thread_info {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:23:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] thread count: 28 {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 08:23:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] thread info: [<_MainThread(MainThread, started 133056092332160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 08:23:07 devstack sudo[96644]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-34c74946-d9a0-4fe2-9d83-b1b8704cc08f tempest-VolumesExtendTest-1655891662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-50d6885b-69bf-4181-9e06-da612776448d 1073741824" returned: 0 in 1.147s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:07 devstack sudo[96645]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-356672f5-d17e-4961-b2aa-188f08feaf83 tempest-VolumesGetTest-684624965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cd8cfb90-d967-4cd4-bf7c-35104d18304b" returned: 0 in 1.139s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:07 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-356672f5-d17e-4961-b2aa-188f08feaf83 tempest-VolumesGetTest-684624965 None] Lock "cinder-quobyte-cd8cfb90-d967-4cd4-bf7c-35104d18304b" released by "delete_volume" :: held 2.521s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:23:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-34c74946-d9a0-4fe2-9d83-b1b8704cc08f tempest-VolumesExtendTest-1655891662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-50d6885b-69bf-4181-9e06-da612776448d {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:07 devstack sudo[96654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-50d6885b-69bf-4181-9e06-da612776448d Jul 07 08:23:07 devstack sudo[96654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:08 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-356672f5-d17e-4961-b2aa-188f08feaf83 tempest-VolumesGetTest-684624965 None] Created reservations ['179136d3-c1af-41a4-bae7-ac17b91000a0', '51550767-159d-4c22-b180-b4310058f8ce', '5d33d234-a688-442d-807e-db0b5fde884a', '1374f512-6bd9-434d-8603-157bc26b07a5'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:23:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-356672f5-d17e-4961-b2aa-188f08feaf83 tempest-VolumesGetTest-684624965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-356672f5-d17e-4961-b2aa-188f08feaf83 tempest-VolumesGetTest-684624965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:08 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-356672f5-d17e-4961-b2aa-188f08feaf83 tempest-VolumesGetTest-684624965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:23:08 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-356672f5-d17e-4961-b2aa-188f08feaf83 tempest-VolumesGetTest-684624965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:23:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-356672f5-d17e-4961-b2aa-188f08feaf83 tempest-VolumesGetTest-684624965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-356672f5-d17e-4961-b2aa-188f08feaf83 tempest-VolumesGetTest-684624965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:08 devstack sudo[96656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:23:08 devstack sudo[96656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:08 devstack sudo[96654]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-34c74946-d9a0-4fe2-9d83-b1b8704cc08f tempest-VolumesExtendTest-1655891662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-50d6885b-69bf-4181-9e06-da612776448d" returned: 0 in 0.756s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:08 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-34c74946-d9a0-4fe2-9d83-b1b8704cc08f tempest-VolumesExtendTest-1655891662 None] <== create_volume: return (1991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:23:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-34c74946-d9a0-4fe2-9d83-b1b8704cc08f tempest-VolumesExtendTest-1655891662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.003s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-34c74946-d9a0-4fe2-9d83-b1b8704cc08f tempest-VolumesExtendTest-1655891662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfdac55a-2d90-470c-bd47-601e5446834d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50d6885b-69bf-4181-9e06-da612776448d', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-34c74946-d9a0-4fe2-9d83-b1b8704cc08f tempest-VolumesExtendTest-1655891662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cee12c5a-72aa-44e1-8951-32f58ccb5b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:08 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-34c74946-d9a0-4fe2-9d83-b1b8704cc08f tempest-VolumesExtendTest-1655891662 None] Volume volume-50d6885b-69bf-4181-9e06-da612776448d (50d6885b-69bf-4181-9e06-da612776448d): created successfully Jul 07 08:23:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-34c74946-d9a0-4fe2-9d83-b1b8704cc08f tempest-VolumesExtendTest-1655891662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cee12c5a-72aa-44e1-8951-32f58ccb5b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-34c74946-d9a0-4fe2-9d83-b1b8704cc08f tempest-VolumesExtendTest-1655891662 None] Flow 'volume_create_manager' (1f418d1c-e4b4-4f01-9b52-06c61a2ab19c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:23:08 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-34c74946-d9a0-4fe2-9d83-b1b8704cc08f tempest-VolumesExtendTest-1655891662 None] Created volume successfully. Jul 07 08:23:09 devstack sudo[96656]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-356672f5-d17e-4961-b2aa-188f08feaf83 tempest-VolumesGetTest-684624965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.906s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:09 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-356672f5-d17e-4961-b2aa-188f08feaf83 tempest-VolumesGetTest-684624965 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:23:09 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-356672f5-d17e-4961-b2aa-188f08feaf83 tempest-VolumesGetTest-684624965 None] Deleted volume successfully. Jul 07 08:23:09 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c2ec407b-a3ba-4ba3-96cb-386a6fbff4ce tempest-VolumesGetTest-684624965 None] Acquiring lock "cinder-c906b66a-f05f-4daf-b13e-e21b76ee4830-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:23:09 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-356672f5-d17e-4961-b2aa-188f08feaf83 tempest-VolumesGetTest-684624965 None] Lock "cinder-cd8cfb90-d967-4cd4-bf7c-35104d18304b-delete_volume" released by "delete_volume" :: held 3.701s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:23:09 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c2ec407b-a3ba-4ba3-96cb-386a6fbff4ce tempest-VolumesGetTest-684624965 None] Lock "cinder-c906b66a-f05f-4daf-b13e-e21b76ee4830-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:23:09 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c2ec407b-a3ba-4ba3-96cb-386a6fbff4ce tempest-VolumesGetTest-684624965 None] Acquiring lock "cinder-quobyte-c906b66a-f05f-4daf-b13e-e21b76ee4830" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:23:09 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c2ec407b-a3ba-4ba3-96cb-386a6fbff4ce tempest-VolumesGetTest-684624965 None] Lock "cinder-quobyte-c906b66a-f05f-4daf-b13e-e21b76ee4830" acquired by "delete_volume" :: waited 0.016s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:23:09 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8b6c64-0b4e-4373-9f21-b6ea337ce4af]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:23:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c2ec407b-a3ba-4ba3-96cb-386a6fbff4ce tempest-VolumesGetTest-684624965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c906b66a-f05f-4daf-b13e-e21b76ee4830 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:09 devstack sudo[96663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c906b66a-f05f-4daf-b13e-e21b76ee4830 Jul 07 08:23:09 devstack sudo[96663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-19359579-87dc-469e-a9b5-239dbdf565b9 tempest-VolumesExtendTest-1655891662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-19359579-87dc-469e-a9b5-239dbdf565b9 tempest-VolumesExtendTest-1655891662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-19359579-87dc-469e-a9b5-239dbdf565b9 tempest-VolumesExtendTest-1655891662 None] Creating offline snapshot f6da014d-bf9b-40d0-b49f-32532d83e900 of volume 50d6885b-69bf-4181-9e06-da612776448d {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:23:09 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a0b721-0581-4be9-beab-29a1235ad578]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:23:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-19359579-87dc-469e-a9b5-239dbdf565b9 tempest-VolumesExtendTest-1655891662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-50d6885b-69bf-4181-9e06-da612776448d {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:10 devstack sudo[96668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-50d6885b-69bf-4181-9e06-da612776448d Jul 07 08:23:10 devstack sudo[96668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:10 devstack sudo[96663]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c2ec407b-a3ba-4ba3-96cb-386a6fbff4ce tempest-VolumesGetTest-684624965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c906b66a-f05f-4daf-b13e-e21b76ee4830" returned: 0 in 0.916s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c2ec407b-a3ba-4ba3-96cb-386a6fbff4ce tempest-VolumesGetTest-684624965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c906b66a-f05f-4daf-b13e-e21b76ee4830 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:10 devstack sudo[96671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c906b66a-f05f-4daf-b13e-e21b76ee4830 Jul 07 08:23:10 devstack sudo[96671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:10 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-9e366432-a400-42b5-8f8b-e0aa40781780 req-7f1094e7-eed9-43b9-8db7-4529119ac332 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] Terminate volume connection completed successfully. Jul 07 08:23:10 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-9e366432-a400-42b5-8f8b-e0aa40781780 req-7f1094e7-eed9-43b9-8db7-4529119ac332 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] Deleting attachment d1f94829-507e-46c9-a077-2cc23d931c9e. {{(pid=87199) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 08:23:10 devstack sudo[96668]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:10 devstack sudo[96671]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c2ec407b-a3ba-4ba3-96cb-386a6fbff4ce tempest-VolumesGetTest-684624965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c906b66a-f05f-4daf-b13e-e21b76ee4830" returned: 0 in 0.693s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-19359579-87dc-469e-a9b5-239dbdf565b9 tempest-VolumesExtendTest-1655891662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-50d6885b-69bf-4181-9e06-da612776448d" returned: 0 in 0.915s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-19359579-87dc-469e-a9b5-239dbdf565b9 tempest-VolumesExtendTest-1655891662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-50d6885b-69bf-4181-9e06-da612776448d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-50d6885b-69bf-4181-9e06-da612776448d.f6da014d-bf9b-40d0-b49f-32532d83e900 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:10 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c2ec407b-a3ba-4ba3-96cb-386a6fbff4ce tempest-VolumesGetTest-684624965 None] Lock "cinder-quobyte-c906b66a-f05f-4daf-b13e-e21b76ee4830" released by "delete_volume" :: held 1.662s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:23:10 devstack sudo[96706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-50d6885b-69bf-4181-9e06-da612776448d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-50d6885b-69bf-4181-9e06-da612776448d.f6da014d-bf9b-40d0-b49f-32532d83e900 1G Jul 07 08:23:10 devstack sudo[96706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:10 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-c2ec407b-a3ba-4ba3-96cb-386a6fbff4ce tempest-VolumesGetTest-684624965 None] Created reservations ['66b8bece-54a3-4aea-aaf9-2ccca35663bb', 'b76f2b44-ad89-4217-a0df-aaf93f3b14a1', '733de968-3052-41e7-b5a8-a1d19669d2de', '05051b36-60cd-4797-8888-b823b07f37c9'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:23:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c2ec407b-a3ba-4ba3-96cb-386a6fbff4ce tempest-VolumesGetTest-684624965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c2ec407b-a3ba-4ba3-96cb-386a6fbff4ce tempest-VolumesGetTest-684624965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:10 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c2ec407b-a3ba-4ba3-96cb-386a6fbff4ce tempest-VolumesGetTest-684624965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:23:10 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c2ec407b-a3ba-4ba3-96cb-386a6fbff4ce tempest-VolumesGetTest-684624965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:23:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c2ec407b-a3ba-4ba3-96cb-386a6fbff4ce tempest-VolumesGetTest-684624965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c2ec407b-a3ba-4ba3-96cb-386a6fbff4ce tempest-VolumesGetTest-684624965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:10 devstack sudo[96708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:23:10 devstack sudo[96708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:11 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a4bf908c-4edb-45c7-ba42-89d8c001b8b6 tempest-VolumesGetTest-684624965 None] Acquiring lock "cinder-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:23:11 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a4bf908c-4edb-45c7-ba42-89d8c001b8b6 tempest-VolumesGetTest-684624965 None] Lock "cinder-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:23:11 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a4bf908c-4edb-45c7-ba42-89d8c001b8b6 tempest-VolumesGetTest-684624965 None] Acquiring lock "cinder-quobyte-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:23:11 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a4bf908c-4edb-45c7-ba42-89d8c001b8b6 tempest-VolumesGetTest-684624965 None] Lock "cinder-quobyte-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab" acquired by "delete_volume" :: waited 0.016s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:23:11 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[4104bfca-d4f1-4cd4-8a66-8d6325175d23]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:23:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a4bf908c-4edb-45c7-ba42-89d8c001b8b6 tempest-VolumesGetTest-684624965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:11 devstack sudo[96714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab Jul 07 08:23:11 devstack sudo[96714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:11 devstack sudo[96708]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c2ec407b-a3ba-4ba3-96cb-386a6fbff4ce tempest-VolumesGetTest-684624965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.703s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:11 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-c2ec407b-a3ba-4ba3-96cb-386a6fbff4ce tempest-VolumesGetTest-684624965 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:23:11 devstack sudo[96706]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:11 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-c2ec407b-a3ba-4ba3-96cb-386a6fbff4ce tempest-VolumesGetTest-684624965 None] Deleted volume successfully. Jul 07 08:23:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-19359579-87dc-469e-a9b5-239dbdf565b9 tempest-VolumesExtendTest-1655891662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-50d6885b-69bf-4181-9e06-da612776448d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-50d6885b-69bf-4181-9e06-da612776448d.f6da014d-bf9b-40d0-b49f-32532d83e900 1G" returned: 0 in 0.867s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-19359579-87dc-469e-a9b5-239dbdf565b9 tempest-VolumesExtendTest-1655891662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50d6885b-69bf-4181-9e06-da612776448d -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-50d6885b-69bf-4181-9e06-da612776448d.f6da014d-bf9b-40d0-b49f-32532d83e900 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:11 devstack sudo[96717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50d6885b-69bf-4181-9e06-da612776448d -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-50d6885b-69bf-4181-9e06-da612776448d.f6da014d-bf9b-40d0-b49f-32532d83e900 Jul 07 08:23:11 devstack sudo[96717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:11 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c2ec407b-a3ba-4ba3-96cb-386a6fbff4ce tempest-VolumesGetTest-684624965 None] Lock "cinder-c906b66a-f05f-4daf-b13e-e21b76ee4830-delete_volume" released by "delete_volume" :: held 2.593s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:23:12 devstack sudo[96714]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a4bf908c-4edb-45c7-ba42-89d8c001b8b6 tempest-VolumesGetTest-684624965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab" returned: 0 in 0.851s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a4bf908c-4edb-45c7-ba42-89d8c001b8b6 tempest-VolumesGetTest-684624965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:12 devstack sudo[96725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab Jul 07 08:23:12 devstack sudo[96725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:12 devstack sudo[96717]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-19359579-87dc-469e-a9b5-239dbdf565b9 tempest-VolumesExtendTest-1655891662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50d6885b-69bf-4181-9e06-da612776448d -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-50d6885b-69bf-4181-9e06-da612776448d.f6da014d-bf9b-40d0-b49f-32532d83e900" returned: 0 in 0.730s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:12 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-19359579-87dc-469e-a9b5-239dbdf565b9 tempest-VolumesExtendTest-1655891662 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-50d6885b-69bf-4181-9e06-da612776448d.f6da014d-bf9b-40d0-b49f-32532d83e900 is being set with open permissions: ugo+rw Jul 07 08:23:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-19359579-87dc-469e-a9b5-239dbdf565b9 tempest-VolumesExtendTest-1655891662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-50d6885b-69bf-4181-9e06-da612776448d.f6da014d-bf9b-40d0-b49f-32532d83e900 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:12 devstack sudo[96727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-50d6885b-69bf-4181-9e06-da612776448d.f6da014d-bf9b-40d0-b49f-32532d83e900 Jul 07 08:23:12 devstack sudo[96727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:12 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5058aad7-dd9b-4012-974d-7070c8a41634 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] Acquiring lock "cinder-82109665-1ac4-4779-a324-03d89f9901bd-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:23:12 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5058aad7-dd9b-4012-974d-7070c8a41634 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] Lock "cinder-82109665-1ac4-4779-a324-03d89f9901bd-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:23:12 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5058aad7-dd9b-4012-974d-7070c8a41634 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] Acquiring lock "cinder-quobyte-82109665-1ac4-4779-a324-03d89f9901bd" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:23:12 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5058aad7-dd9b-4012-974d-7070c8a41634 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] Lock "cinder-quobyte-82109665-1ac4-4779-a324-03d89f9901bd" acquired by "delete_volume" :: waited 0.019s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:23:12 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[6066b2ee-5c78-4d6c-a46f-8aa72efd8742]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:23:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5058aad7-dd9b-4012-974d-7070c8a41634 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-82109665-1ac4-4779-a324-03d89f9901bd {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:12 devstack sudo[96729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-82109665-1ac4-4779-a324-03d89f9901bd Jul 07 08:23:12 devstack sudo[96729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:13 devstack sudo[96725]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a4bf908c-4edb-45c7-ba42-89d8c001b8b6 tempest-VolumesGetTest-684624965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab" returned: 0 in 0.757s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:13 devstack sudo[96727]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-19359579-87dc-469e-a9b5-239dbdf565b9 tempest-VolumesExtendTest-1655891662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-50d6885b-69bf-4181-9e06-da612776448d.f6da014d-bf9b-40d0-b49f-32532d83e900" returned: 0 in 0.730s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:13 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a4bf908c-4edb-45c7-ba42-89d8c001b8b6 tempest-VolumesGetTest-684624965 None] Lock "cinder-quobyte-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab" released by "delete_volume" :: held 1.669s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:23:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-19359579-87dc-469e-a9b5-239dbdf565b9 tempest-VolumesExtendTest-1655891662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-50d6885b-69bf-4181-9e06-da612776448d.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:13 devstack sudo[96733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-50d6885b-69bf-4181-9e06-da612776448d.info Jul 07 08:23:13 devstack sudo[96733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:13 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-a4bf908c-4edb-45c7-ba42-89d8c001b8b6 tempest-VolumesGetTest-684624965 None] Created reservations ['eb86589b-719e-4c76-8e86-58d10d2a6f49', '456823ef-72d4-4958-92b4-bada3979e0b3', '3a7d762a-b1ca-4ebd-9b25-0db4f52f14d8', '49aaa44c-352a-4745-9d34-39dc8c27bd41'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:23:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a4bf908c-4edb-45c7-ba42-89d8c001b8b6 tempest-VolumesGetTest-684624965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a4bf908c-4edb-45c7-ba42-89d8c001b8b6 tempest-VolumesGetTest-684624965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a4bf908c-4edb-45c7-ba42-89d8c001b8b6 tempest-VolumesGetTest-684624965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:23:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a4bf908c-4edb-45c7-ba42-89d8c001b8b6 tempest-VolumesGetTest-684624965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:23:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a4bf908c-4edb-45c7-ba42-89d8c001b8b6 tempest-VolumesGetTest-684624965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a4bf908c-4edb-45c7-ba42-89d8c001b8b6 tempest-VolumesGetTest-684624965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:13 devstack sudo[96738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:23:13 devstack sudo[96738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:13 devstack sudo[96729]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5058aad7-dd9b-4012-974d-7070c8a41634 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-82109665-1ac4-4779-a324-03d89f9901bd" returned: 0 in 0.923s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5058aad7-dd9b-4012-974d-7070c8a41634 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-82109665-1ac4-4779-a324-03d89f9901bd {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:13 devstack sudo[96740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-82109665-1ac4-4779-a324-03d89f9901bd Jul 07 08:23:13 devstack sudo[96740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:14 devstack sudo[96733]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-19359579-87dc-469e-a9b5-239dbdf565b9 tempest-VolumesExtendTest-1655891662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-50d6885b-69bf-4181-9e06-da612776448d.info" returned: 0 in 0.880s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:14 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-19359579-87dc-469e-a9b5-239dbdf565b9 tempest-VolumesExtendTest-1655891662 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-50d6885b-69bf-4181-9e06-da612776448d.info is being set with open permissions: ugo+rw Jul 07 08:23:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-19359579-87dc-469e-a9b5-239dbdf565b9 tempest-VolumesExtendTest-1655891662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-50d6885b-69bf-4181-9e06-da612776448d.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:14 devstack sudo[96743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-50d6885b-69bf-4181-9e06-da612776448d.info Jul 07 08:23:14 devstack sudo[96743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:14 devstack sudo[96740]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5058aad7-dd9b-4012-974d-7070c8a41634 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-82109665-1ac4-4779-a324-03d89f9901bd" returned: 0 in 0.740s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:14 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5058aad7-dd9b-4012-974d-7070c8a41634 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] Lock "cinder-quobyte-82109665-1ac4-4779-a324-03d89f9901bd" released by "delete_volume" :: held 1.746s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:23:14 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-5058aad7-dd9b-4012-974d-7070c8a41634 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] Created reservations ['c9a56a83-6931-4e1b-b6a9-305aa5568909', '61bcf97a-031f-416f-967f-201c8d284a70', '71830a06-31fd-4927-b4ed-c56301f6f506', 'ace7014f-fcb2-40a0-bcfc-88d4cfec4e37'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:23:14 devstack sudo[96738]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a4bf908c-4edb-45c7-ba42-89d8c001b8b6 tempest-VolumesGetTest-684624965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 1.026s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:14 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-a4bf908c-4edb-45c7-ba42-89d8c001b8b6 tempest-VolumesGetTest-684624965 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:23:14 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-a4bf908c-4edb-45c7-ba42-89d8c001b8b6 tempest-VolumesGetTest-684624965 None] Deleted volume successfully. Jul 07 08:23:14 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a4bf908c-4edb-45c7-ba42-89d8c001b8b6 tempest-VolumesGetTest-684624965 None] Lock "cinder-ecf0c72a-8899-4ede-83ba-1a4b3a5aceab-delete_volume" released by "delete_volume" :: held 3.070s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:23:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-5058aad7-dd9b-4012-974d-7070c8a41634 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-5058aad7-dd9b-4012-974d-7070c8a41634 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:14 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-5058aad7-dd9b-4012-974d-7070c8a41634 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:23:14 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-5058aad7-dd9b-4012-974d-7070c8a41634 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:23:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-5058aad7-dd9b-4012-974d-7070c8a41634 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5058aad7-dd9b-4012-974d-7070c8a41634 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:14 devstack sudo[96747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:23:14 devstack sudo[96747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:14 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:23:14 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] Flow 'volume_create_manager' (2cada378-44e6-4a59-84f6-f98bea36a949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:23:14 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13737a59-b54a-4b5e-884c-4c49088bbc09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:14 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13737a59-b54a-4b5e-884c-4c49088bbc09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1658885324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=218e7788-5e49-41b0-aec4-74417feed94d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a2c16b6b1b494f40ab8446df3b7cafb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:23:15Z,use_quota=True,user_id='7f12dfe390174445ac6a473704f10545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:14 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2680496-03a5-4271-96d3-03ce66cd3f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:14 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2680496-03a5-4271-96d3-03ce66cd3f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:14 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b23ecf49-bbec-4f0a-a4f0-3a41c24b8229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:14 devstack cinder-volume[87199]: DEBUG cinder.image.glance [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] Creating Keystone auth plugin from conf {{(pid=87199) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 08:23:15 devstack sudo[96743]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-19359579-87dc-469e-a9b5-239dbdf565b9 tempest-VolumesExtendTest-1655891662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-50d6885b-69bf-4181-9e06-da612776448d.info" returned: 0 in 1.067s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-19359579-87dc-469e-a9b5-239dbdf565b9 tempest-VolumesExtendTest-1655891662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.344s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:15 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-19359579-87dc-469e-a9b5-239dbdf565b9 tempest-VolumesExtendTest-1655891662 None] Create snapshot completed successfully Jul 07 08:23:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b23ecf49-bbec-4f0a-a4f0-3a41c24b8229) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '218e7788-5e49-41b0-aec4-74417feed94d', 'volume_name': 'volume-218e7788-5e49-41b0-aec4-74417feed94d', 'volume_size': 1, 'image_id': '276bad5d-feb0-4ba2-a219-18ecf721ff14', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/276bad5d-feb0-4ba2-a219-18ecf721ff14', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '616624e32aa447818ca627e0bb0985c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '276bad5d-feb0-4ba2-a219-18ecf721ff14', 'created_at': datetime.datetime(2026, 7, 7, 6, 6, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 6, 6, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/276bad5d-feb0-4ba2-a219-18ecf721ff14/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e5169d2-b2f5-4cf7-a19e-1ee521e5f1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:15 devstack sudo[96747]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e5169d2-b2f5-4cf7-a19e-1ee521e5f1bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e82af43-7045-4a2d-92b4-ac067e906aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:15 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] Volume 218e7788-5e49-41b0-aec4-74417feed94d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-218e7788-5e49-41b0-aec4-74417feed94d', 'volume_size': 1, 'image_id': '276bad5d-feb0-4ba2-a219-18ecf721ff14', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/276bad5d-feb0-4ba2-a219-18ecf721ff14', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '616624e32aa447818ca627e0bb0985c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '276bad5d-feb0-4ba2-a219-18ecf721ff14', 'created_at': datetime.datetime(2026, 7, 7, 6, 6, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 6, 6, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/276bad5d-feb0-4ba2-a219-18ecf721ff14/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 07 08:23:15 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] Trying to clone 218e7788-5e49-41b0-aec4-74417feed94d from image 276bad5d-feb0-4ba2-a219-18ecf721ff14 at location (None, [{'url': 'file:///opt/stack/data/glance/images/276bad5d-feb0-4ba2-a219-18ecf721ff14', 'metadata': {}}]). {{(pid=87199) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 08:23:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5058aad7-dd9b-4012-974d-7070c8a41634 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 1.002s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:15 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-5058aad7-dd9b-4012-974d-7070c8a41634 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:23:15 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-5058aad7-dd9b-4012-974d-7070c8a41634 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] Deleted volume successfully. Jul 07 08:23:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5058aad7-dd9b-4012-974d-7070c8a41634 tempest-TestServerVolumeAttachScenarioOldVersion-1227570681 None] Lock "cinder-82109665-1ac4-4779-a324-03d89f9901bd-delete_volume" released by "delete_volume" :: held 3.101s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:23:15 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_276bad5d-feb0-4ba2-a219-18ecf721ff14_0lgwb8s0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87199) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 08:23:15 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] Image download 20.69 MB at 20.69 MB/s Jul 07 08:23:15 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c1cbc0-5b05-4767-96d0-d981a22274b0]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:23:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_276bad5d-feb0-4ba2-a219-18ecf721ff14_0lgwb8s0devstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:16 devstack sudo[96753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_276bad5d-feb0-4ba2-a219-18ecf721ff14_0lgwb8s0devstack@QuobyteHD Jul 07 08:23:16 devstack sudo[96753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9cd9d7ec-c176-469a-84cf-eb6b47ba19de tempest-VolumesExtendTest-1655891662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9cd9d7ec-c176-469a-84cf-eb6b47ba19de tempest-VolumesExtendTest-1655891662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:16 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[353beaaf-aebb-4a47-bfef-571bb8fe49bf]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:23:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9cd9d7ec-c176-469a-84cf-eb6b47ba19de tempest-VolumesExtendTest-1655891662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-50d6885b-69bf-4181-9e06-da612776448d {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:16 devstack sudo[96773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-50d6885b-69bf-4181-9e06-da612776448d Jul 07 08:23:16 devstack sudo[96773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:17 devstack sudo[96753]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_276bad5d-feb0-4ba2-a219-18ecf721ff14_0lgwb8s0devstack@QuobyteHD" returned: 0 in 1.199s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:17 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] Temporary image 276bad5d-feb0-4ba2-a219-18ecf721ff14 is fetched for user 7f12dfe390174445ac6a473704f10545. {{(pid=87199) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 08:23:17 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc84c10-c8e6-4352-9b13-8e71004487c1]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:23:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_276bad5d-feb0-4ba2-a219-18ecf721ff14_0lgwb8s0devstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:17 devstack sudo[96798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_276bad5d-feb0-4ba2-a219-18ecf721ff14_0lgwb8s0devstack@QuobyteHD Jul 07 08:23:17 devstack sudo[96798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:17 devstack sudo[96773]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9cd9d7ec-c176-469a-84cf-eb6b47ba19de tempest-VolumesExtendTest-1655891662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-50d6885b-69bf-4181-9e06-da612776448d" returned: 0 in 1.155s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9cd9d7ec-c176-469a-84cf-eb6b47ba19de tempest-VolumesExtendTest-1655891662 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-50d6885b-69bf-4181-9e06-da612776448d.f6da014d-bf9b-40d0-b49f-32532d83e900 2G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9cd9d7ec-c176-469a-84cf-eb6b47ba19de tempest-VolumesExtendTest-1655891662 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-50d6885b-69bf-4181-9e06-da612776448d.f6da014d-bf9b-40d0-b49f-32532d83e900 2G" returned: 0 in 0.151s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9cd9d7ec-c176-469a-84cf-eb6b47ba19de tempest-VolumesExtendTest-1655891662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.369s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:17 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-9cd9d7ec-c176-469a-84cf-eb6b47ba19de tempest-VolumesExtendTest-1655891662 None] Extend volume completed successfully. Jul 07 08:23:18 devstack sudo[96798]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_276bad5d-feb0-4ba2-a219-18ecf721ff14_0lgwb8s0devstack@QuobyteHD" returned: 0 in 0.926s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:18 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1658885324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=218e7788-5e49-41b0-aec4-74417feed94d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a2c16b6b1b494f40ab8446df3b7cafb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:23:15Z,use_quota=True,user_id='7f12dfe390174445ac6a473704f10545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:23:18 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] Creating volume 218e7788-5e49-41b0-aec4-74417feed94d {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:23:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:18 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:23:18 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:23:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:18 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:23:18 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:23:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-218e7788-5e49-41b0-aec4-74417feed94d 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:18 devstack sudo[96814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-218e7788-5e49-41b0-aec4-74417feed94d 1073741824 Jul 07 08:23:18 devstack sudo[96814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:18 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5762831e-c8f0-4220-9150-8788f9e3305d tempest-VolumesExtendTest-1655891662 None] Acquiring lock "cinder-f6da014d-bf9b-40d0-b49f-32532d83e900-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:23:18 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5762831e-c8f0-4220-9150-8788f9e3305d tempest-VolumesExtendTest-1655891662 None] Lock "cinder-f6da014d-bf9b-40d0-b49f-32532d83e900-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:23:18 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5762831e-c8f0-4220-9150-8788f9e3305d tempest-VolumesExtendTest-1655891662 None] Acquiring lock "cinder-quobyte-50d6885b-69bf-4181-9e06-da612776448d" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:23:18 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5762831e-c8f0-4220-9150-8788f9e3305d tempest-VolumesExtendTest-1655891662 None] Lock "cinder-quobyte-50d6885b-69bf-4181-9e06-da612776448d" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:23:18 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5762831e-c8f0-4220-9150-8788f9e3305d tempest-VolumesExtendTest-1655891662 None] Acquiring lock "cinder-quobyte-f6da014d-bf9b-40d0-b49f-32532d83e900" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:23:18 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5762831e-c8f0-4220-9150-8788f9e3305d tempest-VolumesExtendTest-1655891662 None] Lock "cinder-quobyte-f6da014d-bf9b-40d0-b49f-32532d83e900" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:23:18 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-5762831e-c8f0-4220-9150-8788f9e3305d tempest-VolumesExtendTest-1655891662 None] Deleting offline snapshot f6da014d-bf9b-40d0-b49f-32532d83e900 of volume 50d6885b-69bf-4181-9e06-da612776448d {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:23:18 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-5762831e-c8f0-4220-9150-8788f9e3305d tempest-VolumesExtendTest-1655891662 None] snapshot_file for this snap is: volume-50d6885b-69bf-4181-9e06-da612776448d.f6da014d-bf9b-40d0-b49f-32532d83e900 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:23:18 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca49bd0c-49d4-4756-90e7-94d04bf8eefa]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:23:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5762831e-c8f0-4220-9150-8788f9e3305d tempest-VolumesExtendTest-1655891662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-50d6885b-69bf-4181-9e06-da612776448d.f6da014d-bf9b-40d0-b49f-32532d83e900 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:19 devstack sudo[96818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-50d6885b-69bf-4181-9e06-da612776448d.f6da014d-bf9b-40d0-b49f-32532d83e900 Jul 07 08:23:19 devstack sudo[96818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:19 devstack sudo[96814]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-218e7788-5e49-41b0-aec4-74417feed94d 1073741824" returned: 0 in 1.022s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-218e7788-5e49-41b0-aec4-74417feed94d {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:19 devstack sudo[96824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-218e7788-5e49-41b0-aec4-74417feed94d Jul 07 08:23:19 devstack sudo[96824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:19 devstack sudo[96818]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5762831e-c8f0-4220-9150-8788f9e3305d tempest-VolumesExtendTest-1655891662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-50d6885b-69bf-4181-9e06-da612776448d.f6da014d-bf9b-40d0-b49f-32532d83e900" returned: 0 in 0.814s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:19 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-5762831e-c8f0-4220-9150-8788f9e3305d tempest-VolumesExtendTest-1655891662 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50d6885b-69bf-4181-9e06-da612776448d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:23:19 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[41bc99c6-e966-4974-8027-420ed56cd443]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:23:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5762831e-c8f0-4220-9150-8788f9e3305d tempest-VolumesExtendTest-1655891662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-50d6885b-69bf-4181-9e06-da612776448d {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:19 devstack sudo[96829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-50d6885b-69bf-4181-9e06-da612776448d Jul 07 08:23:19 devstack sudo[96829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:19 devstack sudo[96824]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-218e7788-5e49-41b0-aec4-74417feed94d" returned: 0 in 0.658s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:19 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] <== create_volume: return (1731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:23:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.735s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:19 devstack cinder-volume[87199]: DEBUG cinder.volume.volume_utils [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] Attempting download of 276bad5d-feb0-4ba2-a219-18ecf721ff14 ((None, [{'url': 'file:///opt/stack/data/glance/images/276bad5d-feb0-4ba2-a219-18ecf721ff14', 'metadata': {}}])) to volume 218e7788-5e49-41b0-aec4-74417feed94d. {{(pid=87199) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 08:23:20 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3f6d30-2e55-4c01-b87a-0fc8679bb9df]: (4, 'raw') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:23:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_276bad5d-feb0-4ba2-a219-18ecf721ff14_gjyknn8m {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:20 devstack sudo[96832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_276bad5d-feb0-4ba2-a219-18ecf721ff14_gjyknn8m Jul 07 08:23:20 devstack sudo[96832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:20 devstack sudo[96829]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5762831e-c8f0-4220-9150-8788f9e3305d tempest-VolumesExtendTest-1655891662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-50d6885b-69bf-4181-9e06-da612776448d" returned: 0 in 0.881s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5762831e-c8f0-4220-9150-8788f9e3305d tempest-VolumesExtendTest-1655891662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-50d6885b-69bf-4181-9e06-da612776448d.f6da014d-bf9b-40d0-b49f-32532d83e900 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:20 devstack sudo[96837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-50d6885b-69bf-4181-9e06-da612776448d.f6da014d-bf9b-40d0-b49f-32532d83e900 Jul 07 08:23:20 devstack sudo[96837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:20 devstack sudo[96832]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_276bad5d-feb0-4ba2-a219-18ecf721ff14_gjyknn8m" returned: 0 in 0.787s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_276bad5d-feb0-4ba2-a219-18ecf721ff14_gjyknn8m {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:20 devstack sudo[96842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_276bad5d-feb0-4ba2-a219-18ecf721ff14_gjyknn8m Jul 07 08:23:20 devstack sudo[96842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_276bad5d-feb0-4ba2-a219-18ecf721ff14_gjyknn8m" returned: 1 in 1.062s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_276bad5d-feb0-4ba2-a219-18ecf721ff14_gjyknn8m' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:23:21 devstack sudo[96842]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:21 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e26e1db-528e-4020-bb63-9f6e4b7bb9cd]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:23:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_276bad5d-feb0-4ba2-a219-18ecf721ff14_0lgwb8s0devstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5762831e-c8f0-4220-9150-8788f9e3305d tempest-VolumesExtendTest-1655891662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-50d6885b-69bf-4181-9e06-da612776448d.f6da014d-bf9b-40d0-b49f-32532d83e900" returned: 0 in 1.370s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5762831e-c8f0-4220-9150-8788f9e3305d tempest-VolumesExtendTest-1655891662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-50d6885b-69bf-4181-9e06-da612776448d.f6da014d-bf9b-40d0-b49f-32532d83e900 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:21 devstack sudo[96837]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:22 devstack sudo[96895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-50d6885b-69bf-4181-9e06-da612776448d.f6da014d-bf9b-40d0-b49f-32532d83e900 Jul 07 08:23:22 devstack sudo[96895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:22 devstack sudo[96892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_276bad5d-feb0-4ba2-a219-18ecf721ff14_0lgwb8s0devstack@QuobyteHD Jul 07 08:23:22 devstack sudo[96892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:22 devstack sudo[96895]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5762831e-c8f0-4220-9150-8788f9e3305d tempest-VolumesExtendTest-1655891662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-50d6885b-69bf-4181-9e06-da612776448d.f6da014d-bf9b-40d0-b49f-32532d83e900" returned: 0 in 0.738s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:22 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5762831e-c8f0-4220-9150-8788f9e3305d tempest-VolumesExtendTest-1655891662 None] Lock "cinder-quobyte-f6da014d-bf9b-40d0-b49f-32532d83e900" released by "_delete_snapshot" :: held 3.935s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:23:22 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5762831e-c8f0-4220-9150-8788f9e3305d tempest-VolumesExtendTest-1655891662 None] Lock "cinder-quobyte-50d6885b-69bf-4181-9e06-da612776448d" released by "delete_snapshot" :: held 3.965s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:23:22 devstack sudo[96892]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_276bad5d-feb0-4ba2-a219-18ecf721ff14_0lgwb8s0devstack@QuobyteHD" returned: 0 in 0.954s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:22 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] 276bad5d-feb0-4ba2-a219-18ecf721ff14 was qcow2, converting to raw {{(pid=87199) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 08:23:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_276bad5d-feb0-4ba2-a219-18ecf721ff14_0lgwb8s0devstack@QuobyteHD /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-218e7788-5e49-41b0-aec4-74417feed94d {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:22 devstack sudo[96910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_276bad5d-feb0-4ba2-a219-18ecf721ff14_0lgwb8s0devstack@QuobyteHD /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-218e7788-5e49-41b0-aec4-74417feed94d Jul 07 08:23:22 devstack sudo[96910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:22 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-5762831e-c8f0-4220-9150-8788f9e3305d tempest-VolumesExtendTest-1655891662 None] Created reservations ['ffb0ed70-7349-42e7-8baf-9c38ac39e782', '05cc5ffe-9111-4d21-a90a-69f72239470c', 'eed5ca85-ce67-42c7-bafe-1ce3606365ce', 'ce4a4612-c0ed-43c4-ae12-f7b4b5556d73'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:23:22 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-5762831e-c8f0-4220-9150-8788f9e3305d tempest-VolumesExtendTest-1655891662 None] Delete snapshot completed successfully. Jul 07 08:23:23 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5762831e-c8f0-4220-9150-8788f9e3305d tempest-VolumesExtendTest-1655891662 None] Lock "cinder-f6da014d-bf9b-40d0-b49f-32532d83e900-delete_snapshot" released by "delete_snapshot" :: held 4.210s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:23:23 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9ec1312e-b5c5-4832-b95d-8f289fe2168e tempest-VolumesExtendTest-1655891662 None] Acquiring lock "cinder-50d6885b-69bf-4181-9e06-da612776448d-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:23:23 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9ec1312e-b5c5-4832-b95d-8f289fe2168e tempest-VolumesExtendTest-1655891662 None] Lock "cinder-50d6885b-69bf-4181-9e06-da612776448d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:23:23 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9ec1312e-b5c5-4832-b95d-8f289fe2168e tempest-VolumesExtendTest-1655891662 None] Acquiring lock "cinder-quobyte-50d6885b-69bf-4181-9e06-da612776448d" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:23:23 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9ec1312e-b5c5-4832-b95d-8f289fe2168e tempest-VolumesExtendTest-1655891662 None] Lock "cinder-quobyte-50d6885b-69bf-4181-9e06-da612776448d" acquired by "delete_volume" :: waited 0.018s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:23:23 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[007dd5b9-9368-4475-af4a-ed98722ea0a3]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:23:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9ec1312e-b5c5-4832-b95d-8f289fe2168e tempest-VolumesExtendTest-1655891662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-50d6885b-69bf-4181-9e06-da612776448d {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:23 devstack sudo[96927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-50d6885b-69bf-4181-9e06-da612776448d Jul 07 08:23:23 devstack sudo[96927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:24 devstack sudo[96927]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9ec1312e-b5c5-4832-b95d-8f289fe2168e tempest-VolumesExtendTest-1655891662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-50d6885b-69bf-4181-9e06-da612776448d" returned: 0 in 1.266s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9ec1312e-b5c5-4832-b95d-8f289fe2168e tempest-VolumesExtendTest-1655891662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-50d6885b-69bf-4181-9e06-da612776448d {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:24 devstack sudo[96945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-50d6885b-69bf-4181-9e06-da612776448d Jul 07 08:23:24 devstack sudo[96945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:25 devstack sudo[96910]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_276bad5d-feb0-4ba2-a219-18ecf721ff14_0lgwb8s0devstack@QuobyteHD /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-218e7788-5e49-41b0-aec4-74417feed94d" returned: 0 in 2.786s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:25 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_276bad5d-feb0-4ba2-a219-18ecf721ff14_0lgwb8s0devstack@QuobyteHD, size 112.00 MB, duration 2.79 sec, destination /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-218e7788-5e49-41b0-aec4-74417feed94d {{(pid=87199) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 08:23:25 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] Converted 112.00 MB image at 40.18 MB/s Jul 07 08:23:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-218e7788-5e49-41b0-aec4-74417feed94d 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:25 devstack sudo[96955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-218e7788-5e49-41b0-aec4-74417feed94d 1G Jul 07 08:23:25 devstack sudo[96955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:25 devstack sudo[96945]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9ec1312e-b5c5-4832-b95d-8f289fe2168e tempest-VolumesExtendTest-1655891662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-50d6885b-69bf-4181-9e06-da612776448d" returned: 0 in 1.122s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:25 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9ec1312e-b5c5-4832-b95d-8f289fe2168e tempest-VolumesExtendTest-1655891662 None] Lock "cinder-quobyte-50d6885b-69bf-4181-9e06-da612776448d" released by "delete_volume" :: held 2.488s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:23:25 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-9ec1312e-b5c5-4832-b95d-8f289fe2168e tempest-VolumesExtendTest-1655891662 None] Created reservations ['e6f15dcc-70f7-4221-8743-e63b78787ec1', '19473652-cc65-42a7-b5df-0cb663f9367a', '372ebf62-2502-4a86-800c-0288d51e5828', '1ee49790-620c-48b3-9b2f-213ffce504ca'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:23:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9ec1312e-b5c5-4832-b95d-8f289fe2168e tempest-VolumesExtendTest-1655891662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9ec1312e-b5c5-4832-b95d-8f289fe2168e tempest-VolumesExtendTest-1655891662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:26 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-9ec1312e-b5c5-4832-b95d-8f289fe2168e tempest-VolumesExtendTest-1655891662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:23:26 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-9ec1312e-b5c5-4832-b95d-8f289fe2168e tempest-VolumesExtendTest-1655891662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:23:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9ec1312e-b5c5-4832-b95d-8f289fe2168e tempest-VolumesExtendTest-1655891662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9ec1312e-b5c5-4832-b95d-8f289fe2168e tempest-VolumesExtendTest-1655891662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:26 devstack sudo[96957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:23:26 devstack sudo[96957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:27 devstack sudo[96955]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-218e7788-5e49-41b0-aec4-74417feed94d 1G" returned: 0 in 1.419s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:27 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[022d510e-9b03-4e49-a3c0-255cea0921d6]: (4, 'raw') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:23:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-218e7788-5e49-41b0-aec4-74417feed94d {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:27 devstack sudo[96957]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9ec1312e-b5c5-4832-b95d-8f289fe2168e tempest-VolumesExtendTest-1655891662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 1.199s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:27 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-9ec1312e-b5c5-4832-b95d-8f289fe2168e tempest-VolumesExtendTest-1655891662 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:23:27 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-9ec1312e-b5c5-4832-b95d-8f289fe2168e tempest-VolumesExtendTest-1655891662 None] Deleted volume successfully. Jul 07 08:23:27 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9ec1312e-b5c5-4832-b95d-8f289fe2168e tempest-VolumesExtendTest-1655891662 None] Lock "cinder-50d6885b-69bf-4181-9e06-da612776448d-delete_volume" released by "delete_volume" :: held 4.089s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:23:27 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1ec1308-29d2-44f4-9b3c-84e6c876b27e tempest-VolumesActionsTest-1764575982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:23:27 devstack sudo[96963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-218e7788-5e49-41b0-aec4-74417feed94d Jul 07 08:23:27 devstack sudo[96963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d1ec1308-29d2-44f4-9b3c-84e6c876b27e tempest-VolumesActionsTest-1764575982 None] Flow 'volume_create_manager' (58faf51e-28db-45a0-8731-f5de91e5e2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:23:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d1ec1308-29d2-44f4-9b3c-84e6c876b27e tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f752dc7f-1128-4394-b23d-ec7f5b70b7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d1ec1308-29d2-44f4-9b3c-84e6c876b27e tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f752dc7f-1128-4394-b23d-ec7f5b70b7a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:23:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-785898097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e449e361-1acf-4b2b-be19-992792f0f524,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68368676a64749b3ba414b1751a5abaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:23:27Z,use_quota=True,user_id='6717bb48e52b40fc92e585e3937702d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d1ec1308-29d2-44f4-9b3c-84e6c876b27e tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3edf6e7f-850f-41e0-8c3e-2bf0d0495296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d1ec1308-29d2-44f4-9b3c-84e6c876b27e tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3edf6e7f-850f-41e0-8c3e-2bf0d0495296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d1ec1308-29d2-44f4-9b3c-84e6c876b27e tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88d360c6-2373-49d1-b6d8-2c29e5b7d964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d1ec1308-29d2-44f4-9b3c-84e6c876b27e tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88d360c6-2373-49d1-b6d8-2c29e5b7d964) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e449e361-1acf-4b2b-be19-992792f0f524', 'volume_name': 'volume-e449e361-1acf-4b2b-be19-992792f0f524', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d1ec1308-29d2-44f4-9b3c-84e6c876b27e tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db578d4c-4f85-465b-ae73-aa78a0fa2948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d1ec1308-29d2-44f4-9b3c-84e6c876b27e tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db578d4c-4f85-465b-ae73-aa78a0fa2948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d1ec1308-29d2-44f4-9b3c-84e6c876b27e tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e00f162f-7a7c-44e8-b9d2-a8e364cbeb3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:27 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-d1ec1308-29d2-44f4-9b3c-84e6c876b27e tempest-VolumesActionsTest-1764575982 None] Volume e449e361-1acf-4b2b-be19-992792f0f524: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e449e361-1acf-4b2b-be19-992792f0f524', 'volume_size': 1} Jul 07 08:23:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d1ec1308-29d2-44f4-9b3c-84e6c876b27e tempest-VolumesActionsTest-1764575982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d1ec1308-29d2-44f4-9b3c-84e6c876b27e tempest-VolumesActionsTest-1764575982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:27 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d1ec1308-29d2-44f4-9b3c-84e6c876b27e tempest-VolumesActionsTest-1764575982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:23:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-785898097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e449e361-1acf-4b2b-be19-992792f0f524,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68368676a64749b3ba414b1751a5abaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:23:27Z,use_quota=True,user_id='6717bb48e52b40fc92e585e3937702d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:23:27 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-d1ec1308-29d2-44f4-9b3c-84e6c876b27e tempest-VolumesActionsTest-1764575982 None] Creating volume e449e361-1acf-4b2b-be19-992792f0f524 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:23:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d1ec1308-29d2-44f4-9b3c-84e6c876b27e tempest-VolumesActionsTest-1764575982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d1ec1308-29d2-44f4-9b3c-84e6c876b27e tempest-VolumesActionsTest-1764575982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:27 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d1ec1308-29d2-44f4-9b3c-84e6c876b27e tempest-VolumesActionsTest-1764575982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:23:27 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d1ec1308-29d2-44f4-9b3c-84e6c876b27e tempest-VolumesActionsTest-1764575982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:23:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d1ec1308-29d2-44f4-9b3c-84e6c876b27e tempest-VolumesActionsTest-1764575982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:27 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d1ec1308-29d2-44f4-9b3c-84e6c876b27e tempest-VolumesActionsTest-1764575982 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:23:27 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-d1ec1308-29d2-44f4-9b3c-84e6c876b27e tempest-VolumesActionsTest-1764575982 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:23:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d1ec1308-29d2-44f4-9b3c-84e6c876b27e tempest-VolumesActionsTest-1764575982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-e449e361-1acf-4b2b-be19-992792f0f524 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:27 devstack sudo[96966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-e449e361-1acf-4b2b-be19-992792f0f524 1073741824 Jul 07 08:23:27 devstack sudo[96966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:28 devstack sudo[96963]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-218e7788-5e49-41b0-aec4-74417feed94d" returned: 0 in 1.466s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-218e7788-5e49-41b0-aec4-74417feed94d {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:28 devstack sudo[96966]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d1ec1308-29d2-44f4-9b3c-84e6c876b27e tempest-VolumesActionsTest-1764575982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-e449e361-1acf-4b2b-be19-992792f0f524 1073741824" returned: 0 in 1.270s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:28 devstack sudo[97007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-218e7788-5e49-41b0-aec4-74417feed94d Jul 07 08:23:28 devstack sudo[97007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d1ec1308-29d2-44f4-9b3c-84e6c876b27e tempest-VolumesActionsTest-1764575982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-e449e361-1acf-4b2b-be19-992792f0f524 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:28 devstack sudo[97011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-e449e361-1acf-4b2b-be19-992792f0f524 Jul 07 08:23:28 devstack sudo[97011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:30 devstack sudo[97007]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-218e7788-5e49-41b0-aec4-74417feed94d" returned: 1 in 1.354s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-218e7788-5e49-41b0-aec4-74417feed94d' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:23:30 devstack cinder-volume[87199]: DEBUG cinder.volume.volume_utils [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] Downloaded image 276bad5d-feb0-4ba2-a219-18ecf721ff14 ((None, [{'url': 'file:///opt/stack/data/glance/images/276bad5d-feb0-4ba2-a219-18ecf721ff14', 'metadata': {}}])) to volume 218e7788-5e49-41b0-aec4-74417feed94d successfully. {{(pid=87199) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 08:23:30 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] Temporary image 276bad5d-feb0-4ba2-a219-18ecf721ff14 for user 7f12dfe390174445ac6a473704f10545 is deleted. {{(pid=87199) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 08:23:30 devstack cinder-volume[87199]: DEBUG cinder.volume.volume_utils [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] Marking volume 218e7788-5e49-41b0-aec4-74417feed94d as bootable. {{(pid=87199) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 08:23:30 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] Copying metadata from image 276bad5d-feb0-4ba2-a219-18ecf721ff14 to 218e7788-5e49-41b0-aec4-74417feed94d. {{(pid=87199) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 08:23:30 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] Creating volume glance metadata for volume 218e7788-5e49-41b0-aec4-74417feed94d backed by image 276bad5d-feb0-4ba2-a219-18ecf721ff14 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '276bad5d-feb0-4ba2-a219-18ecf721ff14', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87199) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 08:23:30 devstack sudo[97011]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d1ec1308-29d2-44f4-9b3c-84e6c876b27e tempest-VolumesActionsTest-1764575982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-e449e361-1acf-4b2b-be19-992792f0f524" returned: 0 in 1.213s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:30 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d1ec1308-29d2-44f4-9b3c-84e6c876b27e tempest-VolumesActionsTest-1764575982 None] <== create_volume: return (2566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:23:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d1ec1308-29d2-44f4-9b3c-84e6c876b27e tempest-VolumesActionsTest-1764575982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.570s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d1ec1308-29d2-44f4-9b3c-84e6c876b27e tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e00f162f-7a7c-44e8-b9d2-a8e364cbeb3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e449e361-1acf-4b2b-be19-992792f0f524', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d1ec1308-29d2-44f4-9b3c-84e6c876b27e tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2636f5e-c767-4a9c-af2e-d69df610abd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:30 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-d1ec1308-29d2-44f4-9b3c-84e6c876b27e tempest-VolumesActionsTest-1764575982 None] Volume volume-e449e361-1acf-4b2b-be19-992792f0f524 (e449e361-1acf-4b2b-be19-992792f0f524): created successfully Jul 07 08:23:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d1ec1308-29d2-44f4-9b3c-84e6c876b27e tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2636f5e-c767-4a9c-af2e-d69df610abd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d1ec1308-29d2-44f4-9b3c-84e6c876b27e tempest-VolumesActionsTest-1764575982 None] Flow 'volume_create_manager' (58faf51e-28db-45a0-8731-f5de91e5e2c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:23:30 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-d1ec1308-29d2-44f4-9b3c-84e6c876b27e tempest-VolumesActionsTest-1764575982 None] Created volume successfully. Jul 07 08:23:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e82af43-7045-4a2d-92b4-ac067e906aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-218e7788-5e49-41b0-aec4-74417feed94d', 'volume_size': 1, 'image_id': '276bad5d-feb0-4ba2-a219-18ecf721ff14', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/276bad5d-feb0-4ba2-a219-18ecf721ff14', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '616624e32aa447818ca627e0bb0985c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '276bad5d-feb0-4ba2-a219-18ecf721ff14', 'created_at': datetime.datetime(2026, 7, 7, 6, 6, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 6, 6, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/276bad5d-feb0-4ba2-a219-18ecf721ff14/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fbf07e6-d346-466a-8e58-0d7a96c0d6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:30 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] Volume volume-218e7788-5e49-41b0-aec4-74417feed94d (218e7788-5e49-41b0-aec4-74417feed94d): created successfully Jul 07 08:23:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fbf07e6-d346-466a-8e58-0d7a96c0d6a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] Flow 'volume_create_manager' (2cada378-44e6-4a59-84f6-f98bea36a949) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:23:30 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-395ed4e7-e461-4968-b819-b3ac2c9c9ad9 tempest-VolumesGetTest-684624965 None] Created volume successfully. Jul 07 08:23:30 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-50fc3122-5c27-499d-8daa-abbfa9acf25e tempest-VolumesActionsTest-1764575982 None] Acquiring lock "cinder-e449e361-1acf-4b2b-be19-992792f0f524" by "attach_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:23:30 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-50fc3122-5c27-499d-8daa-abbfa9acf25e tempest-VolumesActionsTest-1764575982 None] Lock "cinder-e449e361-1acf-4b2b-be19-992792f0f524" acquired by "attach_volume" :: waited 0.027s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:23:30 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-50fc3122-5c27-499d-8daa-abbfa9acf25e tempest-VolumesActionsTest-1764575982 None] Attaching volume e449e361-1acf-4b2b-be19-992792f0f524 to instance e7ba6ff9-492a-40d0-9815-e96d17e2eed9 at mountpoint /dev/vdb on host None. Jul 07 08:23:31 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-50fc3122-5c27-499d-8daa-abbfa9acf25e tempest-VolumesActionsTest-1764575982 None] Attach volume completed successfully. Jul 07 08:23:31 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-50fc3122-5c27-499d-8daa-abbfa9acf25e tempest-VolumesActionsTest-1764575982 None] Lock "cinder-e449e361-1acf-4b2b-be19-992792f0f524" released by "attach_volume" :: held 0.265s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:23:32 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-d74d0dd9-7874-4599-aef1-f2ea3d50f341 tempest-VolumesActionsTest-1911398733 None] Terminate volume connection completed successfully. Jul 07 08:23:32 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-f146fe4d-77cf-4d05-bb38-5a6aaf189bec tempest-VolumesGetTest-684624965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:23:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f146fe4d-77cf-4d05-bb38-5a6aaf189bec tempest-VolumesGetTest-684624965 None] Flow 'volume_create_manager' (db56e605-abce-4d1f-a9e2-16b4a586c4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:23:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f146fe4d-77cf-4d05-bb38-5a6aaf189bec tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41fcc847-abba-4780-bea3-052a1b590c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f146fe4d-77cf-4d05-bb38-5a6aaf189bec tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41fcc847-abba-4780-bea3-052a1b590c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:23:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1220636854',display_name='tempest-VolumesGetTest-Volume-1415447248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=026255b1-48b9-4bbe-9bb8-abb15c13a111,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2c16b6b1b494f40ab8446df3b7cafb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:23:33Z,use_quota=True,user_id='7f12dfe390174445ac6a473704f10545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f146fe4d-77cf-4d05-bb38-5a6aaf189bec tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (859f9ca1-1bff-4a44-8b8c-14bfa78cbe2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f146fe4d-77cf-4d05-bb38-5a6aaf189bec tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (859f9ca1-1bff-4a44-8b8c-14bfa78cbe2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f146fe4d-77cf-4d05-bb38-5a6aaf189bec tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bb79c21-7574-4290-9cb0-16abbf35ec24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f146fe4d-77cf-4d05-bb38-5a6aaf189bec tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bb79c21-7574-4290-9cb0-16abbf35ec24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '026255b1-48b9-4bbe-9bb8-abb15c13a111', 'volume_name': 'volume-026255b1-48b9-4bbe-9bb8-abb15c13a111', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f146fe4d-77cf-4d05-bb38-5a6aaf189bec tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b12d3623-8c84-43fb-bb78-8e8ae471fe91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f146fe4d-77cf-4d05-bb38-5a6aaf189bec tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b12d3623-8c84-43fb-bb78-8e8ae471fe91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f146fe4d-77cf-4d05-bb38-5a6aaf189bec tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f321e495-0675-40e6-b023-e7c4f6c50725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:32 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-f146fe4d-77cf-4d05-bb38-5a6aaf189bec tempest-VolumesGetTest-684624965 None] Volume 026255b1-48b9-4bbe-9bb8-abb15c13a111: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-026255b1-48b9-4bbe-9bb8-abb15c13a111', 'volume_size': 1} Jul 07 08:23:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f146fe4d-77cf-4d05-bb38-5a6aaf189bec tempest-VolumesGetTest-684624965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f146fe4d-77cf-4d05-bb38-5a6aaf189bec tempest-VolumesGetTest-684624965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:32 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f146fe4d-77cf-4d05-bb38-5a6aaf189bec tempest-VolumesGetTest-684624965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:23:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1220636854',display_name='tempest-VolumesGetTest-Volume-1415447248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=026255b1-48b9-4bbe-9bb8-abb15c13a111,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2c16b6b1b494f40ab8446df3b7cafb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:23:33Z,use_quota=True,user_id='7f12dfe390174445ac6a473704f10545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:23:32 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-f146fe4d-77cf-4d05-bb38-5a6aaf189bec tempest-VolumesGetTest-684624965 None] Creating volume 026255b1-48b9-4bbe-9bb8-abb15c13a111 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:23:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f146fe4d-77cf-4d05-bb38-5a6aaf189bec tempest-VolumesGetTest-684624965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f146fe4d-77cf-4d05-bb38-5a6aaf189bec tempest-VolumesGetTest-684624965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:32 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f146fe4d-77cf-4d05-bb38-5a6aaf189bec tempest-VolumesGetTest-684624965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:23:32 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f146fe4d-77cf-4d05-bb38-5a6aaf189bec tempest-VolumesGetTest-684624965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:23:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f146fe4d-77cf-4d05-bb38-5a6aaf189bec tempest-VolumesGetTest-684624965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:32 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f146fe4d-77cf-4d05-bb38-5a6aaf189bec tempest-VolumesGetTest-684624965 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:23:32 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-f146fe4d-77cf-4d05-bb38-5a6aaf189bec tempest-VolumesGetTest-684624965 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:23:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f146fe4d-77cf-4d05-bb38-5a6aaf189bec tempest-VolumesGetTest-684624965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-026255b1-48b9-4bbe-9bb8-abb15c13a111 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:32 devstack sudo[97019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-026255b1-48b9-4bbe-9bb8-abb15c13a111 1073741824 Jul 07 08:23:32 devstack sudo[97019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:33 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d74d0dd9-7874-4599-aef1-f2ea3d50f341 tempest-VolumesActionsTest-1911398733 None] Acquiring lock "cinder-e449e361-1acf-4b2b-be19-992792f0f524-detach_volume" by "detach_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:23:33 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d74d0dd9-7874-4599-aef1-f2ea3d50f341 tempest-VolumesActionsTest-1911398733 None] Lock "cinder-e449e361-1acf-4b2b-be19-992792f0f524-detach_volume" acquired by "detach_volume" :: waited 0.040s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:23:33 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-d74d0dd9-7874-4599-aef1-f2ea3d50f341 tempest-VolumesActionsTest-1911398733 None] Detaching volume e449e361-1acf-4b2b-be19-992792f0f524 from instance e7ba6ff9-492a-40d0-9815-e96d17e2eed9. Jul 07 08:23:33 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-d74d0dd9-7874-4599-aef1-f2ea3d50f341 tempest-VolumesActionsTest-1911398733 None] Detach volume completed successfully. Jul 07 08:23:33 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d74d0dd9-7874-4599-aef1-f2ea3d50f341 tempest-VolumesActionsTest-1911398733 None] Lock "cinder-e449e361-1acf-4b2b-be19-992792f0f524-detach_volume" released by "detach_volume" :: held 0.222s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:23:34 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-030bf4ae-35f2-42ec-b66d-46a354803c47 tempest-VolumesActionsTest-1764575982 None] Acquiring lock "cinder-e449e361-1acf-4b2b-be19-992792f0f524-detach_volume" by "detach_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:23:34 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-030bf4ae-35f2-42ec-b66d-46a354803c47 tempest-VolumesActionsTest-1764575982 None] Lock "cinder-e449e361-1acf-4b2b-be19-992792f0f524-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:23:34 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-030bf4ae-35f2-42ec-b66d-46a354803c47 tempest-VolumesActionsTest-1764575982 None] Volume detach called, but volume not attached. Jul 07 08:23:34 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-030bf4ae-35f2-42ec-b66d-46a354803c47 tempest-VolumesActionsTest-1764575982 None] Lock "cinder-e449e361-1acf-4b2b-be19-992792f0f524-detach_volume" released by "detach_volume" :: held 0.025s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:23:34 devstack sudo[97019]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f146fe4d-77cf-4d05-bb38-5a6aaf189bec tempest-VolumesGetTest-684624965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-026255b1-48b9-4bbe-9bb8-abb15c13a111 1073741824" returned: 0 in 1.497s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f146fe4d-77cf-4d05-bb38-5a6aaf189bec tempest-VolumesGetTest-684624965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-026255b1-48b9-4bbe-9bb8-abb15c13a111 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:34 devstack sudo[97025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-026255b1-48b9-4bbe-9bb8-abb15c13a111 Jul 07 08:23:34 devstack sudo[97025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:34 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-03f450ab-ca27-430f-9774-2d2f2449ce0c tempest-VolumesActionsTest-1764575982 None] Acquiring lock "cinder-e449e361-1acf-4b2b-be19-992792f0f524-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:23:34 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-03f450ab-ca27-430f-9774-2d2f2449ce0c tempest-VolumesActionsTest-1764575982 None] Lock "cinder-e449e361-1acf-4b2b-be19-992792f0f524-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:23:35 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-03f450ab-ca27-430f-9774-2d2f2449ce0c tempest-VolumesActionsTest-1764575982 None] Acquiring lock "cinder-quobyte-e449e361-1acf-4b2b-be19-992792f0f524" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:23:35 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-03f450ab-ca27-430f-9774-2d2f2449ce0c tempest-VolumesActionsTest-1764575982 None] Lock "cinder-quobyte-e449e361-1acf-4b2b-be19-992792f0f524" acquired by "delete_volume" :: waited 0.022s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:23:35 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf94ffd-6e19-411a-8967-75db2e377eca]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:23:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-03f450ab-ca27-430f-9774-2d2f2449ce0c tempest-VolumesActionsTest-1764575982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-e449e361-1acf-4b2b-be19-992792f0f524 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:35 devstack sudo[97027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-e449e361-1acf-4b2b-be19-992792f0f524 Jul 07 08:23:35 devstack sudo[97027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:35 devstack sudo[97025]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f146fe4d-77cf-4d05-bb38-5a6aaf189bec tempest-VolumesGetTest-684624965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-026255b1-48b9-4bbe-9bb8-abb15c13a111" returned: 0 in 0.966s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:35 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f146fe4d-77cf-4d05-bb38-5a6aaf189bec tempest-VolumesGetTest-684624965 None] <== create_volume: return (2521ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:23:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f146fe4d-77cf-4d05-bb38-5a6aaf189bec tempest-VolumesGetTest-684624965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.523s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f146fe4d-77cf-4d05-bb38-5a6aaf189bec tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f321e495-0675-40e6-b023-e7c4f6c50725) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-026255b1-48b9-4bbe-9bb8-abb15c13a111', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f146fe4d-77cf-4d05-bb38-5a6aaf189bec tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7b48d9b-381e-4b1b-b8ba-7225d83528bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:35 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-f146fe4d-77cf-4d05-bb38-5a6aaf189bec tempest-VolumesGetTest-684624965 None] Volume volume-026255b1-48b9-4bbe-9bb8-abb15c13a111 (026255b1-48b9-4bbe-9bb8-abb15c13a111): created successfully Jul 07 08:23:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f146fe4d-77cf-4d05-bb38-5a6aaf189bec tempest-VolumesGetTest-684624965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7b48d9b-381e-4b1b-b8ba-7225d83528bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f146fe4d-77cf-4d05-bb38-5a6aaf189bec tempest-VolumesGetTest-684624965 None] Flow 'volume_create_manager' (db56e605-abce-4d1f-a9e2-16b4a586c4a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:23:35 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-f146fe4d-77cf-4d05-bb38-5a6aaf189bec tempest-VolumesGetTest-684624965 None] Created volume successfully. Jul 07 08:23:36 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-26c69273-d391-401a-9d40-80cc198e73c9 tempest-VolumesGetTest-684624965 None] Acquiring lock "cinder-026255b1-48b9-4bbe-9bb8-abb15c13a111-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:23:36 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-26c69273-d391-401a-9d40-80cc198e73c9 tempest-VolumesGetTest-684624965 None] Lock "cinder-026255b1-48b9-4bbe-9bb8-abb15c13a111-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:23:36 devstack sudo[97027]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-03f450ab-ca27-430f-9774-2d2f2449ce0c tempest-VolumesActionsTest-1764575982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-e449e361-1acf-4b2b-be19-992792f0f524" returned: 0 in 1.307s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-03f450ab-ca27-430f-9774-2d2f2449ce0c tempest-VolumesActionsTest-1764575982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-e449e361-1acf-4b2b-be19-992792f0f524 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:36 devstack sudo[97034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-e449e361-1acf-4b2b-be19-992792f0f524 Jul 07 08:23:36 devstack sudo[97034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:36 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-26c69273-d391-401a-9d40-80cc198e73c9 tempest-VolumesGetTest-684624965 None] Acquiring lock "cinder-quobyte-026255b1-48b9-4bbe-9bb8-abb15c13a111" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:23:36 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-26c69273-d391-401a-9d40-80cc198e73c9 tempest-VolumesGetTest-684624965 None] Lock "cinder-quobyte-026255b1-48b9-4bbe-9bb8-abb15c13a111" acquired by "delete_volume" :: waited 0.022s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:23:36 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70cfbdf-9ffd-4c26-bbc7-19215902ade7]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:23:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-26c69273-d391-401a-9d40-80cc198e73c9 tempest-VolumesGetTest-684624965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-026255b1-48b9-4bbe-9bb8-abb15c13a111 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:36 devstack sudo[97043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-026255b1-48b9-4bbe-9bb8-abb15c13a111 Jul 07 08:23:36 devstack sudo[97043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:37 devstack sudo[97034]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-03f450ab-ca27-430f-9774-2d2f2449ce0c tempest-VolumesActionsTest-1764575982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-e449e361-1acf-4b2b-be19-992792f0f524" returned: 0 in 1.094s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:37 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-03f450ab-ca27-430f-9774-2d2f2449ce0c tempest-VolumesActionsTest-1764575982 None] Lock "cinder-quobyte-e449e361-1acf-4b2b-be19-992792f0f524" released by "delete_volume" :: held 2.465s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:23:37 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-03f450ab-ca27-430f-9774-2d2f2449ce0c tempest-VolumesActionsTest-1764575982 None] Created reservations ['9df18276-c7d6-4466-a944-4ca39efb515e', '43891fe1-4470-4494-a416-b83ae387ccf9', '8040c9f1-e349-464d-8a6c-a27f68e0a8f2', '6e58f783-f444-473b-bf79-a7558b19d6ca'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:23:37 devstack sudo[97043]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-26c69273-d391-401a-9d40-80cc198e73c9 tempest-VolumesGetTest-684624965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-026255b1-48b9-4bbe-9bb8-abb15c13a111" returned: 0 in 1.185s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-26c69273-d391-401a-9d40-80cc198e73c9 tempest-VolumesGetTest-684624965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-026255b1-48b9-4bbe-9bb8-abb15c13a111 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-03f450ab-ca27-430f-9774-2d2f2449ce0c tempest-VolumesActionsTest-1764575982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-03f450ab-ca27-430f-9774-2d2f2449ce0c tempest-VolumesActionsTest-1764575982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:37 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-03f450ab-ca27-430f-9774-2d2f2449ce0c tempest-VolumesActionsTest-1764575982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:23:37 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-03f450ab-ca27-430f-9774-2d2f2449ce0c tempest-VolumesActionsTest-1764575982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:23:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-03f450ab-ca27-430f-9774-2d2f2449ce0c tempest-VolumesActionsTest-1764575982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-03f450ab-ca27-430f-9774-2d2f2449ce0c tempest-VolumesActionsTest-1764575982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:37 devstack sudo[97063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-026255b1-48b9-4bbe-9bb8-abb15c13a111 Jul 07 08:23:37 devstack sudo[97063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:37 devstack sudo[97065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:23:37 devstack sudo[97065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:38 devstack sudo[97065]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-03f450ab-ca27-430f-9774-2d2f2449ce0c tempest-VolumesActionsTest-1764575982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.876s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:38 devstack sudo[97063]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:38 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-03f450ab-ca27-430f-9774-2d2f2449ce0c tempest-VolumesActionsTest-1764575982 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:23:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-26c69273-d391-401a-9d40-80cc198e73c9 tempest-VolumesGetTest-684624965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-026255b1-48b9-4bbe-9bb8-abb15c13a111" returned: 0 in 0.924s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:38 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-03f450ab-ca27-430f-9774-2d2f2449ce0c tempest-VolumesActionsTest-1764575982 None] Deleted volume successfully. Jul 07 08:23:38 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-26c69273-d391-401a-9d40-80cc198e73c9 tempest-VolumesGetTest-684624965 None] Lock "cinder-quobyte-026255b1-48b9-4bbe-9bb8-abb15c13a111" released by "delete_volume" :: held 2.193s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:23:38 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-03f450ab-ca27-430f-9774-2d2f2449ce0c tempest-VolumesActionsTest-1764575982 None] Lock "cinder-e449e361-1acf-4b2b-be19-992792f0f524-delete_volume" released by "delete_volume" :: held 3.716s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:23:38 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-26c69273-d391-401a-9d40-80cc198e73c9 tempest-VolumesGetTest-684624965 None] Created reservations ['af7f60bf-dcd5-47db-a492-345d399fa1c8', '6d51ba64-ba13-4e82-b881-28c35c66e91f', '350dae76-2248-43b4-904d-30a3f179eddc', 'be749edc-ec6b-40fd-a4e7-5ea971a66e3e'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:23:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-26c69273-d391-401a-9d40-80cc198e73c9 tempest-VolumesGetTest-684624965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-26c69273-d391-401a-9d40-80cc198e73c9 tempest-VolumesGetTest-684624965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:38 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-26c69273-d391-401a-9d40-80cc198e73c9 tempest-VolumesGetTest-684624965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:23:38 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-26c69273-d391-401a-9d40-80cc198e73c9 tempest-VolumesGetTest-684624965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:23:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-26c69273-d391-401a-9d40-80cc198e73c9 tempest-VolumesGetTest-684624965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-26c69273-d391-401a-9d40-80cc198e73c9 tempest-VolumesGetTest-684624965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:38 devstack sudo[97069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:23:38 devstack sudo[97069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:39 devstack sudo[97069]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-26c69273-d391-401a-9d40-80cc198e73c9 tempest-VolumesGetTest-684624965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 1.002s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:39 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-26c69273-d391-401a-9d40-80cc198e73c9 tempest-VolumesGetTest-684624965 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:23:39 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-26c69273-d391-401a-9d40-80cc198e73c9 tempest-VolumesGetTest-684624965 None] Deleted volume successfully. Jul 07 08:23:39 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-26c69273-d391-401a-9d40-80cc198e73c9 tempest-VolumesGetTest-684624965 None] Lock "cinder-026255b1-48b9-4bbe-9bb8-abb15c13a111-delete_volume" released by "delete_volume" :: held 3.525s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:23:39 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a5bed2f1-692f-4a11-8245-7b47e3542b48 tempest-VolumesGetTest-684624965 None] Acquiring lock "cinder-218e7788-5e49-41b0-aec4-74417feed94d-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:23:39 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a5bed2f1-692f-4a11-8245-7b47e3542b48 tempest-VolumesGetTest-684624965 None] Lock "cinder-218e7788-5e49-41b0-aec4-74417feed94d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:23:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a5bed2f1-692f-4a11-8245-7b47e3542b48 tempest-VolumesGetTest-684624965 None] Acquiring lock "cinder-quobyte-218e7788-5e49-41b0-aec4-74417feed94d" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:23:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a5bed2f1-692f-4a11-8245-7b47e3542b48 tempest-VolumesGetTest-684624965 None] Lock "cinder-quobyte-218e7788-5e49-41b0-aec4-74417feed94d" acquired by "delete_volume" :: waited 0.021s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:23:40 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7106df-8174-4aca-ae44-bf93c8f56a6f]: (4, 'raw') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:23:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a5bed2f1-692f-4a11-8245-7b47e3542b48 tempest-VolumesGetTest-684624965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-218e7788-5e49-41b0-aec4-74417feed94d {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:40 devstack sudo[97078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-218e7788-5e49-41b0-aec4-74417feed94d Jul 07 08:23:40 devstack sudo[97078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:41 devstack sudo[97078]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a5bed2f1-692f-4a11-8245-7b47e3542b48 tempest-VolumesGetTest-684624965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-218e7788-5e49-41b0-aec4-74417feed94d" returned: 0 in 1.104s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a5bed2f1-692f-4a11-8245-7b47e3542b48 tempest-VolumesGetTest-684624965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-218e7788-5e49-41b0-aec4-74417feed94d {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:41 devstack sudo[97099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-218e7788-5e49-41b0-aec4-74417feed94d Jul 07 08:23:41 devstack sudo[97099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:42 devstack sudo[97099]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a5bed2f1-692f-4a11-8245-7b47e3542b48 tempest-VolumesGetTest-684624965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-218e7788-5e49-41b0-aec4-74417feed94d" returned: 1 in 0.989s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a5bed2f1-692f-4a11-8245-7b47e3542b48 tempest-VolumesGetTest-684624965 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-218e7788-5e49-41b0-aec4-74417feed94d' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:23:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a5bed2f1-692f-4a11-8245-7b47e3542b48 tempest-VolumesGetTest-684624965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-218e7788-5e49-41b0-aec4-74417feed94d {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:42 devstack sudo[97105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-218e7788-5e49-41b0-aec4-74417feed94d Jul 07 08:23:42 devstack sudo[97105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:43 devstack sudo[97105]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a5bed2f1-692f-4a11-8245-7b47e3542b48 tempest-VolumesGetTest-684624965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-218e7788-5e49-41b0-aec4-74417feed94d" returned: 0 in 0.904s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:43 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a5bed2f1-692f-4a11-8245-7b47e3542b48 tempest-VolumesGetTest-684624965 None] Lock "cinder-quobyte-218e7788-5e49-41b0-aec4-74417feed94d" released by "delete_volume" :: held 3.081s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:23:43 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-a5bed2f1-692f-4a11-8245-7b47e3542b48 tempest-VolumesGetTest-684624965 None] Created reservations ['9589abf0-0611-47e3-9c75-b5216f22990a', 'c4d29c28-26a7-4755-841c-6934b99286d1', '45159678-fe77-4593-b013-7bf7c0e11730', '4fcc29ce-94ec-42a7-83e7-701cdd7502a7'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:23:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a5bed2f1-692f-4a11-8245-7b47e3542b48 tempest-VolumesGetTest-684624965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a5bed2f1-692f-4a11-8245-7b47e3542b48 tempest-VolumesGetTest-684624965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:43 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a5bed2f1-692f-4a11-8245-7b47e3542b48 tempest-VolumesGetTest-684624965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:23:43 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a5bed2f1-692f-4a11-8245-7b47e3542b48 tempest-VolumesGetTest-684624965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:23:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a5bed2f1-692f-4a11-8245-7b47e3542b48 tempest-VolumesGetTest-684624965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a5bed2f1-692f-4a11-8245-7b47e3542b48 tempest-VolumesGetTest-684624965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:43 devstack sudo[97109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:23:43 devstack sudo[97109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:44 devstack sudo[97109]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a5bed2f1-692f-4a11-8245-7b47e3542b48 tempest-VolumesGetTest-684624965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.890s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:44 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-a5bed2f1-692f-4a11-8245-7b47e3542b48 tempest-VolumesGetTest-684624965 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:23:44 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-a5bed2f1-692f-4a11-8245-7b47e3542b48 tempest-VolumesGetTest-684624965 None] Deleted volume successfully. Jul 07 08:23:44 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a5bed2f1-692f-4a11-8245-7b47e3542b48 tempest-VolumesGetTest-684624965 None] Lock "cinder-218e7788-5e49-41b0-aec4-74417feed94d-delete_volume" released by "delete_volume" :: held 4.286s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:23:44 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9b8a689-b856-4e76-877a-9e4723e2f9b7 tempest-CreateVolumesFromImageTest-908341297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:23:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d9b8a689-b856-4e76-877a-9e4723e2f9b7 tempest-CreateVolumesFromImageTest-908341297 None] Flow 'volume_create_manager' (79ab552f-a0f5-4dbb-afd5-76cb3918f44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:23:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d9b8a689-b856-4e76-877a-9e4723e2f9b7 tempest-CreateVolumesFromImageTest-908341297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80cc53bc-8503-4552-ab65-40c24a429b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d9b8a689-b856-4e76-877a-9e4723e2f9b7 tempest-CreateVolumesFromImageTest-908341297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80cc53bc-8503-4552-ab65-40c24a429b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:23:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2094542970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e42f7a06-99b8-443a-97c4-3a6cecb95008,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d29102d2315a43bfbcab4010bfde2ded',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:23:45Z,use_quota=True,user_id='154649af8c3a464185bbff039636557e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d9b8a689-b856-4e76-877a-9e4723e2f9b7 tempest-CreateVolumesFromImageTest-908341297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1ea72ac-4c2f-467c-8cfc-336716f5d57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d9b8a689-b856-4e76-877a-9e4723e2f9b7 tempest-CreateVolumesFromImageTest-908341297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1ea72ac-4c2f-467c-8cfc-336716f5d57b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d9b8a689-b856-4e76-877a-9e4723e2f9b7 tempest-CreateVolumesFromImageTest-908341297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21c9c182-4af7-4c24-9008-619256c7eec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d9b8a689-b856-4e76-877a-9e4723e2f9b7 tempest-CreateVolumesFromImageTest-908341297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21c9c182-4af7-4c24-9008-619256c7eec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e42f7a06-99b8-443a-97c4-3a6cecb95008', 'volume_name': 'volume-e42f7a06-99b8-443a-97c4-3a6cecb95008', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d9b8a689-b856-4e76-877a-9e4723e2f9b7 tempest-CreateVolumesFromImageTest-908341297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6872e07-9adb-4f9a-b06e-7787dd18f705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d9b8a689-b856-4e76-877a-9e4723e2f9b7 tempest-CreateVolumesFromImageTest-908341297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6872e07-9adb-4f9a-b06e-7787dd18f705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d9b8a689-b856-4e76-877a-9e4723e2f9b7 tempest-CreateVolumesFromImageTest-908341297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbaedfbe-4ed5-4c84-91bd-f4d589ef62f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:44 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-d9b8a689-b856-4e76-877a-9e4723e2f9b7 tempest-CreateVolumesFromImageTest-908341297 None] Volume e42f7a06-99b8-443a-97c4-3a6cecb95008: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e42f7a06-99b8-443a-97c4-3a6cecb95008', 'volume_size': 1} Jul 07 08:23:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d9b8a689-b856-4e76-877a-9e4723e2f9b7 tempest-CreateVolumesFromImageTest-908341297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d9b8a689-b856-4e76-877a-9e4723e2f9b7 tempest-CreateVolumesFromImageTest-908341297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d9b8a689-b856-4e76-877a-9e4723e2f9b7 tempest-CreateVolumesFromImageTest-908341297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:23:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2094542970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e42f7a06-99b8-443a-97c4-3a6cecb95008,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d29102d2315a43bfbcab4010bfde2ded',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:23:45Z,use_quota=True,user_id='154649af8c3a464185bbff039636557e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:23:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-d9b8a689-b856-4e76-877a-9e4723e2f9b7 tempest-CreateVolumesFromImageTest-908341297 None] Creating volume e42f7a06-99b8-443a-97c4-3a6cecb95008 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:23:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d9b8a689-b856-4e76-877a-9e4723e2f9b7 tempest-CreateVolumesFromImageTest-908341297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d9b8a689-b856-4e76-877a-9e4723e2f9b7 tempest-CreateVolumesFromImageTest-908341297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d9b8a689-b856-4e76-877a-9e4723e2f9b7 tempest-CreateVolumesFromImageTest-908341297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:23:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d9b8a689-b856-4e76-877a-9e4723e2f9b7 tempest-CreateVolumesFromImageTest-908341297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:23:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d9b8a689-b856-4e76-877a-9e4723e2f9b7 tempest-CreateVolumesFromImageTest-908341297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d9b8a689-b856-4e76-877a-9e4723e2f9b7 tempest-CreateVolumesFromImageTest-908341297 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:23:44 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-d9b8a689-b856-4e76-877a-9e4723e2f9b7 tempest-CreateVolumesFromImageTest-908341297 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:23:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d9b8a689-b856-4e76-877a-9e4723e2f9b7 tempest-CreateVolumesFromImageTest-908341297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-e42f7a06-99b8-443a-97c4-3a6cecb95008 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:45 devstack sudo[97113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-e42f7a06-99b8-443a-97c4-3a6cecb95008 1073741824 Jul 07 08:23:45 devstack sudo[97113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:45 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7412acb-16b5-4298-bb7e-8a08d73af300 tempest-CreateVolumesFromImageTest-908341297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:23:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b7412acb-16b5-4298-bb7e-8a08d73af300 tempest-CreateVolumesFromImageTest-908341297 None] Flow 'volume_create_manager' (82ae7fec-37a9-47ee-8e76-f6ce330793a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:23:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b7412acb-16b5-4298-bb7e-8a08d73af300 tempest-CreateVolumesFromImageTest-908341297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbff7a58-b35f-4e41-8631-cc243a87f43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b7412acb-16b5-4298-bb7e-8a08d73af300 tempest-CreateVolumesFromImageTest-908341297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbff7a58-b35f-4e41-8631-cc243a87f43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:23:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-697844313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2ebeda2-bbcd-44f7-bab1-644968a609e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d29102d2315a43bfbcab4010bfde2ded',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:23:45Z,use_quota=True,user_id='154649af8c3a464185bbff039636557e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b7412acb-16b5-4298-bb7e-8a08d73af300 tempest-CreateVolumesFromImageTest-908341297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93b759e1-d1c4-4068-8385-fbc830dd4039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b7412acb-16b5-4298-bb7e-8a08d73af300 tempest-CreateVolumesFromImageTest-908341297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93b759e1-d1c4-4068-8385-fbc830dd4039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b7412acb-16b5-4298-bb7e-8a08d73af300 tempest-CreateVolumesFromImageTest-908341297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (244dd923-de23-47ab-bb31-0ea2f236cd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b7412acb-16b5-4298-bb7e-8a08d73af300 tempest-CreateVolumesFromImageTest-908341297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (244dd923-de23-47ab-bb31-0ea2f236cd39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2ebeda2-bbcd-44f7-bab1-644968a609e9', 'volume_name': 'volume-a2ebeda2-bbcd-44f7-bab1-644968a609e9', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b7412acb-16b5-4298-bb7e-8a08d73af300 tempest-CreateVolumesFromImageTest-908341297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01686f80-8206-44a1-9d1f-74a5c37aa7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b7412acb-16b5-4298-bb7e-8a08d73af300 tempest-CreateVolumesFromImageTest-908341297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01686f80-8206-44a1-9d1f-74a5c37aa7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b7412acb-16b5-4298-bb7e-8a08d73af300 tempest-CreateVolumesFromImageTest-908341297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31426a0f-81b6-4b0f-8db7-b0d9b3744752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:45 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-b7412acb-16b5-4298-bb7e-8a08d73af300 tempest-CreateVolumesFromImageTest-908341297 None] Volume a2ebeda2-bbcd-44f7-bab1-644968a609e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2ebeda2-bbcd-44f7-bab1-644968a609e9', 'volume_size': 1} Jul 07 08:23:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b7412acb-16b5-4298-bb7e-8a08d73af300 tempest-CreateVolumesFromImageTest-908341297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:45 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f1bcbb4-dc7a-489a-be0b-a826701f281e tempest-CreateVolumesFromImageTest-908341297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:23:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7f1bcbb4-dc7a-489a-be0b-a826701f281e tempest-CreateVolumesFromImageTest-908341297 None] Flow 'volume_create_manager' (4f62b1ff-a3e9-4629-95ca-8fc2a7df66fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:23:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7f1bcbb4-dc7a-489a-be0b-a826701f281e tempest-CreateVolumesFromImageTest-908341297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a64823f-c16f-4559-8eeb-64b9544af838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7f1bcbb4-dc7a-489a-be0b-a826701f281e tempest-CreateVolumesFromImageTest-908341297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a64823f-c16f-4559-8eeb-64b9544af838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:23:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-409172605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa13175e-c8be-4111-8df2-ff9469f34fff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d29102d2315a43bfbcab4010bfde2ded',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:23:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:23:46Z,use_quota=True,user_id='154649af8c3a464185bbff039636557e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7f1bcbb4-dc7a-489a-be0b-a826701f281e tempest-CreateVolumesFromImageTest-908341297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2da7a210-3107-404d-820c-9ef047b1dd1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:46 devstack sudo[97113]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7f1bcbb4-dc7a-489a-be0b-a826701f281e tempest-CreateVolumesFromImageTest-908341297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2da7a210-3107-404d-820c-9ef047b1dd1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7f1bcbb4-dc7a-489a-be0b-a826701f281e tempest-CreateVolumesFromImageTest-908341297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69bffb09-86eb-45d4-8fa2-69fe800fbc85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7f1bcbb4-dc7a-489a-be0b-a826701f281e tempest-CreateVolumesFromImageTest-908341297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69bffb09-86eb-45d4-8fa2-69fe800fbc85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa13175e-c8be-4111-8df2-ff9469f34fff', 'volume_name': 'volume-aa13175e-c8be-4111-8df2-ff9469f34fff', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7f1bcbb4-dc7a-489a-be0b-a826701f281e tempest-CreateVolumesFromImageTest-908341297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ce75469-7d96-471e-bac6-f2d64057f313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7f1bcbb4-dc7a-489a-be0b-a826701f281e tempest-CreateVolumesFromImageTest-908341297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ce75469-7d96-471e-bac6-f2d64057f313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7f1bcbb4-dc7a-489a-be0b-a826701f281e tempest-CreateVolumesFromImageTest-908341297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cdbe35b-b356-4744-958e-f30b167e14a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:46 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-7f1bcbb4-dc7a-489a-be0b-a826701f281e tempest-CreateVolumesFromImageTest-908341297 None] Volume aa13175e-c8be-4111-8df2-ff9469f34fff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa13175e-c8be-4111-8df2-ff9469f34fff', 'volume_size': 1} Jul 07 08:23:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7f1bcbb4-dc7a-489a-be0b-a826701f281e tempest-CreateVolumesFromImageTest-908341297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d9b8a689-b856-4e76-877a-9e4723e2f9b7 tempest-CreateVolumesFromImageTest-908341297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-e42f7a06-99b8-443a-97c4-3a6cecb95008 1073741824" returned: 0 in 1.301s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d9b8a689-b856-4e76-877a-9e4723e2f9b7 tempest-CreateVolumesFromImageTest-908341297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-e42f7a06-99b8-443a-97c4-3a6cecb95008 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:46 devstack sudo[97121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-e42f7a06-99b8-443a-97c4-3a6cecb95008 Jul 07 08:23:46 devstack sudo[97121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:46 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-2acf2c75-43a4-4592-9c99-0d3628bf1ad9 tempest-CreateVolumesFromImageTest-908341297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:23:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2acf2c75-43a4-4592-9c99-0d3628bf1ad9 tempest-CreateVolumesFromImageTest-908341297 None] Flow 'volume_create_manager' (baba745b-f673-4bf8-b184-cf9cac695410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:23:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2acf2c75-43a4-4592-9c99-0d3628bf1ad9 tempest-CreateVolumesFromImageTest-908341297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a3edc09-605b-4ec4-b816-dcc992b62bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2acf2c75-43a4-4592-9c99-0d3628bf1ad9 tempest-CreateVolumesFromImageTest-908341297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a3edc09-605b-4ec4-b816-dcc992b62bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:23:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1856787240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3770799-774b-4372-9b4e-4b5807eac302,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d29102d2315a43bfbcab4010bfde2ded',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:23:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:23:47Z,use_quota=True,user_id='154649af8c3a464185bbff039636557e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2acf2c75-43a4-4592-9c99-0d3628bf1ad9 tempest-CreateVolumesFromImageTest-908341297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95be1fbd-3883-4682-a6f5-1a41407f186f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2acf2c75-43a4-4592-9c99-0d3628bf1ad9 tempest-CreateVolumesFromImageTest-908341297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95be1fbd-3883-4682-a6f5-1a41407f186f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2acf2c75-43a4-4592-9c99-0d3628bf1ad9 tempest-CreateVolumesFromImageTest-908341297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ff84da0-6ea9-48aa-ab19-f8016d8d5eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2acf2c75-43a4-4592-9c99-0d3628bf1ad9 tempest-CreateVolumesFromImageTest-908341297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ff84da0-6ea9-48aa-ab19-f8016d8d5eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3770799-774b-4372-9b4e-4b5807eac302', 'volume_name': 'volume-d3770799-774b-4372-9b4e-4b5807eac302', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2acf2c75-43a4-4592-9c99-0d3628bf1ad9 tempest-CreateVolumesFromImageTest-908341297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (978b1b8f-04f8-4ff6-ae8c-9042e1fa73ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2acf2c75-43a4-4592-9c99-0d3628bf1ad9 tempest-CreateVolumesFromImageTest-908341297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (978b1b8f-04f8-4ff6-ae8c-9042e1fa73ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2acf2c75-43a4-4592-9c99-0d3628bf1ad9 tempest-CreateVolumesFromImageTest-908341297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30908566-5f81-4507-a55b-a22622c2c06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:46 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-2acf2c75-43a4-4592-9c99-0d3628bf1ad9 tempest-CreateVolumesFromImageTest-908341297 None] Volume d3770799-774b-4372-9b4e-4b5807eac302: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3770799-774b-4372-9b4e-4b5807eac302', 'volume_size': 1} Jul 07 08:23:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-2acf2c75-43a4-4592-9c99-0d3628bf1ad9 tempest-CreateVolumesFromImageTest-908341297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:47 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-10b38d74-6e20-4e38-b346-d778d6ae15be tempest-CreateVolumesFromImageTest-908341297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:23:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-10b38d74-6e20-4e38-b346-d778d6ae15be tempest-CreateVolumesFromImageTest-908341297 None] Flow 'volume_create_manager' (80557b57-b136-489c-a6a6-dad54bece64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:23:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-10b38d74-6e20-4e38-b346-d778d6ae15be tempest-CreateVolumesFromImageTest-908341297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e2852eb-5bd9-4c55-a7dd-a8338b3438ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-10b38d74-6e20-4e38-b346-d778d6ae15be tempest-CreateVolumesFromImageTest-908341297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e2852eb-5bd9-4c55-a7dd-a8338b3438ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-329939326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ac8a73f-e28b-4fd9-81d9-b432d21fa707,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d29102d2315a43bfbcab4010bfde2ded',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:23:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:23:47Z,use_quota=True,user_id='154649af8c3a464185bbff039636557e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-10b38d74-6e20-4e38-b346-d778d6ae15be tempest-CreateVolumesFromImageTest-908341297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c019406-c14f-4beb-8144-dc398c997dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-10b38d74-6e20-4e38-b346-d778d6ae15be tempest-CreateVolumesFromImageTest-908341297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c019406-c14f-4beb-8144-dc398c997dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-10b38d74-6e20-4e38-b346-d778d6ae15be tempest-CreateVolumesFromImageTest-908341297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f5e3c96-8293-497a-8fbe-4b5efa34239f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-10b38d74-6e20-4e38-b346-d778d6ae15be tempest-CreateVolumesFromImageTest-908341297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f5e3c96-8293-497a-8fbe-4b5efa34239f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ac8a73f-e28b-4fd9-81d9-b432d21fa707', 'volume_name': 'volume-2ac8a73f-e28b-4fd9-81d9-b432d21fa707', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-10b38d74-6e20-4e38-b346-d778d6ae15be tempest-CreateVolumesFromImageTest-908341297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc5ed0c1-30d8-40a1-a758-200c45712e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-10b38d74-6e20-4e38-b346-d778d6ae15be tempest-CreateVolumesFromImageTest-908341297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc5ed0c1-30d8-40a1-a758-200c45712e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-10b38d74-6e20-4e38-b346-d778d6ae15be tempest-CreateVolumesFromImageTest-908341297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ce508d5-dd8f-426f-89d0-2ba0e61fc3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:47 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-10b38d74-6e20-4e38-b346-d778d6ae15be tempest-CreateVolumesFromImageTest-908341297 None] Volume 2ac8a73f-e28b-4fd9-81d9-b432d21fa707: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ac8a73f-e28b-4fd9-81d9-b432d21fa707', 'volume_size': 1} Jul 07 08:23:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-10b38d74-6e20-4e38-b346-d778d6ae15be tempest-CreateVolumesFromImageTest-908341297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:47 devstack sudo[97121]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d9b8a689-b856-4e76-877a-9e4723e2f9b7 tempest-CreateVolumesFromImageTest-908341297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-e42f7a06-99b8-443a-97c4-3a6cecb95008" returned: 0 in 1.104s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d9b8a689-b856-4e76-877a-9e4723e2f9b7 tempest-CreateVolumesFromImageTest-908341297 None] <== create_volume: return (2488ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:23:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d9b8a689-b856-4e76-877a-9e4723e2f9b7 tempest-CreateVolumesFromImageTest-908341297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.492s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b7412acb-16b5-4298-bb7e-8a08d73af300 tempest-CreateVolumesFromImageTest-908341297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.833s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b7412acb-16b5-4298-bb7e-8a08d73af300 tempest-CreateVolumesFromImageTest-908341297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:23:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-697844313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2ebeda2-bbcd-44f7-bab1-644968a609e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d29102d2315a43bfbcab4010bfde2ded',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:23:45Z,use_quota=True,user_id='154649af8c3a464185bbff039636557e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:23:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-b7412acb-16b5-4298-bb7e-8a08d73af300 tempest-CreateVolumesFromImageTest-908341297 None] Creating volume a2ebeda2-bbcd-44f7-bab1-644968a609e9 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:23:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b7412acb-16b5-4298-bb7e-8a08d73af300 tempest-CreateVolumesFromImageTest-908341297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b7412acb-16b5-4298-bb7e-8a08d73af300 tempest-CreateVolumesFromImageTest-908341297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b7412acb-16b5-4298-bb7e-8a08d73af300 tempest-CreateVolumesFromImageTest-908341297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:23:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b7412acb-16b5-4298-bb7e-8a08d73af300 tempest-CreateVolumesFromImageTest-908341297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:23:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b7412acb-16b5-4298-bb7e-8a08d73af300 tempest-CreateVolumesFromImageTest-908341297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b7412acb-16b5-4298-bb7e-8a08d73af300 tempest-CreateVolumesFromImageTest-908341297 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:23:47 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-b7412acb-16b5-4298-bb7e-8a08d73af300 tempest-CreateVolumesFromImageTest-908341297 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:23:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b7412acb-16b5-4298-bb7e-8a08d73af300 tempest-CreateVolumesFromImageTest-908341297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-a2ebeda2-bbcd-44f7-bab1-644968a609e9 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:47 devstack sudo[97127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-a2ebeda2-bbcd-44f7-bab1-644968a609e9 1073741824 Jul 07 08:23:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d9b8a689-b856-4e76-877a-9e4723e2f9b7 tempest-CreateVolumesFromImageTest-908341297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbaedfbe-4ed5-4c84-91bd-f4d589ef62f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e42f7a06-99b8-443a-97c4-3a6cecb95008', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:47 devstack sudo[97127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d9b8a689-b856-4e76-877a-9e4723e2f9b7 tempest-CreateVolumesFromImageTest-908341297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cef2c532-3b55-4014-b878-7d24a924e8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:47 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-d9b8a689-b856-4e76-877a-9e4723e2f9b7 tempest-CreateVolumesFromImageTest-908341297 None] Volume volume-e42f7a06-99b8-443a-97c4-3a6cecb95008 (e42f7a06-99b8-443a-97c4-3a6cecb95008): created successfully Jul 07 08:23:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d9b8a689-b856-4e76-877a-9e4723e2f9b7 tempest-CreateVolumesFromImageTest-908341297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cef2c532-3b55-4014-b878-7d24a924e8b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d9b8a689-b856-4e76-877a-9e4723e2f9b7 tempest-CreateVolumesFromImageTest-908341297 None] Flow 'volume_create_manager' (79ab552f-a0f5-4dbb-afd5-76cb3918f44c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:23:47 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-d9b8a689-b856-4e76-877a-9e4723e2f9b7 tempest-CreateVolumesFromImageTest-908341297 None] Created volume successfully. Jul 07 08:23:48 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-274076b4-9d35-428c-8583-0ab66a01a7d8 tempest-VolumesActionsTest-1764575982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:23:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-274076b4-9d35-428c-8583-0ab66a01a7d8 tempest-VolumesActionsTest-1764575982 None] Flow 'volume_create_manager' (65d6f178-4e40-4d6f-bfa0-33040b58709a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:23:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-274076b4-9d35-428c-8583-0ab66a01a7d8 tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3ee9b78-a3b4-494d-a740-e7af06353f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-274076b4-9d35-428c-8583-0ab66a01a7d8 tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3ee9b78-a3b4-494d-a740-e7af06353f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2142314792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08b5dce0-cdbc-4491-9d38-ac6772a730a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68368676a64749b3ba414b1751a5abaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:23:48Z,use_quota=True,user_id='6717bb48e52b40fc92e585e3937702d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-274076b4-9d35-428c-8583-0ab66a01a7d8 tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6140397-23ff-450b-a967-e5254e90de5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-274076b4-9d35-428c-8583-0ab66a01a7d8 tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6140397-23ff-450b-a967-e5254e90de5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-274076b4-9d35-428c-8583-0ab66a01a7d8 tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eb8422a-d558-4945-a6b8-733dfdae9a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-274076b4-9d35-428c-8583-0ab66a01a7d8 tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eb8422a-d558-4945-a6b8-733dfdae9a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08b5dce0-cdbc-4491-9d38-ac6772a730a0', 'volume_name': 'volume-08b5dce0-cdbc-4491-9d38-ac6772a730a0', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-274076b4-9d35-428c-8583-0ab66a01a7d8 tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57775d9a-257b-4260-8929-1e00f489d8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-274076b4-9d35-428c-8583-0ab66a01a7d8 tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57775d9a-257b-4260-8929-1e00f489d8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-274076b4-9d35-428c-8583-0ab66a01a7d8 tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dee8b527-8e42-42e4-8768-5e86ee406b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:48 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-274076b4-9d35-428c-8583-0ab66a01a7d8 tempest-VolumesActionsTest-1764575982 None] Volume 08b5dce0-cdbc-4491-9d38-ac6772a730a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08b5dce0-cdbc-4491-9d38-ac6772a730a0', 'volume_size': 1} Jul 07 08:23:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-274076b4-9d35-428c-8583-0ab66a01a7d8 tempest-VolumesActionsTest-1764575982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:48 devstack sudo[97127]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b7412acb-16b5-4298-bb7e-8a08d73af300 tempest-CreateVolumesFromImageTest-908341297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-a2ebeda2-bbcd-44f7-bab1-644968a609e9 1073741824" returned: 0 in 1.238s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b7412acb-16b5-4298-bb7e-8a08d73af300 tempest-CreateVolumesFromImageTest-908341297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-a2ebeda2-bbcd-44f7-bab1-644968a609e9 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:48 devstack sudo[97134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-a2ebeda2-bbcd-44f7-bab1-644968a609e9 Jul 07 08:23:48 devstack sudo[97134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:49 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-88c81390-8041-4d1a-81a6-c5e6f4ba4c62 tempest-VolumesSnapshotTestJSON-1862037507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:23:49 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-88c81390-8041-4d1a-81a6-c5e6f4ba4c62 tempest-VolumesSnapshotTestJSON-1862037507 None] Flow 'volume_create_manager' (11a35dfe-e6fe-4d0b-8894-3731e7112b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:23:49 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-88c81390-8041-4d1a-81a6-c5e6f4ba4c62 tempest-VolumesSnapshotTestJSON-1862037507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1058c5fe-dfb2-4187-ae4e-0ab0cc3f4b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:49 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-88c81390-8041-4d1a-81a6-c5e6f4ba4c62 tempest-VolumesSnapshotTestJSON-1862037507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1058c5fe-dfb2-4187-ae4e-0ab0cc3f4b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1038185559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3feee3cf-f80c-4b87-ad0b-2df93c769b97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09a4265f78884f7396b49574ccdee3af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:23:49Z,use_quota=True,user_id='775b8acb218a4afa93d6a15c0d98c531',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:49 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-88c81390-8041-4d1a-81a6-c5e6f4ba4c62 tempest-VolumesSnapshotTestJSON-1862037507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (084d1027-3fd2-486c-8dd3-4dafd5ad1b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:49 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-88c81390-8041-4d1a-81a6-c5e6f4ba4c62 tempest-VolumesSnapshotTestJSON-1862037507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (084d1027-3fd2-486c-8dd3-4dafd5ad1b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:49 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-88c81390-8041-4d1a-81a6-c5e6f4ba4c62 tempest-VolumesSnapshotTestJSON-1862037507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3363ef53-83df-4895-b05c-a6b3cfe6a1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:49 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-88c81390-8041-4d1a-81a6-c5e6f4ba4c62 tempest-VolumesSnapshotTestJSON-1862037507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3363ef53-83df-4895-b05c-a6b3cfe6a1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3feee3cf-f80c-4b87-ad0b-2df93c769b97', 'volume_name': 'volume-3feee3cf-f80c-4b87-ad0b-2df93c769b97', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:49 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-88c81390-8041-4d1a-81a6-c5e6f4ba4c62 tempest-VolumesSnapshotTestJSON-1862037507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f8696fd-eddb-4724-8763-552bc8380026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:49 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-88c81390-8041-4d1a-81a6-c5e6f4ba4c62 tempest-VolumesSnapshotTestJSON-1862037507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f8696fd-eddb-4724-8763-552bc8380026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:49 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-88c81390-8041-4d1a-81a6-c5e6f4ba4c62 tempest-VolumesSnapshotTestJSON-1862037507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88f5cdfb-f287-489e-a901-4d0a194cafe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:49 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-88c81390-8041-4d1a-81a6-c5e6f4ba4c62 tempest-VolumesSnapshotTestJSON-1862037507 None] Volume 3feee3cf-f80c-4b87-ad0b-2df93c769b97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3feee3cf-f80c-4b87-ad0b-2df93c769b97', 'volume_size': 1} Jul 07 08:23:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-88c81390-8041-4d1a-81a6-c5e6f4ba4c62 tempest-VolumesSnapshotTestJSON-1862037507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:49 devstack sudo[97134]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b7412acb-16b5-4298-bb7e-8a08d73af300 tempest-CreateVolumesFromImageTest-908341297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-a2ebeda2-bbcd-44f7-bab1-644968a609e9" returned: 0 in 0.887s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:49 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b7412acb-16b5-4298-bb7e-8a08d73af300 tempest-CreateVolumesFromImageTest-908341297 None] <== create_volume: return (2175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:23:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b7412acb-16b5-4298-bb7e-8a08d73af300 tempest-CreateVolumesFromImageTest-908341297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.178s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7f1bcbb4-dc7a-489a-be0b-a826701f281e tempest-CreateVolumesFromImageTest-908341297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.364s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:49 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-7f1bcbb4-dc7a-489a-be0b-a826701f281e tempest-CreateVolumesFromImageTest-908341297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:23:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-409172605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa13175e-c8be-4111-8df2-ff9469f34fff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d29102d2315a43bfbcab4010bfde2ded',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:23:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:23:46Z,use_quota=True,user_id='154649af8c3a464185bbff039636557e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:23:49 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-7f1bcbb4-dc7a-489a-be0b-a826701f281e tempest-CreateVolumesFromImageTest-908341297 None] Creating volume aa13175e-c8be-4111-8df2-ff9469f34fff {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:23:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7f1bcbb4-dc7a-489a-be0b-a826701f281e tempest-CreateVolumesFromImageTest-908341297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7f1bcbb4-dc7a-489a-be0b-a826701f281e tempest-CreateVolumesFromImageTest-908341297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:49 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-7f1bcbb4-dc7a-489a-be0b-a826701f281e tempest-CreateVolumesFromImageTest-908341297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:23:49 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-7f1bcbb4-dc7a-489a-be0b-a826701f281e tempest-CreateVolumesFromImageTest-908341297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:23:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7f1bcbb4-dc7a-489a-be0b-a826701f281e tempest-CreateVolumesFromImageTest-908341297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:49 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-7f1bcbb4-dc7a-489a-be0b-a826701f281e tempest-CreateVolumesFromImageTest-908341297 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:23:49 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-7f1bcbb4-dc7a-489a-be0b-a826701f281e tempest-CreateVolumesFromImageTest-908341297 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:23:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7f1bcbb4-dc7a-489a-be0b-a826701f281e tempest-CreateVolumesFromImageTest-908341297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-aa13175e-c8be-4111-8df2-ff9469f34fff 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:49 devstack sudo[97137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-aa13175e-c8be-4111-8df2-ff9469f34fff 1073741824 Jul 07 08:23:49 devstack sudo[97137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:49 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b7412acb-16b5-4298-bb7e-8a08d73af300 tempest-CreateVolumesFromImageTest-908341297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31426a0f-81b6-4b0f-8db7-b0d9b3744752) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2ebeda2-bbcd-44f7-bab1-644968a609e9', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:49 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b7412acb-16b5-4298-bb7e-8a08d73af300 tempest-CreateVolumesFromImageTest-908341297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f416c954-a896-4ae1-aff4-5548c645235f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:49 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-b7412acb-16b5-4298-bb7e-8a08d73af300 tempest-CreateVolumesFromImageTest-908341297 None] Volume volume-a2ebeda2-bbcd-44f7-bab1-644968a609e9 (a2ebeda2-bbcd-44f7-bab1-644968a609e9): created successfully Jul 07 08:23:49 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b7412acb-16b5-4298-bb7e-8a08d73af300 tempest-CreateVolumesFromImageTest-908341297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f416c954-a896-4ae1-aff4-5548c645235f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:49 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b7412acb-16b5-4298-bb7e-8a08d73af300 tempest-CreateVolumesFromImageTest-908341297 None] Flow 'volume_create_manager' (82ae7fec-37a9-47ee-8e76-f6ce330793a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:23:49 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-b7412acb-16b5-4298-bb7e-8a08d73af300 tempest-CreateVolumesFromImageTest-908341297 None] Created volume successfully. Jul 07 08:23:50 devstack sudo[97137]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7f1bcbb4-dc7a-489a-be0b-a826701f281e tempest-CreateVolumesFromImageTest-908341297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-aa13175e-c8be-4111-8df2-ff9469f34fff 1073741824" returned: 0 in 0.928s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7f1bcbb4-dc7a-489a-be0b-a826701f281e tempest-CreateVolumesFromImageTest-908341297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-aa13175e-c8be-4111-8df2-ff9469f34fff {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:50 devstack sudo[97143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-aa13175e-c8be-4111-8df2-ff9469f34fff Jul 07 08:23:50 devstack sudo[97143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:51 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1f6fdea-01b1-4bbc-afca-4f8220512dab tempest-VolumesListTestJSON-1975080058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:23:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a1f6fdea-01b1-4bbc-afca-4f8220512dab tempest-VolumesListTestJSON-1975080058 None] Flow 'volume_create_manager' (255b4217-eda1-4eac-8400-48e879db78df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:23:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a1f6fdea-01b1-4bbc-afca-4f8220512dab tempest-VolumesListTestJSON-1975080058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (711dc72d-55af-4036-b5ef-878a5af02821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a1f6fdea-01b1-4bbc-afca-4f8220512dab tempest-VolumesListTestJSON-1975080058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (711dc72d-55af-4036-b5ef-878a5af02821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-249261500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e57c9a0-691f-46d7-8bc1-a323784e3d9f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fdb2f05404e7490196d791e6b89ad667',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:23:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:23:51Z,use_quota=True,user_id='9c9e467030a04dc1b7657d447fafee39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:51 devstack sudo[97143]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a1f6fdea-01b1-4bbc-afca-4f8220512dab tempest-VolumesListTestJSON-1975080058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3f4d6a2-344e-442a-adab-94dc92aba237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a1f6fdea-01b1-4bbc-afca-4f8220512dab tempest-VolumesListTestJSON-1975080058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3f4d6a2-344e-442a-adab-94dc92aba237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a1f6fdea-01b1-4bbc-afca-4f8220512dab tempest-VolumesListTestJSON-1975080058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60f30337-1004-4948-8157-0cc61f722924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a1f6fdea-01b1-4bbc-afca-4f8220512dab tempest-VolumesListTestJSON-1975080058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60f30337-1004-4948-8157-0cc61f722924) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e57c9a0-691f-46d7-8bc1-a323784e3d9f', 'volume_name': 'volume-5e57c9a0-691f-46d7-8bc1-a323784e3d9f', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a1f6fdea-01b1-4bbc-afca-4f8220512dab tempest-VolumesListTestJSON-1975080058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a74abcd-b576-4dc3-a0d4-39653a3744e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a1f6fdea-01b1-4bbc-afca-4f8220512dab tempest-VolumesListTestJSON-1975080058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a74abcd-b576-4dc3-a0d4-39653a3744e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a1f6fdea-01b1-4bbc-afca-4f8220512dab tempest-VolumesListTestJSON-1975080058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5bb2ff5-95be-475b-a5ee-9a23bd024b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:51 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-a1f6fdea-01b1-4bbc-afca-4f8220512dab tempest-VolumesListTestJSON-1975080058 None] Volume 5e57c9a0-691f-46d7-8bc1-a323784e3d9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e57c9a0-691f-46d7-8bc1-a323784e3d9f', 'volume_size': 1} Jul 07 08:23:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a1f6fdea-01b1-4bbc-afca-4f8220512dab tempest-VolumesListTestJSON-1975080058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7f1bcbb4-dc7a-489a-be0b-a826701f281e tempest-CreateVolumesFromImageTest-908341297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-aa13175e-c8be-4111-8df2-ff9469f34fff" returned: 0 in 0.709s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:51 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-7f1bcbb4-dc7a-489a-be0b-a826701f281e tempest-CreateVolumesFromImageTest-908341297 None] <== create_volume: return (1679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:23:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7f1bcbb4-dc7a-489a-be0b-a826701f281e tempest-CreateVolumesFromImageTest-908341297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.681s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-2acf2c75-43a4-4592-9c99-0d3628bf1ad9 tempest-CreateVolumesFromImageTest-908341297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.585s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:51 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-2acf2c75-43a4-4592-9c99-0d3628bf1ad9 tempest-CreateVolumesFromImageTest-908341297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:23:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1856787240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3770799-774b-4372-9b4e-4b5807eac302,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d29102d2315a43bfbcab4010bfde2ded',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:23:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:23:47Z,use_quota=True,user_id='154649af8c3a464185bbff039636557e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:23:51 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-2acf2c75-43a4-4592-9c99-0d3628bf1ad9 tempest-CreateVolumesFromImageTest-908341297 None] Creating volume d3770799-774b-4372-9b4e-4b5807eac302 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:23:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-2acf2c75-43a4-4592-9c99-0d3628bf1ad9 tempest-CreateVolumesFromImageTest-908341297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-2acf2c75-43a4-4592-9c99-0d3628bf1ad9 tempest-CreateVolumesFromImageTest-908341297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:51 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-2acf2c75-43a4-4592-9c99-0d3628bf1ad9 tempest-CreateVolumesFromImageTest-908341297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:23:51 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-2acf2c75-43a4-4592-9c99-0d3628bf1ad9 tempest-CreateVolumesFromImageTest-908341297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:23:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-2acf2c75-43a4-4592-9c99-0d3628bf1ad9 tempest-CreateVolumesFromImageTest-908341297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:51 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-2acf2c75-43a4-4592-9c99-0d3628bf1ad9 tempest-CreateVolumesFromImageTest-908341297 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:23:51 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-2acf2c75-43a4-4592-9c99-0d3628bf1ad9 tempest-CreateVolumesFromImageTest-908341297 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:23:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-2acf2c75-43a4-4592-9c99-0d3628bf1ad9 tempest-CreateVolumesFromImageTest-908341297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d3770799-774b-4372-9b4e-4b5807eac302 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7f1bcbb4-dc7a-489a-be0b-a826701f281e tempest-CreateVolumesFromImageTest-908341297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cdbe35b-b356-4744-958e-f30b167e14a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa13175e-c8be-4111-8df2-ff9469f34fff', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7f1bcbb4-dc7a-489a-be0b-a826701f281e tempest-CreateVolumesFromImageTest-908341297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fed6439-c77a-41c5-9e6b-dc1b3ab963ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:51 devstack sudo[97147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d3770799-774b-4372-9b4e-4b5807eac302 1073741824 Jul 07 08:23:51 devstack sudo[97147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:51 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-7f1bcbb4-dc7a-489a-be0b-a826701f281e tempest-CreateVolumesFromImageTest-908341297 None] Volume volume-aa13175e-c8be-4111-8df2-ff9469f34fff (aa13175e-c8be-4111-8df2-ff9469f34fff): created successfully Jul 07 08:23:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7f1bcbb4-dc7a-489a-be0b-a826701f281e tempest-CreateVolumesFromImageTest-908341297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fed6439-c77a-41c5-9e6b-dc1b3ab963ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7f1bcbb4-dc7a-489a-be0b-a826701f281e tempest-CreateVolumesFromImageTest-908341297 None] Flow 'volume_create_manager' (4f62b1ff-a3e9-4629-95ca-8fc2a7df66fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:23:51 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-7f1bcbb4-dc7a-489a-be0b-a826701f281e tempest-CreateVolumesFromImageTest-908341297 None] Created volume successfully. Jul 07 08:23:52 devstack sudo[97147]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-2acf2c75-43a4-4592-9c99-0d3628bf1ad9 tempest-CreateVolumesFromImageTest-908341297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d3770799-774b-4372-9b4e-4b5807eac302 1073741824" returned: 0 in 0.836s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-2acf2c75-43a4-4592-9c99-0d3628bf1ad9 tempest-CreateVolumesFromImageTest-908341297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d3770799-774b-4372-9b4e-4b5807eac302 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:52 devstack sudo[97152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d3770799-774b-4372-9b4e-4b5807eac302 Jul 07 08:23:52 devstack sudo[97152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:52 devstack sudo[97152]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-2acf2c75-43a4-4592-9c99-0d3628bf1ad9 tempest-CreateVolumesFromImageTest-908341297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d3770799-774b-4372-9b4e-4b5807eac302" returned: 0 in 0.671s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:52 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-2acf2c75-43a4-4592-9c99-0d3628bf1ad9 tempest-CreateVolumesFromImageTest-908341297 None] <== create_volume: return (1547ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:23:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-2acf2c75-43a4-4592-9c99-0d3628bf1ad9 tempest-CreateVolumesFromImageTest-908341297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-10b38d74-6e20-4e38-b346-d778d6ae15be tempest-CreateVolumesFromImageTest-908341297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.528s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:52 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-10b38d74-6e20-4e38-b346-d778d6ae15be tempest-CreateVolumesFromImageTest-908341297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-329939326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ac8a73f-e28b-4fd9-81d9-b432d21fa707,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d29102d2315a43bfbcab4010bfde2ded',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:23:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:23:47Z,use_quota=True,user_id='154649af8c3a464185bbff039636557e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:23:52 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-10b38d74-6e20-4e38-b346-d778d6ae15be tempest-CreateVolumesFromImageTest-908341297 None] Creating volume 2ac8a73f-e28b-4fd9-81d9-b432d21fa707 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:23:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-10b38d74-6e20-4e38-b346-d778d6ae15be tempest-CreateVolumesFromImageTest-908341297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-10b38d74-6e20-4e38-b346-d778d6ae15be tempest-CreateVolumesFromImageTest-908341297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:52 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-10b38d74-6e20-4e38-b346-d778d6ae15be tempest-CreateVolumesFromImageTest-908341297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:23:52 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-10b38d74-6e20-4e38-b346-d778d6ae15be tempest-CreateVolumesFromImageTest-908341297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:23:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-10b38d74-6e20-4e38-b346-d778d6ae15be tempest-CreateVolumesFromImageTest-908341297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:52 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-10b38d74-6e20-4e38-b346-d778d6ae15be tempest-CreateVolumesFromImageTest-908341297 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:23:52 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-10b38d74-6e20-4e38-b346-d778d6ae15be tempest-CreateVolumesFromImageTest-908341297 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:23:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-10b38d74-6e20-4e38-b346-d778d6ae15be tempest-CreateVolumesFromImageTest-908341297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2ac8a73f-e28b-4fd9-81d9-b432d21fa707 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:52 devstack sudo[97155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2ac8a73f-e28b-4fd9-81d9-b432d21fa707 1073741824 Jul 07 08:23:52 devstack sudo[97155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:52 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2acf2c75-43a4-4592-9c99-0d3628bf1ad9 tempest-CreateVolumesFromImageTest-908341297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30908566-5f81-4507-a55b-a22622c2c06a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3770799-774b-4372-9b4e-4b5807eac302', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:52 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2acf2c75-43a4-4592-9c99-0d3628bf1ad9 tempest-CreateVolumesFromImageTest-908341297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7c90f9d-9dc8-49c9-bbf0-3d8ffd12542b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:52 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-2acf2c75-43a4-4592-9c99-0d3628bf1ad9 tempest-CreateVolumesFromImageTest-908341297 None] Volume volume-d3770799-774b-4372-9b4e-4b5807eac302 (d3770799-774b-4372-9b4e-4b5807eac302): created successfully Jul 07 08:23:52 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2acf2c75-43a4-4592-9c99-0d3628bf1ad9 tempest-CreateVolumesFromImageTest-908341297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7c90f9d-9dc8-49c9-bbf0-3d8ffd12542b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:52 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2acf2c75-43a4-4592-9c99-0d3628bf1ad9 tempest-CreateVolumesFromImageTest-908341297 None] Flow 'volume_create_manager' (baba745b-f673-4bf8-b184-cf9cac695410) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:23:52 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-2acf2c75-43a4-4592-9c99-0d3628bf1ad9 tempest-CreateVolumesFromImageTest-908341297 None] Created volume successfully. Jul 07 08:23:53 devstack sudo[97155]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-10b38d74-6e20-4e38-b346-d778d6ae15be tempest-CreateVolumesFromImageTest-908341297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2ac8a73f-e28b-4fd9-81d9-b432d21fa707 1073741824" returned: 0 in 0.843s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-10b38d74-6e20-4e38-b346-d778d6ae15be tempest-CreateVolumesFromImageTest-908341297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2ac8a73f-e28b-4fd9-81d9-b432d21fa707 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:53 devstack sudo[97161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2ac8a73f-e28b-4fd9-81d9-b432d21fa707 Jul 07 08:23:53 devstack sudo[97161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:54 devstack sudo[97161]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-10b38d74-6e20-4e38-b346-d778d6ae15be tempest-CreateVolumesFromImageTest-908341297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2ac8a73f-e28b-4fd9-81d9-b432d21fa707" returned: 0 in 0.630s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:54 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-10b38d74-6e20-4e38-b346-d778d6ae15be tempest-CreateVolumesFromImageTest-908341297 None] <== create_volume: return (1509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:23:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-10b38d74-6e20-4e38-b346-d778d6ae15be tempest-CreateVolumesFromImageTest-908341297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.512s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-274076b4-9d35-428c-8583-0ab66a01a7d8 tempest-VolumesActionsTest-1764575982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.907s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:54 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-274076b4-9d35-428c-8583-0ab66a01a7d8 tempest-VolumesActionsTest-1764575982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2142314792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08b5dce0-cdbc-4491-9d38-ac6772a730a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68368676a64749b3ba414b1751a5abaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:23:48Z,use_quota=True,user_id='6717bb48e52b40fc92e585e3937702d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:23:54 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-274076b4-9d35-428c-8583-0ab66a01a7d8 tempest-VolumesActionsTest-1764575982 None] Creating volume 08b5dce0-cdbc-4491-9d38-ac6772a730a0 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:23:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-274076b4-9d35-428c-8583-0ab66a01a7d8 tempest-VolumesActionsTest-1764575982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-274076b4-9d35-428c-8583-0ab66a01a7d8 tempest-VolumesActionsTest-1764575982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:54 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-274076b4-9d35-428c-8583-0ab66a01a7d8 tempest-VolumesActionsTest-1764575982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:23:54 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-274076b4-9d35-428c-8583-0ab66a01a7d8 tempest-VolumesActionsTest-1764575982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:23:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-274076b4-9d35-428c-8583-0ab66a01a7d8 tempest-VolumesActionsTest-1764575982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:54 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-274076b4-9d35-428c-8583-0ab66a01a7d8 tempest-VolumesActionsTest-1764575982 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:23:54 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-274076b4-9d35-428c-8583-0ab66a01a7d8 tempest-VolumesActionsTest-1764575982 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:23:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-274076b4-9d35-428c-8583-0ab66a01a7d8 tempest-VolumesActionsTest-1764575982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-08b5dce0-cdbc-4491-9d38-ac6772a730a0 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-10b38d74-6e20-4e38-b346-d778d6ae15be tempest-CreateVolumesFromImageTest-908341297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ce508d5-dd8f-426f-89d0-2ba0e61fc3f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ac8a73f-e28b-4fd9-81d9-b432d21fa707', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:54 devstack sudo[97164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-08b5dce0-cdbc-4491-9d38-ac6772a730a0 1073741824 Jul 07 08:23:54 devstack sudo[97164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-10b38d74-6e20-4e38-b346-d778d6ae15be tempest-CreateVolumesFromImageTest-908341297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a0ae6a4-c832-4e35-8f1e-bbf5dc206788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:54 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-10b38d74-6e20-4e38-b346-d778d6ae15be tempest-CreateVolumesFromImageTest-908341297 None] Volume volume-2ac8a73f-e28b-4fd9-81d9-b432d21fa707 (2ac8a73f-e28b-4fd9-81d9-b432d21fa707): created successfully Jul 07 08:23:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-10b38d74-6e20-4e38-b346-d778d6ae15be tempest-CreateVolumesFromImageTest-908341297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a0ae6a4-c832-4e35-8f1e-bbf5dc206788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-10b38d74-6e20-4e38-b346-d778d6ae15be tempest-CreateVolumesFromImageTest-908341297 None] Flow 'volume_create_manager' (80557b57-b136-489c-a6a6-dad54bece64f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:23:54 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-10b38d74-6e20-4e38-b346-d778d6ae15be tempest-CreateVolumesFromImageTest-908341297 None] Created volume successfully. Jul 07 08:23:55 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-569c611a-d961-42bc-bbaf-d9b9e7443449 tempest-CreateVolumesFromImageTest-908341297 None] Acquiring lock "cinder-2ac8a73f-e28b-4fd9-81d9-b432d21fa707-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:23:55 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-569c611a-d961-42bc-bbaf-d9b9e7443449 tempest-CreateVolumesFromImageTest-908341297 None] Lock "cinder-2ac8a73f-e28b-4fd9-81d9-b432d21fa707-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:23:55 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-569c611a-d961-42bc-bbaf-d9b9e7443449 tempest-CreateVolumesFromImageTest-908341297 None] Acquiring lock "cinder-quobyte-2ac8a73f-e28b-4fd9-81d9-b432d21fa707" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:23:55 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-569c611a-d961-42bc-bbaf-d9b9e7443449 tempest-CreateVolumesFromImageTest-908341297 None] Lock "cinder-quobyte-2ac8a73f-e28b-4fd9-81d9-b432d21fa707" acquired by "delete_volume" :: waited 0.017s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:23:55 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8299e73-842b-42e9-bc40-88bad13f1e3e]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:23:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-569c611a-d961-42bc-bbaf-d9b9e7443449 tempest-CreateVolumesFromImageTest-908341297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2ac8a73f-e28b-4fd9-81d9-b432d21fa707 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:55 devstack sudo[97169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2ac8a73f-e28b-4fd9-81d9-b432d21fa707 Jul 07 08:23:55 devstack sudo[97169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:55 devstack sudo[97164]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-274076b4-9d35-428c-8583-0ab66a01a7d8 tempest-VolumesActionsTest-1764575982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-08b5dce0-cdbc-4491-9d38-ac6772a730a0 1073741824" returned: 0 in 0.898s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-274076b4-9d35-428c-8583-0ab66a01a7d8 tempest-VolumesActionsTest-1764575982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-08b5dce0-cdbc-4491-9d38-ac6772a730a0 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:55 devstack sudo[97173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-08b5dce0-cdbc-4491-9d38-ac6772a730a0 Jul 07 08:23:55 devstack sudo[97173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:55 devstack sudo[97169]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-569c611a-d961-42bc-bbaf-d9b9e7443449 tempest-CreateVolumesFromImageTest-908341297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2ac8a73f-e28b-4fd9-81d9-b432d21fa707" returned: 0 in 0.805s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-569c611a-d961-42bc-bbaf-d9b9e7443449 tempest-CreateVolumesFromImageTest-908341297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2ac8a73f-e28b-4fd9-81d9-b432d21fa707 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:55 devstack sudo[97179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2ac8a73f-e28b-4fd9-81d9-b432d21fa707 Jul 07 08:23:55 devstack sudo[97179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:55 devstack sudo[97173]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-274076b4-9d35-428c-8583-0ab66a01a7d8 tempest-VolumesActionsTest-1764575982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-08b5dce0-cdbc-4491-9d38-ac6772a730a0" returned: 0 in 0.646s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:55 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-274076b4-9d35-428c-8583-0ab66a01a7d8 tempest-VolumesActionsTest-1764575982 None] <== create_volume: return (1593ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:23:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-274076b4-9d35-428c-8583-0ab66a01a7d8 tempest-VolumesActionsTest-1764575982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.595s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-88c81390-8041-4d1a-81a6-c5e6f4ba4c62 tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.401s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:55 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-88c81390-8041-4d1a-81a6-c5e6f4ba4c62 tempest-VolumesSnapshotTestJSON-1862037507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1038185559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3feee3cf-f80c-4b87-ad0b-2df93c769b97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09a4265f78884f7396b49574ccdee3af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:23:49Z,use_quota=True,user_id='775b8acb218a4afa93d6a15c0d98c531',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:23:55 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-88c81390-8041-4d1a-81a6-c5e6f4ba4c62 tempest-VolumesSnapshotTestJSON-1862037507 None] Creating volume 3feee3cf-f80c-4b87-ad0b-2df93c769b97 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:23:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-88c81390-8041-4d1a-81a6-c5e6f4ba4c62 tempest-VolumesSnapshotTestJSON-1862037507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-88c81390-8041-4d1a-81a6-c5e6f4ba4c62 tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:55 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-88c81390-8041-4d1a-81a6-c5e6f4ba4c62 tempest-VolumesSnapshotTestJSON-1862037507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:23:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-88c81390-8041-4d1a-81a6-c5e6f4ba4c62 tempest-VolumesSnapshotTestJSON-1862037507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:23:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-88c81390-8041-4d1a-81a6-c5e6f4ba4c62 tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-88c81390-8041-4d1a-81a6-c5e6f4ba4c62 tempest-VolumesSnapshotTestJSON-1862037507 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:23:56 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-88c81390-8041-4d1a-81a6-c5e6f4ba4c62 tempest-VolumesSnapshotTestJSON-1862037507 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:23:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-88c81390-8041-4d1a-81a6-c5e6f4ba4c62 tempest-VolumesSnapshotTestJSON-1862037507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3feee3cf-f80c-4b87-ad0b-2df93c769b97 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:56 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=111,cinder:INSERT=30,cinder:UPDATE=141,cinder:DELETE=8 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:23:56 devstack sudo[97181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3feee3cf-f80c-4b87-ad0b-2df93c769b97 1073741824 Jul 07 08:23:56 devstack sudo[97181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-274076b4-9d35-428c-8583-0ab66a01a7d8 tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dee8b527-8e42-42e4-8768-5e86ee406b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08b5dce0-cdbc-4491-9d38-ac6772a730a0', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-274076b4-9d35-428c-8583-0ab66a01a7d8 tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc822e41-ebb1-4134-ab6f-1663ebdbdef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:56 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:UPDATE=116,cinder:SELECT=97,cinder:DELETE=13,cinder:INSERT=38 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:23:56 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-274076b4-9d35-428c-8583-0ab66a01a7d8 tempest-VolumesActionsTest-1764575982 None] Volume volume-08b5dce0-cdbc-4491-9d38-ac6772a730a0 (08b5dce0-cdbc-4491-9d38-ac6772a730a0): created successfully Jul 07 08:23:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-274076b4-9d35-428c-8583-0ab66a01a7d8 tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc822e41-ebb1-4134-ab6f-1663ebdbdef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-274076b4-9d35-428c-8583-0ab66a01a7d8 tempest-VolumesActionsTest-1764575982 None] Flow 'volume_create_manager' (65d6f178-4e40-4d6f-bfa0-33040b58709a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:23:56 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-274076b4-9d35-428c-8583-0ab66a01a7d8 tempest-VolumesActionsTest-1764575982 None] Created volume successfully. Jul 07 08:23:56 devstack sudo[97179]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-569c611a-d961-42bc-bbaf-d9b9e7443449 tempest-CreateVolumesFromImageTest-908341297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2ac8a73f-e28b-4fd9-81d9-b432d21fa707" returned: 0 in 0.674s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-569c611a-d961-42bc-bbaf-d9b9e7443449 tempest-CreateVolumesFromImageTest-908341297 None] Lock "cinder-quobyte-2ac8a73f-e28b-4fd9-81d9-b432d21fa707" released by "delete_volume" :: held 1.527s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:23:56 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-569c611a-d961-42bc-bbaf-d9b9e7443449 tempest-CreateVolumesFromImageTest-908341297 None] Created reservations ['22835c12-acb8-42d7-8e4b-03c4ceacb496', 'bddd97f4-eaf2-4188-88f3-8ca2d1f5e5da', '71e2ca97-2d7f-4210-89cb-e3847c0af841', '85a2f5f0-d19f-42fc-adb6-b44567cbc962'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:23:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-569c611a-d961-42bc-bbaf-d9b9e7443449 tempest-CreateVolumesFromImageTest-908341297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-569c611a-d961-42bc-bbaf-d9b9e7443449 tempest-CreateVolumesFromImageTest-908341297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-569c611a-d961-42bc-bbaf-d9b9e7443449 tempest-CreateVolumesFromImageTest-908341297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:23:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-569c611a-d961-42bc-bbaf-d9b9e7443449 tempest-CreateVolumesFromImageTest-908341297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:23:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-569c611a-d961-42bc-bbaf-d9b9e7443449 tempest-CreateVolumesFromImageTest-908341297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-569c611a-d961-42bc-bbaf-d9b9e7443449 tempest-CreateVolumesFromImageTest-908341297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:56 devstack sudo[97187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:23:56 devstack sudo[97187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3df2c605-5836-4c10-80a5-11262a76f1f9 tempest-VolumesActionsTest-1911398733 None] Acquiring lock "cinder-08b5dce0-cdbc-4491-9d38-ac6772a730a0-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:23:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3df2c605-5836-4c10-80a5-11262a76f1f9 tempest-VolumesActionsTest-1911398733 None] Lock "cinder-08b5dce0-cdbc-4491-9d38-ac6772a730a0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:23:56 devstack sudo[97181]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-88c81390-8041-4d1a-81a6-c5e6f4ba4c62 tempest-VolumesSnapshotTestJSON-1862037507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3feee3cf-f80c-4b87-ad0b-2df93c769b97 1073741824" returned: 0 in 0.946s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3df2c605-5836-4c10-80a5-11262a76f1f9 tempest-VolumesActionsTest-1911398733 None] Acquiring lock "cinder-quobyte-08b5dce0-cdbc-4491-9d38-ac6772a730a0" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:23:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-88c81390-8041-4d1a-81a6-c5e6f4ba4c62 tempest-VolumesSnapshotTestJSON-1862037507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3feee3cf-f80c-4b87-ad0b-2df93c769b97 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:57 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3df2c605-5836-4c10-80a5-11262a76f1f9 tempest-VolumesActionsTest-1911398733 None] Lock "cinder-quobyte-08b5dce0-cdbc-4491-9d38-ac6772a730a0" acquired by "delete_volume" :: waited 0.028s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:23:57 devstack sudo[97190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3feee3cf-f80c-4b87-ad0b-2df93c769b97 Jul 07 08:23:57 devstack sudo[97190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:57 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[92fdd446-96bc-4179-b209-5ecd6999fef1]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:23:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3df2c605-5836-4c10-80a5-11262a76f1f9 tempest-VolumesActionsTest-1911398733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-08b5dce0-cdbc-4491-9d38-ac6772a730a0 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:57 devstack sudo[97192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-08b5dce0-cdbc-4491-9d38-ac6772a730a0 Jul 07 08:23:57 devstack sudo[97192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:57 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-1074b21e-8571-4dc3-89a2-229a79eb4bed tempest-CreateVolumesFromImageTest-908341297 None] Acquiring lock "cinder-d3770799-774b-4372-9b4e-4b5807eac302-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:23:57 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-1074b21e-8571-4dc3-89a2-229a79eb4bed tempest-CreateVolumesFromImageTest-908341297 None] Lock "cinder-d3770799-774b-4372-9b4e-4b5807eac302-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:23:57 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-1074b21e-8571-4dc3-89a2-229a79eb4bed tempest-CreateVolumesFromImageTest-908341297 None] Acquiring lock "cinder-quobyte-d3770799-774b-4372-9b4e-4b5807eac302" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:23:57 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-1074b21e-8571-4dc3-89a2-229a79eb4bed tempest-CreateVolumesFromImageTest-908341297 None] Lock "cinder-quobyte-d3770799-774b-4372-9b4e-4b5807eac302" acquired by "delete_volume" :: waited 0.024s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:23:57 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef73e84-2b21-4ac9-b6f5-9742ad180d26]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:23:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1074b21e-8571-4dc3-89a2-229a79eb4bed tempest-CreateVolumesFromImageTest-908341297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d3770799-774b-4372-9b4e-4b5807eac302 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:57 devstack sudo[97187]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-569c611a-d961-42bc-bbaf-d9b9e7443449 tempest-CreateVolumesFromImageTest-908341297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.794s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:57 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-569c611a-d961-42bc-bbaf-d9b9e7443449 tempest-CreateVolumesFromImageTest-908341297 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:23:57 devstack sudo[97195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d3770799-774b-4372-9b4e-4b5807eac302 Jul 07 08:23:57 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-569c611a-d961-42bc-bbaf-d9b9e7443449 tempest-CreateVolumesFromImageTest-908341297 None] Deleted volume successfully. Jul 07 08:23:57 devstack sudo[97195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:57 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-569c611a-d961-42bc-bbaf-d9b9e7443449 tempest-CreateVolumesFromImageTest-908341297 None] Lock "cinder-2ac8a73f-e28b-4fd9-81d9-b432d21fa707-delete_volume" released by "delete_volume" :: held 2.547s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:23:57 devstack sudo[97190]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-88c81390-8041-4d1a-81a6-c5e6f4ba4c62 tempest-VolumesSnapshotTestJSON-1862037507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3feee3cf-f80c-4b87-ad0b-2df93c769b97" returned: 0 in 0.744s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-88c81390-8041-4d1a-81a6-c5e6f4ba4c62 tempest-VolumesSnapshotTestJSON-1862037507 None] <== create_volume: return (1754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:23:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-88c81390-8041-4d1a-81a6-c5e6f4ba4c62 tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.756s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a1f6fdea-01b1-4bbc-afca-4f8220512dab tempest-VolumesListTestJSON-1975080058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.439s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a1f6fdea-01b1-4bbc-afca-4f8220512dab tempest-VolumesListTestJSON-1975080058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-249261500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e57c9a0-691f-46d7-8bc1-a323784e3d9f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fdb2f05404e7490196d791e6b89ad667',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:23:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:23:51Z,use_quota=True,user_id='9c9e467030a04dc1b7657d447fafee39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:23:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-a1f6fdea-01b1-4bbc-afca-4f8220512dab tempest-VolumesListTestJSON-1975080058 None] Creating volume 5e57c9a0-691f-46d7-8bc1-a323784e3d9f {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:23:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a1f6fdea-01b1-4bbc-afca-4f8220512dab tempest-VolumesListTestJSON-1975080058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a1f6fdea-01b1-4bbc-afca-4f8220512dab tempest-VolumesListTestJSON-1975080058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a1f6fdea-01b1-4bbc-afca-4f8220512dab tempest-VolumesListTestJSON-1975080058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:23:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a1f6fdea-01b1-4bbc-afca-4f8220512dab tempest-VolumesListTestJSON-1975080058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:23:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a1f6fdea-01b1-4bbc-afca-4f8220512dab tempest-VolumesListTestJSON-1975080058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a1f6fdea-01b1-4bbc-afca-4f8220512dab tempest-VolumesListTestJSON-1975080058 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:23:57 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-a1f6fdea-01b1-4bbc-afca-4f8220512dab tempest-VolumesListTestJSON-1975080058 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:23:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a1f6fdea-01b1-4bbc-afca-4f8220512dab tempest-VolumesListTestJSON-1975080058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5e57c9a0-691f-46d7-8bc1-a323784e3d9f 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:57 devstack sudo[97198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5e57c9a0-691f-46d7-8bc1-a323784e3d9f 1073741824 Jul 07 08:23:57 devstack sudo[97198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-88c81390-8041-4d1a-81a6-c5e6f4ba4c62 tempest-VolumesSnapshotTestJSON-1862037507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88f5cdfb-f287-489e-a901-4d0a194cafe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3feee3cf-f80c-4b87-ad0b-2df93c769b97', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-88c81390-8041-4d1a-81a6-c5e6f4ba4c62 tempest-VolumesSnapshotTestJSON-1862037507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eee9670-78b2-4326-9d48-2710efb47cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:57 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-88c81390-8041-4d1a-81a6-c5e6f4ba4c62 tempest-VolumesSnapshotTestJSON-1862037507 None] Volume volume-3feee3cf-f80c-4b87-ad0b-2df93c769b97 (3feee3cf-f80c-4b87-ad0b-2df93c769b97): created successfully Jul 07 08:23:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-88c81390-8041-4d1a-81a6-c5e6f4ba4c62 tempest-VolumesSnapshotTestJSON-1862037507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eee9670-78b2-4326-9d48-2710efb47cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-88c81390-8041-4d1a-81a6-c5e6f4ba4c62 tempest-VolumesSnapshotTestJSON-1862037507 None] Flow 'volume_create_manager' (11a35dfe-e6fe-4d0b-8894-3731e7112b78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:23:57 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-88c81390-8041-4d1a-81a6-c5e6f4ba4c62 tempest-VolumesSnapshotTestJSON-1862037507 None] Created volume successfully. Jul 07 08:23:58 devstack sudo[97192]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3df2c605-5836-4c10-80a5-11262a76f1f9 tempest-VolumesActionsTest-1911398733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-08b5dce0-cdbc-4491-9d38-ac6772a730a0" returned: 0 in 0.992s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3df2c605-5836-4c10-80a5-11262a76f1f9 tempest-VolumesActionsTest-1911398733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-08b5dce0-cdbc-4491-9d38-ac6772a730a0 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:58 devstack sudo[97203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-08b5dce0-cdbc-4491-9d38-ac6772a730a0 Jul 07 08:23:58 devstack sudo[97203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:58 devstack sudo[97195]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1074b21e-8571-4dc3-89a2-229a79eb4bed tempest-CreateVolumesFromImageTest-908341297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d3770799-774b-4372-9b4e-4b5807eac302" returned: 0 in 0.906s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1074b21e-8571-4dc3-89a2-229a79eb4bed tempest-CreateVolumesFromImageTest-908341297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d3770799-774b-4372-9b4e-4b5807eac302 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:58 devstack sudo[97208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d3770799-774b-4372-9b4e-4b5807eac302 Jul 07 08:23:58 devstack sudo[97208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-bcba6d3d-eb84-42e1-bd62-234351c304a2 tempest-VolumesSnapshotTestJSON-1862037507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:58 devstack sudo[97198]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a1f6fdea-01b1-4bbc-afca-4f8220512dab tempest-VolumesListTestJSON-1975080058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5e57c9a0-691f-46d7-8bc1-a323784e3d9f 1073741824" returned: 0 in 0.980s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a1f6fdea-01b1-4bbc-afca-4f8220512dab tempest-VolumesListTestJSON-1975080058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5e57c9a0-691f-46d7-8bc1-a323784e3d9f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:58 devstack sudo[97216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5e57c9a0-691f-46d7-8bc1-a323784e3d9f Jul 07 08:23:58 devstack sudo[97216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:58 devstack sudo[97203]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3df2c605-5836-4c10-80a5-11262a76f1f9 tempest-VolumesActionsTest-1911398733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-08b5dce0-cdbc-4491-9d38-ac6772a730a0" returned: 0 in 0.823s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:58 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3df2c605-5836-4c10-80a5-11262a76f1f9 tempest-VolumesActionsTest-1911398733 None] Lock "cinder-quobyte-08b5dce0-cdbc-4491-9d38-ac6772a730a0" released by "delete_volume" :: held 1.867s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:23:58 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-3df2c605-5836-4c10-80a5-11262a76f1f9 tempest-VolumesActionsTest-1911398733 None] Created reservations ['c4361687-5409-4f7a-a718-a4ccece46485', 'd52112c1-bb19-43fd-8d98-151cdb76de13', '169cdcb6-8e7f-4fc3-854f-11d9621f271e', '85fce6b9-5921-4910-bd01-c728cf527e76'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:23:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3df2c605-5836-4c10-80a5-11262a76f1f9 tempest-VolumesActionsTest-1911398733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3df2c605-5836-4c10-80a5-11262a76f1f9 tempest-VolumesActionsTest-1911398733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-3df2c605-5836-4c10-80a5-11262a76f1f9 tempest-VolumesActionsTest-1911398733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:23:59 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-3df2c605-5836-4c10-80a5-11262a76f1f9 tempest-VolumesActionsTest-1911398733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:23:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3df2c605-5836-4c10-80a5-11262a76f1f9 tempest-VolumesActionsTest-1911398733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3df2c605-5836-4c10-80a5-11262a76f1f9 tempest-VolumesActionsTest-1911398733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:59 devstack sudo[97219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:23:59 devstack sudo[97219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:59 devstack sudo[97208]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1074b21e-8571-4dc3-89a2-229a79eb4bed tempest-CreateVolumesFromImageTest-908341297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d3770799-774b-4372-9b4e-4b5807eac302" returned: 0 in 0.728s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:59 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-1074b21e-8571-4dc3-89a2-229a79eb4bed tempest-CreateVolumesFromImageTest-908341297 None] Lock "cinder-quobyte-d3770799-774b-4372-9b4e-4b5807eac302" released by "delete_volume" :: held 1.698s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:23:59 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-1074b21e-8571-4dc3-89a2-229a79eb4bed tempest-CreateVolumesFromImageTest-908341297 None] Created reservations ['57cedc5e-2785-4c52-b032-a1db01011064', '1a43b573-2d0c-498d-ad4a-9851b1f816c3', '067fb033-e521-4770-8a34-b4e497b90844', '1427e6fa-ab55-42fa-81c3-a58600454048'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:23:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1074b21e-8571-4dc3-89a2-229a79eb4bed tempest-CreateVolumesFromImageTest-908341297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1074b21e-8571-4dc3-89a2-229a79eb4bed tempest-CreateVolumesFromImageTest-908341297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:59 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1074b21e-8571-4dc3-89a2-229a79eb4bed tempest-CreateVolumesFromImageTest-908341297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:23:59 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1074b21e-8571-4dc3-89a2-229a79eb4bed tempest-CreateVolumesFromImageTest-908341297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:23:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1074b21e-8571-4dc3-89a2-229a79eb4bed tempest-CreateVolumesFromImageTest-908341297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1074b21e-8571-4dc3-89a2-229a79eb4bed tempest-CreateVolumesFromImageTest-908341297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:59 devstack sudo[97221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:23:59 devstack sudo[97221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:59 devstack sudo[97216]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a1f6fdea-01b1-4bbc-afca-4f8220512dab tempest-VolumesListTestJSON-1975080058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5e57c9a0-691f-46d7-8bc1-a323784e3d9f" returned: 0 in 0.806s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:59 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a1f6fdea-01b1-4bbc-afca-4f8220512dab tempest-VolumesListTestJSON-1975080058 None] <== create_volume: return (1837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:23:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a1f6fdea-01b1-4bbc-afca-4f8220512dab tempest-VolumesListTestJSON-1975080058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.841s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-bcba6d3d-eb84-42e1-bd62-234351c304a2 tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.197s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:59 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6cbe9baf-0f65-4283-8d59-cf0573825bd3 tempest-CreateVolumesFromImageTest-908341297 None] Acquiring lock "cinder-aa13175e-c8be-4111-8df2-ff9469f34fff-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:23:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a1f6fdea-01b1-4bbc-afca-4f8220512dab tempest-VolumesListTestJSON-1975080058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5bb2ff5-95be-475b-a5ee-9a23bd024b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e57c9a0-691f-46d7-8bc1-a323784e3d9f', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a1f6fdea-01b1-4bbc-afca-4f8220512dab tempest-VolumesListTestJSON-1975080058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41c3ac35-0e71-4f3d-b05d-a9d62bbbf017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:59 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-bcba6d3d-eb84-42e1-bd62-234351c304a2 tempest-VolumesSnapshotTestJSON-1862037507 None] Creating offline snapshot a0a4c1da-e6ae-4e49-ae80-d386667eba68 of volume 3feee3cf-f80c-4b87-ad0b-2df93c769b97 {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:23:59 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6cbe9baf-0f65-4283-8d59-cf0573825bd3 tempest-CreateVolumesFromImageTest-908341297 None] Lock "cinder-aa13175e-c8be-4111-8df2-ff9469f34fff-delete_volume" acquired by "delete_volume" :: waited 0.096s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:23:59 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-a1f6fdea-01b1-4bbc-afca-4f8220512dab tempest-VolumesListTestJSON-1975080058 None] Volume volume-5e57c9a0-691f-46d7-8bc1-a323784e3d9f (5e57c9a0-691f-46d7-8bc1-a323784e3d9f): created successfully Jul 07 08:23:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a1f6fdea-01b1-4bbc-afca-4f8220512dab tempest-VolumesListTestJSON-1975080058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41c3ac35-0e71-4f3d-b05d-a9d62bbbf017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a1f6fdea-01b1-4bbc-afca-4f8220512dab tempest-VolumesListTestJSON-1975080058 None] Flow 'volume_create_manager' (255b4217-eda1-4eac-8400-48e879db78df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:23:59 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fecc37d-0da4-4ddf-9631-87581e4d5f4d]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:23:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bcba6d3d-eb84-42e1-bd62-234351c304a2 tempest-VolumesSnapshotTestJSON-1862037507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3feee3cf-f80c-4b87-ad0b-2df93c769b97 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:59 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-a1f6fdea-01b1-4bbc-afca-4f8220512dab tempest-VolumesListTestJSON-1975080058 None] Created volume successfully. Jul 07 08:23:59 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6cbe9baf-0f65-4283-8d59-cf0573825bd3 tempest-CreateVolumesFromImageTest-908341297 None] Acquiring lock "cinder-quobyte-aa13175e-c8be-4111-8df2-ff9469f34fff" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:23:59 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-493c5de7-519c-4a33-93a9-d80166992f76 tempest-VolumesActionsTest-1764575982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:23:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-493c5de7-519c-4a33-93a9-d80166992f76 tempest-VolumesActionsTest-1764575982 None] Flow 'volume_create_manager' (2064d4c6-b0ad-46c7-8192-3d227ef800a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:23:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-493c5de7-519c-4a33-93a9-d80166992f76 tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a8ccbd4-d4de-41b2-ad4c-4ef3682f2711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-493c5de7-519c-4a33-93a9-d80166992f76 tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a8ccbd4-d4de-41b2-ad4c-4ef3682f2711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:23:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1741551412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61270cff-1650-4bab-9500-c67b94e5b803,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68368676a64749b3ba414b1751a5abaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:24:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:24:00Z,use_quota=True,user_id='6717bb48e52b40fc92e585e3937702d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:59 devstack sudo[97224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3feee3cf-f80c-4b87-ad0b-2df93c769b97 Jul 07 08:23:59 devstack sudo[97224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-493c5de7-519c-4a33-93a9-d80166992f76 tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8816211e-ad93-4196-83d7-c9ecba38043d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-493c5de7-519c-4a33-93a9-d80166992f76 tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8816211e-ad93-4196-83d7-c9ecba38043d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-493c5de7-519c-4a33-93a9-d80166992f76 tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9481ebcf-4e2c-47d5-85fd-24fe4a80b662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-493c5de7-519c-4a33-93a9-d80166992f76 tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9481ebcf-4e2c-47d5-85fd-24fe4a80b662) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61270cff-1650-4bab-9500-c67b94e5b803', 'volume_name': 'volume-61270cff-1650-4bab-9500-c67b94e5b803', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-493c5de7-519c-4a33-93a9-d80166992f76 tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (396a567a-c393-4e9d-b0f7-cebfcfc0994f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-493c5de7-519c-4a33-93a9-d80166992f76 tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (396a567a-c393-4e9d-b0f7-cebfcfc0994f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-493c5de7-519c-4a33-93a9-d80166992f76 tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a6cd81d-25e4-4540-83e4-46bc3f6af17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:59 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-493c5de7-519c-4a33-93a9-d80166992f76 tempest-VolumesActionsTest-1764575982 None] Volume 61270cff-1650-4bab-9500-c67b94e5b803: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61270cff-1650-4bab-9500-c67b94e5b803', 'volume_size': 1} Jul 07 08:23:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-493c5de7-519c-4a33-93a9-d80166992f76 tempest-VolumesActionsTest-1764575982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:59 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6cbe9baf-0f65-4283-8d59-cf0573825bd3 tempest-CreateVolumesFromImageTest-908341297 None] Lock "cinder-quobyte-aa13175e-c8be-4111-8df2-ff9469f34fff" acquired by "delete_volume" :: waited 0.105s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:23:59 devstack sudo[97219]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3df2c605-5836-4c10-80a5-11262a76f1f9 tempest-VolumesActionsTest-1911398733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.958s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:59 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-3df2c605-5836-4c10-80a5-11262a76f1f9 tempest-VolumesActionsTest-1911398733 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:23:59 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[1724ff08-31e0-4fb3-bd24-831cb6c455ef]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:23:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6cbe9baf-0f65-4283-8d59-cf0573825bd3 tempest-CreateVolumesFromImageTest-908341297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-aa13175e-c8be-4111-8df2-ff9469f34fff {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:59 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-3df2c605-5836-4c10-80a5-11262a76f1f9 tempest-VolumesActionsTest-1911398733 None] Deleted volume successfully. Jul 07 08:24:00 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3df2c605-5836-4c10-80a5-11262a76f1f9 tempest-VolumesActionsTest-1911398733 None] Lock "cinder-08b5dce0-cdbc-4491-9d38-ac6772a730a0-delete_volume" released by "delete_volume" :: held 3.076s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:24:00 devstack sudo[97227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-aa13175e-c8be-4111-8df2-ff9469f34fff Jul 07 08:24:00 devstack sudo[97227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:00 devstack sudo[97221]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1074b21e-8571-4dc3-89a2-229a79eb4bed tempest-CreateVolumesFromImageTest-908341297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.891s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:00 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-1074b21e-8571-4dc3-89a2-229a79eb4bed tempest-CreateVolumesFromImageTest-908341297 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:24:00 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-1074b21e-8571-4dc3-89a2-229a79eb4bed tempest-CreateVolumesFromImageTest-908341297 None] Deleted volume successfully. Jul 07 08:24:00 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-1074b21e-8571-4dc3-89a2-229a79eb4bed tempest-CreateVolumesFromImageTest-908341297 None] Lock "cinder-d3770799-774b-4372-9b4e-4b5807eac302-delete_volume" released by "delete_volume" :: held 2.864s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:24:00 devstack sudo[97224]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bcba6d3d-eb84-42e1-bd62-234351c304a2 tempest-VolumesSnapshotTestJSON-1862037507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3feee3cf-f80c-4b87-ad0b-2df93c769b97" returned: 0 in 0.839s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bcba6d3d-eb84-42e1-bd62-234351c304a2 tempest-VolumesSnapshotTestJSON-1862037507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3feee3cf-f80c-4b87-ad0b-2df93c769b97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3feee3cf-f80c-4b87-ad0b-2df93c769b97.a0a4c1da-e6ae-4e49-ae80-d386667eba68 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:00 devstack sudo[97233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3feee3cf-f80c-4b87-ad0b-2df93c769b97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3feee3cf-f80c-4b87-ad0b-2df93c769b97.a0a4c1da-e6ae-4e49-ae80-d386667eba68 1G Jul 07 08:24:00 devstack sudo[97233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:00 devstack sudo[97227]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6cbe9baf-0f65-4283-8d59-cf0573825bd3 tempest-CreateVolumesFromImageTest-908341297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-aa13175e-c8be-4111-8df2-ff9469f34fff" returned: 0 in 0.833s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6cbe9baf-0f65-4283-8d59-cf0573825bd3 tempest-CreateVolumesFromImageTest-908341297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-aa13175e-c8be-4111-8df2-ff9469f34fff {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:00 devstack sudo[97239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-aa13175e-c8be-4111-8df2-ff9469f34fff Jul 07 08:24:00 devstack sudo[97239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:01 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-19f2109e-3557-4eaa-9503-9b22dcca0998 tempest-VolumesListTestJSON-1975080058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:24:01 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-19f2109e-3557-4eaa-9503-9b22dcca0998 tempest-VolumesListTestJSON-1975080058 None] Flow 'volume_create_manager' (1f55da0a-a484-41f2-a412-0542bf1e73ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:24:01 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-19f2109e-3557-4eaa-9503-9b22dcca0998 tempest-VolumesListTestJSON-1975080058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f4b369f-bd1d-4e18-b820-1b33a40ab5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:01 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-19f2109e-3557-4eaa-9503-9b22dcca0998 tempest-VolumesListTestJSON-1975080058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f4b369f-bd1d-4e18-b820-1b33a40ab5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1781103200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f90c37b-dc9f-4456-8eed-9fad6d1a6bb0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fdb2f05404e7490196d791e6b89ad667',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:24:01Z,use_quota=True,user_id='9c9e467030a04dc1b7657d447fafee39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:01 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-19f2109e-3557-4eaa-9503-9b22dcca0998 tempest-VolumesListTestJSON-1975080058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cca710d-bb63-43be-a7cd-647bec9a1bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:01 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-19f2109e-3557-4eaa-9503-9b22dcca0998 tempest-VolumesListTestJSON-1975080058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cca710d-bb63-43be-a7cd-647bec9a1bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:01 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-19f2109e-3557-4eaa-9503-9b22dcca0998 tempest-VolumesListTestJSON-1975080058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f69375b-dc72-4f46-a90c-3672318740f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:01 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-19f2109e-3557-4eaa-9503-9b22dcca0998 tempest-VolumesListTestJSON-1975080058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f69375b-dc72-4f46-a90c-3672318740f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f90c37b-dc9f-4456-8eed-9fad6d1a6bb0', 'volume_name': 'volume-3f90c37b-dc9f-4456-8eed-9fad6d1a6bb0', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:01 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-19f2109e-3557-4eaa-9503-9b22dcca0998 tempest-VolumesListTestJSON-1975080058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8740d095-870a-44b6-a9f2-d82cbb234e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:01 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-19f2109e-3557-4eaa-9503-9b22dcca0998 tempest-VolumesListTestJSON-1975080058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8740d095-870a-44b6-a9f2-d82cbb234e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:01 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-19f2109e-3557-4eaa-9503-9b22dcca0998 tempest-VolumesListTestJSON-1975080058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bac87ef-98c1-4de3-a684-cf547a0d96ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:01 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-19f2109e-3557-4eaa-9503-9b22dcca0998 tempest-VolumesListTestJSON-1975080058 None] Volume 3f90c37b-dc9f-4456-8eed-9fad6d1a6bb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f90c37b-dc9f-4456-8eed-9fad6d1a6bb0', 'volume_size': 1} Jul 07 08:24:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-19f2109e-3557-4eaa-9503-9b22dcca0998 tempest-VolumesListTestJSON-1975080058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:01 devstack sudo[97233]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bcba6d3d-eb84-42e1-bd62-234351c304a2 tempest-VolumesSnapshotTestJSON-1862037507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3feee3cf-f80c-4b87-ad0b-2df93c769b97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3feee3cf-f80c-4b87-ad0b-2df93c769b97.a0a4c1da-e6ae-4e49-ae80-d386667eba68 1G" returned: 0 in 0.918s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bcba6d3d-eb84-42e1-bd62-234351c304a2 tempest-VolumesSnapshotTestJSON-1862037507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3feee3cf-f80c-4b87-ad0b-2df93c769b97 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3feee3cf-f80c-4b87-ad0b-2df93c769b97.a0a4c1da-e6ae-4e49-ae80-d386667eba68 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:01 devstack sudo[97239]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6cbe9baf-0f65-4283-8d59-cf0573825bd3 tempest-CreateVolumesFromImageTest-908341297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-aa13175e-c8be-4111-8df2-ff9469f34fff" returned: 0 in 0.736s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:01 devstack sudo[97248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3feee3cf-f80c-4b87-ad0b-2df93c769b97 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3feee3cf-f80c-4b87-ad0b-2df93c769b97.a0a4c1da-e6ae-4e49-ae80-d386667eba68 Jul 07 08:24:01 devstack sudo[97248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:01 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6cbe9baf-0f65-4283-8d59-cf0573825bd3 tempest-CreateVolumesFromImageTest-908341297 None] Lock "cinder-quobyte-aa13175e-c8be-4111-8df2-ff9469f34fff" released by "delete_volume" :: held 1.612s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:24:01 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-6cbe9baf-0f65-4283-8d59-cf0573825bd3 tempest-CreateVolumesFromImageTest-908341297 None] Created reservations ['a2135798-bd99-41d1-9e08-feb6ffcc081e', 'e8fbc045-62c4-4aee-bf49-969741f95986', '013b2c77-6269-4d7a-a156-7266f4b6cf42', 'cc1139f3-2bcc-4edd-bb2e-2a15e85c6b92'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:24:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6cbe9baf-0f65-4283-8d59-cf0573825bd3 tempest-CreateVolumesFromImageTest-908341297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6cbe9baf-0f65-4283-8d59-cf0573825bd3 tempest-CreateVolumesFromImageTest-908341297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:01 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6cbe9baf-0f65-4283-8d59-cf0573825bd3 tempest-CreateVolumesFromImageTest-908341297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:24:01 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6cbe9baf-0f65-4283-8d59-cf0573825bd3 tempest-CreateVolumesFromImageTest-908341297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:24:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6cbe9baf-0f65-4283-8d59-cf0573825bd3 tempest-CreateVolumesFromImageTest-908341297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6cbe9baf-0f65-4283-8d59-cf0573825bd3 tempest-CreateVolumesFromImageTest-908341297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:01 devstack sudo[97250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:24:01 devstack sudo[97250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:01 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4ce95338-188a-4f76-8e70-48907d506c37 tempest-CreateVolumesFromImageTest-908341297 None] Acquiring lock "cinder-a2ebeda2-bbcd-44f7-bab1-644968a609e9-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:24:01 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4ce95338-188a-4f76-8e70-48907d506c37 tempest-CreateVolumesFromImageTest-908341297 None] Lock "cinder-a2ebeda2-bbcd-44f7-bab1-644968a609e9-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:24:01 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4ce95338-188a-4f76-8e70-48907d506c37 tempest-CreateVolumesFromImageTest-908341297 None] Acquiring lock "cinder-quobyte-a2ebeda2-bbcd-44f7-bab1-644968a609e9" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:24:01 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4ce95338-188a-4f76-8e70-48907d506c37 tempest-CreateVolumesFromImageTest-908341297 None] Lock "cinder-quobyte-a2ebeda2-bbcd-44f7-bab1-644968a609e9" acquired by "delete_volume" :: waited 0.018s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:24:02 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b715965-ebf7-4a85-bb97-0b559bab7ec1]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:24:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4ce95338-188a-4f76-8e70-48907d506c37 tempest-CreateVolumesFromImageTest-908341297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-a2ebeda2-bbcd-44f7-bab1-644968a609e9 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:02 devstack sudo[97252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-a2ebeda2-bbcd-44f7-bab1-644968a609e9 Jul 07 08:24:02 devstack sudo[97252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:02 devstack sudo[97248]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bcba6d3d-eb84-42e1-bd62-234351c304a2 tempest-VolumesSnapshotTestJSON-1862037507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3feee3cf-f80c-4b87-ad0b-2df93c769b97 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3feee3cf-f80c-4b87-ad0b-2df93c769b97.a0a4c1da-e6ae-4e49-ae80-d386667eba68" returned: 0 in 0.773s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:02 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-bcba6d3d-eb84-42e1-bd62-234351c304a2 tempest-VolumesSnapshotTestJSON-1862037507 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3feee3cf-f80c-4b87-ad0b-2df93c769b97.a0a4c1da-e6ae-4e49-ae80-d386667eba68 is being set with open permissions: ugo+rw Jul 07 08:24:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bcba6d3d-eb84-42e1-bd62-234351c304a2 tempest-VolumesSnapshotTestJSON-1862037507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3feee3cf-f80c-4b87-ad0b-2df93c769b97.a0a4c1da-e6ae-4e49-ae80-d386667eba68 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:02 devstack sudo[97258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3feee3cf-f80c-4b87-ad0b-2df93c769b97.a0a4c1da-e6ae-4e49-ae80-d386667eba68 Jul 07 08:24:02 devstack sudo[97258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:02 devstack sudo[97250]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6cbe9baf-0f65-4283-8d59-cf0573825bd3 tempest-CreateVolumesFromImageTest-908341297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.742s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:02 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-6cbe9baf-0f65-4283-8d59-cf0573825bd3 tempest-CreateVolumesFromImageTest-908341297 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:24:02 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-6cbe9baf-0f65-4283-8d59-cf0573825bd3 tempest-CreateVolumesFromImageTest-908341297 None] Deleted volume successfully. Jul 07 08:24:02 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6cbe9baf-0f65-4283-8d59-cf0573825bd3 tempest-CreateVolumesFromImageTest-908341297 None] Lock "cinder-aa13175e-c8be-4111-8df2-ff9469f34fff-delete_volume" released by "delete_volume" :: held 2.708s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:24:02 devstack sudo[97252]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4ce95338-188a-4f76-8e70-48907d506c37 tempest-CreateVolumesFromImageTest-908341297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-a2ebeda2-bbcd-44f7-bab1-644968a609e9" returned: 0 in 0.778s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4ce95338-188a-4f76-8e70-48907d506c37 tempest-CreateVolumesFromImageTest-908341297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-a2ebeda2-bbcd-44f7-bab1-644968a609e9 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:02 devstack sudo[97263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-a2ebeda2-bbcd-44f7-bab1-644968a609e9 Jul 07 08:24:02 devstack sudo[97263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:02 devstack sudo[97258]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bcba6d3d-eb84-42e1-bd62-234351c304a2 tempest-VolumesSnapshotTestJSON-1862037507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3feee3cf-f80c-4b87-ad0b-2df93c769b97.a0a4c1da-e6ae-4e49-ae80-d386667eba68" returned: 0 in 0.698s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bcba6d3d-eb84-42e1-bd62-234351c304a2 tempest-VolumesSnapshotTestJSON-1862037507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3feee3cf-f80c-4b87-ad0b-2df93c769b97.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:03 devstack sudo[97266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3feee3cf-f80c-4b87-ad0b-2df93c769b97.info Jul 07 08:24:03 devstack sudo[97266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:03 devstack sudo[97263]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4ce95338-188a-4f76-8e70-48907d506c37 tempest-CreateVolumesFromImageTest-908341297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-a2ebeda2-bbcd-44f7-bab1-644968a609e9" returned: 0 in 0.660s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:03 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4ce95338-188a-4f76-8e70-48907d506c37 tempest-CreateVolumesFromImageTest-908341297 None] Lock "cinder-quobyte-a2ebeda2-bbcd-44f7-bab1-644968a609e9" released by "delete_volume" :: held 1.486s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:24:03 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-4ce95338-188a-4f76-8e70-48907d506c37 tempest-CreateVolumesFromImageTest-908341297 None] Created reservations ['0199430a-e835-4be6-b370-25d583d62511', '35aa3286-5543-4439-94a3-c22207ddf638', 'af8d2450-0bc2-4a7c-82bc-0a4736be098e', 'd7006264-66cb-4480-8bcc-77a9f2e01c22'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:24:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4ce95338-188a-4f76-8e70-48907d506c37 tempest-CreateVolumesFromImageTest-908341297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4ce95338-188a-4f76-8e70-48907d506c37 tempest-CreateVolumesFromImageTest-908341297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4ce95338-188a-4f76-8e70-48907d506c37 tempest-CreateVolumesFromImageTest-908341297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:24:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4ce95338-188a-4f76-8e70-48907d506c37 tempest-CreateVolumesFromImageTest-908341297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:24:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4ce95338-188a-4f76-8e70-48907d506c37 tempest-CreateVolumesFromImageTest-908341297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4ce95338-188a-4f76-8e70-48907d506c37 tempest-CreateVolumesFromImageTest-908341297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:03 devstack sudo[97270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:24:03 devstack sudo[97270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:03 devstack sudo[97266]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bcba6d3d-eb84-42e1-bd62-234351c304a2 tempest-VolumesSnapshotTestJSON-1862037507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3feee3cf-f80c-4b87-ad0b-2df93c769b97.info" returned: 0 in 0.733s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:03 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-bcba6d3d-eb84-42e1-bd62-234351c304a2 tempest-VolumesSnapshotTestJSON-1862037507 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3feee3cf-f80c-4b87-ad0b-2df93c769b97.info is being set with open permissions: ugo+rw Jul 07 08:24:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bcba6d3d-eb84-42e1-bd62-234351c304a2 tempest-VolumesSnapshotTestJSON-1862037507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3feee3cf-f80c-4b87-ad0b-2df93c769b97.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:03 devstack sudo[97272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3feee3cf-f80c-4b87-ad0b-2df93c769b97.info Jul 07 08:24:03 devstack sudo[97272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:04 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-91c01b6a-9408-4220-a3cb-8f255f8e2edc tempest-CreateVolumesFromImageTest-908341297 None] Acquiring lock "cinder-e42f7a06-99b8-443a-97c4-3a6cecb95008-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:24:04 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-91c01b6a-9408-4220-a3cb-8f255f8e2edc tempest-CreateVolumesFromImageTest-908341297 None] Lock "cinder-e42f7a06-99b8-443a-97c4-3a6cecb95008-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:24:04 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-91c01b6a-9408-4220-a3cb-8f255f8e2edc tempest-CreateVolumesFromImageTest-908341297 None] Acquiring lock "cinder-quobyte-e42f7a06-99b8-443a-97c4-3a6cecb95008" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:24:04 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-91c01b6a-9408-4220-a3cb-8f255f8e2edc tempest-CreateVolumesFromImageTest-908341297 None] Lock "cinder-quobyte-e42f7a06-99b8-443a-97c4-3a6cecb95008" acquired by "delete_volume" :: waited 0.016s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:24:04 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[106eb5d8-efcf-489d-8b42-d7279b1079b4]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:24:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-91c01b6a-9408-4220-a3cb-8f255f8e2edc tempest-CreateVolumesFromImageTest-908341297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-e42f7a06-99b8-443a-97c4-3a6cecb95008 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:04 devstack sudo[97270]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4ce95338-188a-4f76-8e70-48907d506c37 tempest-CreateVolumesFromImageTest-908341297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.714s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:04 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-4ce95338-188a-4f76-8e70-48907d506c37 tempest-CreateVolumesFromImageTest-908341297 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:24:04 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-4ce95338-188a-4f76-8e70-48907d506c37 tempest-CreateVolumesFromImageTest-908341297 None] Deleted volume successfully. Jul 07 08:24:04 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4ce95338-188a-4f76-8e70-48907d506c37 tempest-CreateVolumesFromImageTest-908341297 None] Lock "cinder-a2ebeda2-bbcd-44f7-bab1-644968a609e9-delete_volume" released by "delete_volume" :: held 2.433s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:24:04 devstack sudo[97275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-e42f7a06-99b8-443a-97c4-3a6cecb95008 Jul 07 08:24:04 devstack sudo[97275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:04 devstack sudo[97272]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bcba6d3d-eb84-42e1-bd62-234351c304a2 tempest-VolumesSnapshotTestJSON-1862037507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3feee3cf-f80c-4b87-ad0b-2df93c769b97.info" returned: 0 in 0.714s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-bcba6d3d-eb84-42e1-bd62-234351c304a2 tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.887s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-493c5de7-519c-4a33-93a9-d80166992f76 tempest-VolumesActionsTest-1764575982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.550s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-493c5de7-519c-4a33-93a9-d80166992f76 tempest-VolumesActionsTest-1764575982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:23:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1741551412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61270cff-1650-4bab-9500-c67b94e5b803,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68368676a64749b3ba414b1751a5abaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:24:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:24:00Z,use_quota=True,user_id='6717bb48e52b40fc92e585e3937702d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:24:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-493c5de7-519c-4a33-93a9-d80166992f76 tempest-VolumesActionsTest-1764575982 None] Creating volume 61270cff-1650-4bab-9500-c67b94e5b803 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:24:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-493c5de7-519c-4a33-93a9-d80166992f76 tempest-VolumesActionsTest-1764575982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-493c5de7-519c-4a33-93a9-d80166992f76 tempest-VolumesActionsTest-1764575982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-493c5de7-519c-4a33-93a9-d80166992f76 tempest-VolumesActionsTest-1764575982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:24:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-493c5de7-519c-4a33-93a9-d80166992f76 tempest-VolumesActionsTest-1764575982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:24:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-493c5de7-519c-4a33-93a9-d80166992f76 tempest-VolumesActionsTest-1764575982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-493c5de7-519c-4a33-93a9-d80166992f76 tempest-VolumesActionsTest-1764575982 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:24:04 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-493c5de7-519c-4a33-93a9-d80166992f76 tempest-VolumesActionsTest-1764575982 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:24:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-493c5de7-519c-4a33-93a9-d80166992f76 tempest-VolumesActionsTest-1764575982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61270cff-1650-4bab-9500-c67b94e5b803 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:04 devstack sudo[97278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61270cff-1650-4bab-9500-c67b94e5b803 1073741824 Jul 07 08:24:04 devstack sudo[97278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:04 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-bcba6d3d-eb84-42e1-bd62-234351c304a2 tempest-VolumesSnapshotTestJSON-1862037507 None] Create snapshot completed successfully Jul 07 08:24:05 devstack sudo[97275]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-91c01b6a-9408-4220-a3cb-8f255f8e2edc tempest-CreateVolumesFromImageTest-908341297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-e42f7a06-99b8-443a-97c4-3a6cecb95008" returned: 0 in 0.875s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-91c01b6a-9408-4220-a3cb-8f255f8e2edc tempest-CreateVolumesFromImageTest-908341297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-e42f7a06-99b8-443a-97c4-3a6cecb95008 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:05 devstack sudo[97286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-e42f7a06-99b8-443a-97c4-3a6cecb95008 Jul 07 08:24:05 devstack sudo[97286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:05 devstack sudo[97278]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-493c5de7-519c-4a33-93a9-d80166992f76 tempest-VolumesActionsTest-1764575982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61270cff-1650-4bab-9500-c67b94e5b803 1073741824" returned: 0 in 0.945s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-493c5de7-519c-4a33-93a9-d80166992f76 tempest-VolumesActionsTest-1764575982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61270cff-1650-4bab-9500-c67b94e5b803 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:05 devstack sudo[97288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61270cff-1650-4bab-9500-c67b94e5b803 Jul 07 08:24:05 devstack sudo[97288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f05e0758-68b1-4cb9-a4e0-f782ab15d07a tempest-VolumesSnapshotTestJSON-1862037507 None] Acquiring lock "cinder-a0a4c1da-e6ae-4e49-ae80-d386667eba68-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:24:05 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:24:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:24:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:24:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:05 devstack sudo[97286]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-91c01b6a-9408-4220-a3cb-8f255f8e2edc tempest-CreateVolumesFromImageTest-908341297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-e42f7a06-99b8-443a-97c4-3a6cecb95008" returned: 0 in 0.733s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:05 devstack sudo[97291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:24:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f05e0758-68b1-4cb9-a4e0-f782ab15d07a tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "cinder-a0a4c1da-e6ae-4e49-ae80-d386667eba68-delete_snapshot" acquired by "delete_snapshot" :: waited 0.069s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:24:05 devstack sudo[97291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-91c01b6a-9408-4220-a3cb-8f255f8e2edc tempest-CreateVolumesFromImageTest-908341297 None] Lock "cinder-quobyte-e42f7a06-99b8-443a-97c4-3a6cecb95008" released by "delete_volume" :: held 1.682s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:24:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f05e0758-68b1-4cb9-a4e0-f782ab15d07a tempest-VolumesSnapshotTestJSON-1862037507 None] Acquiring lock "cinder-quobyte-3feee3cf-f80c-4b87-ad0b-2df93c769b97" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:24:06 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f05e0758-68b1-4cb9-a4e0-f782ab15d07a tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "cinder-quobyte-3feee3cf-f80c-4b87-ad0b-2df93c769b97" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:24:06 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f05e0758-68b1-4cb9-a4e0-f782ab15d07a tempest-VolumesSnapshotTestJSON-1862037507 None] Acquiring lock "cinder-quobyte-a0a4c1da-e6ae-4e49-ae80-d386667eba68" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:24:06 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f05e0758-68b1-4cb9-a4e0-f782ab15d07a tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "cinder-quobyte-a0a4c1da-e6ae-4e49-ae80-d386667eba68" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:24:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-f05e0758-68b1-4cb9-a4e0-f782ab15d07a tempest-VolumesSnapshotTestJSON-1862037507 None] Deleting offline snapshot a0a4c1da-e6ae-4e49-ae80-d386667eba68 of volume 3feee3cf-f80c-4b87-ad0b-2df93c769b97 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:24:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-f05e0758-68b1-4cb9-a4e0-f782ab15d07a tempest-VolumesSnapshotTestJSON-1862037507 None] snapshot_file for this snap is: volume-3feee3cf-f80c-4b87-ad0b-2df93c769b97.a0a4c1da-e6ae-4e49-ae80-d386667eba68 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:24:06 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee3fd08-102c-40c9-8614-f3c3bbeb708f]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:24:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f05e0758-68b1-4cb9-a4e0-f782ab15d07a tempest-VolumesSnapshotTestJSON-1862037507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3feee3cf-f80c-4b87-ad0b-2df93c769b97.a0a4c1da-e6ae-4e49-ae80-d386667eba68 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:06 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-91c01b6a-9408-4220-a3cb-8f255f8e2edc tempest-CreateVolumesFromImageTest-908341297 None] Created reservations ['603cb57e-ebc9-4b03-b985-0cb33e2a4abb', '7cc74511-fb50-4a68-97c3-6b783df2c553', '0735c6ea-aff0-42c2-9d8b-59df316c0a94', '4c123060-a27d-4c8a-8450-bb081a65e1b9'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:24:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-91c01b6a-9408-4220-a3cb-8f255f8e2edc tempest-CreateVolumesFromImageTest-908341297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-91c01b6a-9408-4220-a3cb-8f255f8e2edc tempest-CreateVolumesFromImageTest-908341297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-91c01b6a-9408-4220-a3cb-8f255f8e2edc tempest-CreateVolumesFromImageTest-908341297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:24:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-91c01b6a-9408-4220-a3cb-8f255f8e2edc tempest-CreateVolumesFromImageTest-908341297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:24:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-91c01b6a-9408-4220-a3cb-8f255f8e2edc tempest-CreateVolumesFromImageTest-908341297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-91c01b6a-9408-4220-a3cb-8f255f8e2edc tempest-CreateVolumesFromImageTest-908341297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:06 devstack sudo[97295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:24:06 devstack sudo[97295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:06 devstack sudo[97288]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-493c5de7-519c-4a33-93a9-d80166992f76 tempest-VolumesActionsTest-1764575982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61270cff-1650-4bab-9500-c67b94e5b803" returned: 0 in 0.761s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-493c5de7-519c-4a33-93a9-d80166992f76 tempest-VolumesActionsTest-1764575982 None] <== create_volume: return (1770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:24:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-493c5de7-519c-4a33-93a9-d80166992f76 tempest-VolumesActionsTest-1764575982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.773s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-19f2109e-3557-4eaa-9503-9b22dcca0998 tempest-VolumesListTestJSON-1975080058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.816s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-19f2109e-3557-4eaa-9503-9b22dcca0998 tempest-VolumesListTestJSON-1975080058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1781103200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f90c37b-dc9f-4456-8eed-9fad6d1a6bb0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fdb2f05404e7490196d791e6b89ad667',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:24:01Z,use_quota=True,user_id='9c9e467030a04dc1b7657d447fafee39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:24:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-19f2109e-3557-4eaa-9503-9b22dcca0998 tempest-VolumesListTestJSON-1975080058 None] Creating volume 3f90c37b-dc9f-4456-8eed-9fad6d1a6bb0 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:24:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-19f2109e-3557-4eaa-9503-9b22dcca0998 tempest-VolumesListTestJSON-1975080058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-19f2109e-3557-4eaa-9503-9b22dcca0998 tempest-VolumesListTestJSON-1975080058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-19f2109e-3557-4eaa-9503-9b22dcca0998 tempest-VolumesListTestJSON-1975080058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:24:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-19f2109e-3557-4eaa-9503-9b22dcca0998 tempest-VolumesListTestJSON-1975080058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:24:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-19f2109e-3557-4eaa-9503-9b22dcca0998 tempest-VolumesListTestJSON-1975080058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-19f2109e-3557-4eaa-9503-9b22dcca0998 tempest-VolumesListTestJSON-1975080058 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:24:06 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-19f2109e-3557-4eaa-9503-9b22dcca0998 tempest-VolumesListTestJSON-1975080058 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:24:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-19f2109e-3557-4eaa-9503-9b22dcca0998 tempest-VolumesListTestJSON-1975080058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3f90c37b-dc9f-4456-8eed-9fad6d1a6bb0 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:06 devstack sudo[97293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3feee3cf-f80c-4b87-ad0b-2df93c769b97.a0a4c1da-e6ae-4e49-ae80-d386667eba68 Jul 07 08:24:06 devstack sudo[97293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-493c5de7-519c-4a33-93a9-d80166992f76 tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a6cd81d-25e4-4540-83e4-46bc3f6af17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61270cff-1650-4bab-9500-c67b94e5b803', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:06 devstack sudo[97297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3f90c37b-dc9f-4456-8eed-9fad6d1a6bb0 1073741824 Jul 07 08:24:06 devstack sudo[97297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-493c5de7-519c-4a33-93a9-d80166992f76 tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a21180d-944c-43f5-b843-0cb377ec01d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:06 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-493c5de7-519c-4a33-93a9-d80166992f76 tempest-VolumesActionsTest-1764575982 None] Volume volume-61270cff-1650-4bab-9500-c67b94e5b803 (61270cff-1650-4bab-9500-c67b94e5b803): created successfully Jul 07 08:24:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-493c5de7-519c-4a33-93a9-d80166992f76 tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a21180d-944c-43f5-b843-0cb377ec01d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-493c5de7-519c-4a33-93a9-d80166992f76 tempest-VolumesActionsTest-1764575982 None] Flow 'volume_create_manager' (2064d4c6-b0ad-46c7-8192-3d227ef800a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:24:06 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-493c5de7-519c-4a33-93a9-d80166992f76 tempest-VolumesActionsTest-1764575982 None] Created volume successfully. Jul 07 08:24:06 devstack sudo[97291]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 1.010s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:06 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:24:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running periodic task VolumeManager._thread_info {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:24:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] thread count: 28 {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 08:24:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] thread info: [<_MainThread(MainThread, started 133056092332160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 08:24:07 devstack sudo[97293]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f05e0758-68b1-4cb9-a4e0-f782ab15d07a tempest-VolumesSnapshotTestJSON-1862037507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3feee3cf-f80c-4b87-ad0b-2df93c769b97.a0a4c1da-e6ae-4e49-ae80-d386667eba68" returned: 0 in 1.095s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:07 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-f05e0758-68b1-4cb9-a4e0-f782ab15d07a tempest-VolumesSnapshotTestJSON-1862037507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3feee3cf-f80c-4b87-ad0b-2df93c769b97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:24:07 devstack sudo[97295]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-91c01b6a-9408-4220-a3cb-8f255f8e2edc tempest-CreateVolumesFromImageTest-908341297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.987s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:07 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-91c01b6a-9408-4220-a3cb-8f255f8e2edc tempest-CreateVolumesFromImageTest-908341297 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:24:07 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc183a0-0c3f-40aa-ae60-e111fe777168]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:24:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f05e0758-68b1-4cb9-a4e0-f782ab15d07a tempest-VolumesSnapshotTestJSON-1862037507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3feee3cf-f80c-4b87-ad0b-2df93c769b97 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:07 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-91c01b6a-9408-4220-a3cb-8f255f8e2edc tempest-CreateVolumesFromImageTest-908341297 None] Deleted volume successfully. Jul 07 08:24:07 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-91c01b6a-9408-4220-a3cb-8f255f8e2edc tempest-CreateVolumesFromImageTest-908341297 None] Lock "cinder-e42f7a06-99b8-443a-97c4-3a6cecb95008-delete_volume" released by "delete_volume" :: held 3.072s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:24:07 devstack sudo[97309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3feee3cf-f80c-4b87-ad0b-2df93c769b97 Jul 07 08:24:07 devstack sudo[97309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:07 devstack sudo[97297]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-19f2109e-3557-4eaa-9503-9b22dcca0998 tempest-VolumesListTestJSON-1975080058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3f90c37b-dc9f-4456-8eed-9fad6d1a6bb0 1073741824" returned: 0 in 1.281s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:07 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d732ac7c-5f63-4982-b07d-ff0773b6677d tempest-VolumesActionsTest-1911398733 None] Acquiring lock "cinder-61270cff-1650-4bab-9500-c67b94e5b803-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:24:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-19f2109e-3557-4eaa-9503-9b22dcca0998 tempest-VolumesListTestJSON-1975080058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3f90c37b-dc9f-4456-8eed-9fad6d1a6bb0 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:07 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d732ac7c-5f63-4982-b07d-ff0773b6677d tempest-VolumesActionsTest-1911398733 None] Lock "cinder-61270cff-1650-4bab-9500-c67b94e5b803-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:24:07 devstack sudo[97311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3f90c37b-dc9f-4456-8eed-9fad6d1a6bb0 Jul 07 08:24:07 devstack sudo[97311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:07 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d732ac7c-5f63-4982-b07d-ff0773b6677d tempest-VolumesActionsTest-1911398733 None] Acquiring lock "cinder-quobyte-61270cff-1650-4bab-9500-c67b94e5b803" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:24:07 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d732ac7c-5f63-4982-b07d-ff0773b6677d tempest-VolumesActionsTest-1911398733 None] Lock "cinder-quobyte-61270cff-1650-4bab-9500-c67b94e5b803" acquired by "delete_volume" :: waited 0.023s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:24:07 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b6c763-09b9-4b2f-8c1d-00af8454ca19]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:24:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d732ac7c-5f63-4982-b07d-ff0773b6677d tempest-VolumesActionsTest-1911398733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61270cff-1650-4bab-9500-c67b94e5b803 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:08 devstack sudo[97313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61270cff-1650-4bab-9500-c67b94e5b803 Jul 07 08:24:08 devstack sudo[97313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:08 devstack sudo[97309]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f05e0758-68b1-4cb9-a4e0-f782ab15d07a tempest-VolumesSnapshotTestJSON-1862037507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3feee3cf-f80c-4b87-ad0b-2df93c769b97" returned: 0 in 0.982s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f05e0758-68b1-4cb9-a4e0-f782ab15d07a tempest-VolumesSnapshotTestJSON-1862037507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3feee3cf-f80c-4b87-ad0b-2df93c769b97.a0a4c1da-e6ae-4e49-ae80-d386667eba68 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:08 devstack sudo[97319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3feee3cf-f80c-4b87-ad0b-2df93c769b97.a0a4c1da-e6ae-4e49-ae80-d386667eba68 Jul 07 08:24:08 devstack sudo[97319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:08 devstack sudo[97311]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-19f2109e-3557-4eaa-9503-9b22dcca0998 tempest-VolumesListTestJSON-1975080058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3f90c37b-dc9f-4456-8eed-9fad6d1a6bb0" returned: 0 in 0.899s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:08 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-19f2109e-3557-4eaa-9503-9b22dcca0998 tempest-VolumesListTestJSON-1975080058 None] <== create_volume: return (2248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:24:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-19f2109e-3557-4eaa-9503-9b22dcca0998 tempest-VolumesListTestJSON-1975080058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.255s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-19f2109e-3557-4eaa-9503-9b22dcca0998 tempest-VolumesListTestJSON-1975080058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bac87ef-98c1-4de3-a684-cf547a0d96ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f90c37b-dc9f-4456-8eed-9fad6d1a6bb0', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-19f2109e-3557-4eaa-9503-9b22dcca0998 tempest-VolumesListTestJSON-1975080058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3dac0a9-6413-4e7e-851f-93ea0a9507fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:08 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-19f2109e-3557-4eaa-9503-9b22dcca0998 tempest-VolumesListTestJSON-1975080058 None] Volume volume-3f90c37b-dc9f-4456-8eed-9fad6d1a6bb0 (3f90c37b-dc9f-4456-8eed-9fad6d1a6bb0): created successfully Jul 07 08:24:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-19f2109e-3557-4eaa-9503-9b22dcca0998 tempest-VolumesListTestJSON-1975080058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3dac0a9-6413-4e7e-851f-93ea0a9507fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-19f2109e-3557-4eaa-9503-9b22dcca0998 tempest-VolumesListTestJSON-1975080058 None] Flow 'volume_create_manager' (1f55da0a-a484-41f2-a412-0542bf1e73ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:24:08 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-19f2109e-3557-4eaa-9503-9b22dcca0998 tempest-VolumesListTestJSON-1975080058 None] Created volume successfully. Jul 07 08:24:08 devstack sudo[97313]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d732ac7c-5f63-4982-b07d-ff0773b6677d tempest-VolumesActionsTest-1911398733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61270cff-1650-4bab-9500-c67b94e5b803" returned: 0 in 0.975s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d732ac7c-5f63-4982-b07d-ff0773b6677d tempest-VolumesActionsTest-1911398733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61270cff-1650-4bab-9500-c67b94e5b803 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:08 devstack sudo[97326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61270cff-1650-4bab-9500-c67b94e5b803 Jul 07 08:24:08 devstack sudo[97326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:09 devstack sudo[97319]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f05e0758-68b1-4cb9-a4e0-f782ab15d07a tempest-VolumesSnapshotTestJSON-1862037507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3feee3cf-f80c-4b87-ad0b-2df93c769b97.a0a4c1da-e6ae-4e49-ae80-d386667eba68" returned: 0 in 0.922s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f05e0758-68b1-4cb9-a4e0-f782ab15d07a tempest-VolumesSnapshotTestJSON-1862037507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3feee3cf-f80c-4b87-ad0b-2df93c769b97.a0a4c1da-e6ae-4e49-ae80-d386667eba68 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:09 devstack sudo[97332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3feee3cf-f80c-4b87-ad0b-2df93c769b97.a0a4c1da-e6ae-4e49-ae80-d386667eba68 Jul 07 08:24:09 devstack sudo[97332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:09 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8fe4492-d0eb-4477-9dfe-f0cc3a8107c3 tempest-VolumesListTestJSON-1975080058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:24:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b8fe4492-d0eb-4477-9dfe-f0cc3a8107c3 tempest-VolumesListTestJSON-1975080058 None] Flow 'volume_create_manager' (dca8e02b-1173-4a91-8657-68f13bab68a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:24:09 devstack sudo[97326]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b8fe4492-d0eb-4477-9dfe-f0cc3a8107c3 tempest-VolumesListTestJSON-1975080058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ac0b0eb-6c6c-425b-babe-9537e8872fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d732ac7c-5f63-4982-b07d-ff0773b6677d tempest-VolumesActionsTest-1911398733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61270cff-1650-4bab-9500-c67b94e5b803" returned: 0 in 0.861s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:09 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d732ac7c-5f63-4982-b07d-ff0773b6677d tempest-VolumesActionsTest-1911398733 None] Lock "cinder-quobyte-61270cff-1650-4bab-9500-c67b94e5b803" released by "delete_volume" :: held 1.900s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:24:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b8fe4492-d0eb-4477-9dfe-f0cc3a8107c3 tempest-VolumesListTestJSON-1975080058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ac0b0eb-6c6c-425b-babe-9537e8872fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1256352205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=666e7fba-7156-48c4-9793-b8f8e04779e1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fdb2f05404e7490196d791e6b89ad667',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:24:10Z,use_quota=True,user_id='9c9e467030a04dc1b7657d447fafee39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b8fe4492-d0eb-4477-9dfe-f0cc3a8107c3 tempest-VolumesListTestJSON-1975080058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (286e2e79-c524-4f63-917d-370d2d60049a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b8fe4492-d0eb-4477-9dfe-f0cc3a8107c3 tempest-VolumesListTestJSON-1975080058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (286e2e79-c524-4f63-917d-370d2d60049a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b8fe4492-d0eb-4477-9dfe-f0cc3a8107c3 tempest-VolumesListTestJSON-1975080058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (941eeb54-34dd-4884-8ab4-45cbc97d1e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b8fe4492-d0eb-4477-9dfe-f0cc3a8107c3 tempest-VolumesListTestJSON-1975080058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (941eeb54-34dd-4884-8ab4-45cbc97d1e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '666e7fba-7156-48c4-9793-b8f8e04779e1', 'volume_name': 'volume-666e7fba-7156-48c4-9793-b8f8e04779e1', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b8fe4492-d0eb-4477-9dfe-f0cc3a8107c3 tempest-VolumesListTestJSON-1975080058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2334ef8d-b96d-41d9-b2b3-7669056da982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b8fe4492-d0eb-4477-9dfe-f0cc3a8107c3 tempest-VolumesListTestJSON-1975080058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2334ef8d-b96d-41d9-b2b3-7669056da982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:09 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b8fe4492-d0eb-4477-9dfe-f0cc3a8107c3 tempest-VolumesListTestJSON-1975080058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (678bbcac-b93e-4e1d-b3c9-984cdf13e3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:09 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-b8fe4492-d0eb-4477-9dfe-f0cc3a8107c3 tempest-VolumesListTestJSON-1975080058 None] Volume 666e7fba-7156-48c4-9793-b8f8e04779e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-666e7fba-7156-48c4-9793-b8f8e04779e1', 'volume_size': 1} Jul 07 08:24:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b8fe4492-d0eb-4477-9dfe-f0cc3a8107c3 tempest-VolumesListTestJSON-1975080058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b8fe4492-d0eb-4477-9dfe-f0cc3a8107c3 tempest-VolumesListTestJSON-1975080058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b8fe4492-d0eb-4477-9dfe-f0cc3a8107c3 tempest-VolumesListTestJSON-1975080058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1256352205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=666e7fba-7156-48c4-9793-b8f8e04779e1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fdb2f05404e7490196d791e6b89ad667',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:24:10Z,use_quota=True,user_id='9c9e467030a04dc1b7657d447fafee39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:24:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-b8fe4492-d0eb-4477-9dfe-f0cc3a8107c3 tempest-VolumesListTestJSON-1975080058 None] Creating volume 666e7fba-7156-48c4-9793-b8f8e04779e1 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:24:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b8fe4492-d0eb-4477-9dfe-f0cc3a8107c3 tempest-VolumesListTestJSON-1975080058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b8fe4492-d0eb-4477-9dfe-f0cc3a8107c3 tempest-VolumesListTestJSON-1975080058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b8fe4492-d0eb-4477-9dfe-f0cc3a8107c3 tempest-VolumesListTestJSON-1975080058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:24:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b8fe4492-d0eb-4477-9dfe-f0cc3a8107c3 tempest-VolumesListTestJSON-1975080058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:24:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b8fe4492-d0eb-4477-9dfe-f0cc3a8107c3 tempest-VolumesListTestJSON-1975080058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b8fe4492-d0eb-4477-9dfe-f0cc3a8107c3 tempest-VolumesListTestJSON-1975080058 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:24:09 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-b8fe4492-d0eb-4477-9dfe-f0cc3a8107c3 tempest-VolumesListTestJSON-1975080058 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:24:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b8fe4492-d0eb-4477-9dfe-f0cc3a8107c3 tempest-VolumesListTestJSON-1975080058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-666e7fba-7156-48c4-9793-b8f8e04779e1 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:09 devstack sudo[97335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-666e7fba-7156-48c4-9793-b8f8e04779e1 1073741824 Jul 07 08:24:09 devstack sudo[97335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:09 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-d732ac7c-5f63-4982-b07d-ff0773b6677d tempest-VolumesActionsTest-1911398733 None] Created reservations ['b8d2a612-0398-4019-9f1f-2a531b177358', '054abfca-a812-48aa-8c73-44bf9aadac97', 'ab854ac0-4aff-4f57-8740-a36bbf8c9100', '4d52d14d-8589-4c1c-aeda-828eab9d8187'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:24:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d732ac7c-5f63-4982-b07d-ff0773b6677d tempest-VolumesActionsTest-1911398733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d732ac7c-5f63-4982-b07d-ff0773b6677d tempest-VolumesActionsTest-1911398733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d732ac7c-5f63-4982-b07d-ff0773b6677d tempest-VolumesActionsTest-1911398733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:24:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d732ac7c-5f63-4982-b07d-ff0773b6677d tempest-VolumesActionsTest-1911398733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:24:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d732ac7c-5f63-4982-b07d-ff0773b6677d tempest-VolumesActionsTest-1911398733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d732ac7c-5f63-4982-b07d-ff0773b6677d tempest-VolumesActionsTest-1911398733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:09 devstack sudo[97332]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f05e0758-68b1-4cb9-a4e0-f782ab15d07a tempest-VolumesSnapshotTestJSON-1862037507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3feee3cf-f80c-4b87-ad0b-2df93c769b97.a0a4c1da-e6ae-4e49-ae80-d386667eba68" returned: 0 in 0.820s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:09 devstack sudo[97338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:24:09 devstack sudo[97338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:10 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f05e0758-68b1-4cb9-a4e0-f782ab15d07a tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "cinder-quobyte-a0a4c1da-e6ae-4e49-ae80-d386667eba68" released by "_delete_snapshot" :: held 3.972s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:24:10 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f05e0758-68b1-4cb9-a4e0-f782ab15d07a tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "cinder-quobyte-3feee3cf-f80c-4b87-ad0b-2df93c769b97" released by "delete_snapshot" :: held 4.016s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:24:10 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-f05e0758-68b1-4cb9-a4e0-f782ab15d07a tempest-VolumesSnapshotTestJSON-1862037507 None] Created reservations ['585ea598-9e93-4688-a4d1-25e5e6840655', '9203e3f9-29c8-4d18-800d-afc0427bd542', '2e0357d0-15e5-4cfe-ae26-695d108d2350', '42e26fbe-cb4a-4d16-829e-cab02a78ffd8'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:24:10 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-f05e0758-68b1-4cb9-a4e0-f782ab15d07a tempest-VolumesSnapshotTestJSON-1862037507 None] Delete snapshot completed successfully. Jul 07 08:24:10 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f05e0758-68b1-4cb9-a4e0-f782ab15d07a tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "cinder-a0a4c1da-e6ae-4e49-ae80-d386667eba68-delete_snapshot" released by "delete_snapshot" :: held 4.285s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:24:10 devstack sudo[97338]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d732ac7c-5f63-4982-b07d-ff0773b6677d tempest-VolumesActionsTest-1911398733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.712s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:10 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-d732ac7c-5f63-4982-b07d-ff0773b6677d tempest-VolumesActionsTest-1911398733 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:24:10 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-d732ac7c-5f63-4982-b07d-ff0773b6677d tempest-VolumesActionsTest-1911398733 None] Deleted volume successfully. Jul 07 08:24:10 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d732ac7c-5f63-4982-b07d-ff0773b6677d tempest-VolumesActionsTest-1911398733 None] Lock "cinder-61270cff-1650-4bab-9500-c67b94e5b803-delete_volume" released by "delete_volume" :: held 3.003s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:24:10 devstack sudo[97335]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b8fe4492-d0eb-4477-9dfe-f0cc3a8107c3 tempest-VolumesListTestJSON-1975080058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-666e7fba-7156-48c4-9793-b8f8e04779e1 1073741824" returned: 0 in 1.031s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b8fe4492-d0eb-4477-9dfe-f0cc3a8107c3 tempest-VolumesListTestJSON-1975080058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-666e7fba-7156-48c4-9793-b8f8e04779e1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:10 devstack sudo[97346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-666e7fba-7156-48c4-9793-b8f8e04779e1 Jul 07 08:24:10 devstack sudo[97346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:11 devstack sudo[97346]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b8fe4492-d0eb-4477-9dfe-f0cc3a8107c3 tempest-VolumesListTestJSON-1975080058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-666e7fba-7156-48c4-9793-b8f8e04779e1" returned: 0 in 0.778s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:11 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b8fe4492-d0eb-4477-9dfe-f0cc3a8107c3 tempest-VolumesListTestJSON-1975080058 None] <== create_volume: return (1854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:24:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b8fe4492-d0eb-4477-9dfe-f0cc3a8107c3 tempest-VolumesListTestJSON-1975080058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.858s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b8fe4492-d0eb-4477-9dfe-f0cc3a8107c3 tempest-VolumesListTestJSON-1975080058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (678bbcac-b93e-4e1d-b3c9-984cdf13e3ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-666e7fba-7156-48c4-9793-b8f8e04779e1', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b8fe4492-d0eb-4477-9dfe-f0cc3a8107c3 tempest-VolumesListTestJSON-1975080058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (045d5bdb-0bab-49a4-82a7-d057f038880f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:11 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-b8fe4492-d0eb-4477-9dfe-f0cc3a8107c3 tempest-VolumesListTestJSON-1975080058 None] Volume volume-666e7fba-7156-48c4-9793-b8f8e04779e1 (666e7fba-7156-48c4-9793-b8f8e04779e1): created successfully Jul 07 08:24:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b8fe4492-d0eb-4477-9dfe-f0cc3a8107c3 tempest-VolumesListTestJSON-1975080058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (045d5bdb-0bab-49a4-82a7-d057f038880f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b8fe4492-d0eb-4477-9dfe-f0cc3a8107c3 tempest-VolumesListTestJSON-1975080058 None] Flow 'volume_create_manager' (dca8e02b-1173-4a91-8657-68f13bab68a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:24:11 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcee29f1-c590-4765-9a05-f371901f8585 tempest-VolumesActionsTest-1764575982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:24:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-dcee29f1-c590-4765-9a05-f371901f8585 tempest-VolumesActionsTest-1764575982 None] Flow 'volume_create_manager' (2ef350c0-6bae-4377-bea9-eed410af809e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:24:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-dcee29f1-c590-4765-9a05-f371901f8585 tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2f9515f-72bc-4fc2-8263-2926c880e9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:11 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-b8fe4492-d0eb-4477-9dfe-f0cc3a8107c3 tempest-VolumesListTestJSON-1975080058 None] Created volume successfully. Jul 07 08:24:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-dcee29f1-c590-4765-9a05-f371901f8585 tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2f9515f-72bc-4fc2-8263-2926c880e9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1389888707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=058b65e3-7b7e-4121-8628-40d5bbbd57bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68368676a64749b3ba414b1751a5abaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:24:12Z,use_quota=True,user_id='6717bb48e52b40fc92e585e3937702d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-dcee29f1-c590-4765-9a05-f371901f8585 tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d9b020d-b471-4209-852a-c83234777b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-dcee29f1-c590-4765-9a05-f371901f8585 tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d9b020d-b471-4209-852a-c83234777b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-dcee29f1-c590-4765-9a05-f371901f8585 tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4c3c038-7a55-406e-ab8b-29a8a3b960d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-dcee29f1-c590-4765-9a05-f371901f8585 tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4c3c038-7a55-406e-ab8b-29a8a3b960d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '058b65e3-7b7e-4121-8628-40d5bbbd57bc', 'volume_name': 'volume-058b65e3-7b7e-4121-8628-40d5bbbd57bc', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-dcee29f1-c590-4765-9a05-f371901f8585 tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb332a3c-58aa-4581-9ab4-7b7c22c8432d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-dcee29f1-c590-4765-9a05-f371901f8585 tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb332a3c-58aa-4581-9ab4-7b7c22c8432d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-dcee29f1-c590-4765-9a05-f371901f8585 tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25ea342c-0dfd-439c-8d76-85df81aa4970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:11 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-dcee29f1-c590-4765-9a05-f371901f8585 tempest-VolumesActionsTest-1764575982 None] Volume 058b65e3-7b7e-4121-8628-40d5bbbd57bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-058b65e3-7b7e-4121-8628-40d5bbbd57bc', 'volume_size': 1} Jul 07 08:24:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-dcee29f1-c590-4765-9a05-f371901f8585 tempest-VolumesActionsTest-1764575982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-dcee29f1-c590-4765-9a05-f371901f8585 tempest-VolumesActionsTest-1764575982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:11 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-dcee29f1-c590-4765-9a05-f371901f8585 tempest-VolumesActionsTest-1764575982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1389888707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=058b65e3-7b7e-4121-8628-40d5bbbd57bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68368676a64749b3ba414b1751a5abaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:24:12Z,use_quota=True,user_id='6717bb48e52b40fc92e585e3937702d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:24:11 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-dcee29f1-c590-4765-9a05-f371901f8585 tempest-VolumesActionsTest-1764575982 None] Creating volume 058b65e3-7b7e-4121-8628-40d5bbbd57bc {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:24:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-dcee29f1-c590-4765-9a05-f371901f8585 tempest-VolumesActionsTest-1764575982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-dcee29f1-c590-4765-9a05-f371901f8585 tempest-VolumesActionsTest-1764575982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:11 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-dcee29f1-c590-4765-9a05-f371901f8585 tempest-VolumesActionsTest-1764575982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:24:11 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-dcee29f1-c590-4765-9a05-f371901f8585 tempest-VolumesActionsTest-1764575982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:24:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-dcee29f1-c590-4765-9a05-f371901f8585 tempest-VolumesActionsTest-1764575982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:11 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-dcee29f1-c590-4765-9a05-f371901f8585 tempest-VolumesActionsTest-1764575982 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:24:11 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-dcee29f1-c590-4765-9a05-f371901f8585 tempest-VolumesActionsTest-1764575982 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:24:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-dcee29f1-c590-4765-9a05-f371901f8585 tempest-VolumesActionsTest-1764575982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-058b65e3-7b7e-4121-8628-40d5bbbd57bc 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:11 devstack sudo[97349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-058b65e3-7b7e-4121-8628-40d5bbbd57bc 1073741824 Jul 07 08:24:11 devstack sudo[97349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:11 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c0abfc0-c819-40a0-bd29-4770e1dcd2c1 tempest-VolumesSnapshotTestJSON-1862037507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:24:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2c0abfc0-c819-40a0-bd29-4770e1dcd2c1 tempest-VolumesSnapshotTestJSON-1862037507 None] Flow 'volume_create_manager' (0d3f9487-b0b3-47fb-80ec-a1d6253f26f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:24:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2c0abfc0-c819-40a0-bd29-4770e1dcd2c1 tempest-VolumesSnapshotTestJSON-1862037507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26af43a7-becf-4631-b933-20f520fd408c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2c0abfc0-c819-40a0-bd29-4770e1dcd2c1 tempest-VolumesSnapshotTestJSON-1862037507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26af43a7-becf-4631-b933-20f520fd408c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1606093558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e12e713-7b86-4b5a-8d1f-8a67dd3a901c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09a4265f78884f7396b49574ccdee3af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:24:12Z,use_quota=True,user_id='775b8acb218a4afa93d6a15c0d98c531',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2c0abfc0-c819-40a0-bd29-4770e1dcd2c1 tempest-VolumesSnapshotTestJSON-1862037507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e871d5a-fa38-4fdb-a80e-ad008a7782a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2c0abfc0-c819-40a0-bd29-4770e1dcd2c1 tempest-VolumesSnapshotTestJSON-1862037507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e871d5a-fa38-4fdb-a80e-ad008a7782a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2c0abfc0-c819-40a0-bd29-4770e1dcd2c1 tempest-VolumesSnapshotTestJSON-1862037507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddc694a5-ace3-421d-a901-8f129a7b0910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2c0abfc0-c819-40a0-bd29-4770e1dcd2c1 tempest-VolumesSnapshotTestJSON-1862037507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddc694a5-ace3-421d-a901-8f129a7b0910) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e12e713-7b86-4b5a-8d1f-8a67dd3a901c', 'volume_name': 'volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2c0abfc0-c819-40a0-bd29-4770e1dcd2c1 tempest-VolumesSnapshotTestJSON-1862037507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fce49634-0d6b-41d9-ab01-a334726ba708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2c0abfc0-c819-40a0-bd29-4770e1dcd2c1 tempest-VolumesSnapshotTestJSON-1862037507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fce49634-0d6b-41d9-ab01-a334726ba708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2c0abfc0-c819-40a0-bd29-4770e1dcd2c1 tempest-VolumesSnapshotTestJSON-1862037507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (110ffba7-5bf1-4d19-abf1-64dfefb1df07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:11 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-2c0abfc0-c819-40a0-bd29-4770e1dcd2c1 tempest-VolumesSnapshotTestJSON-1862037507 None] Volume 6e12e713-7b86-4b5a-8d1f-8a67dd3a901c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c', 'volume_size': 1} Jul 07 08:24:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-2c0abfc0-c819-40a0-bd29-4770e1dcd2c1 tempest-VolumesSnapshotTestJSON-1862037507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:12 devstack sudo[97349]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-dcee29f1-c590-4765-9a05-f371901f8585 tempest-VolumesActionsTest-1764575982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-058b65e3-7b7e-4121-8628-40d5bbbd57bc 1073741824" returned: 0 in 0.964s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-dcee29f1-c590-4765-9a05-f371901f8585 tempest-VolumesActionsTest-1764575982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-058b65e3-7b7e-4121-8628-40d5bbbd57bc {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:12 devstack sudo[97355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-058b65e3-7b7e-4121-8628-40d5bbbd57bc Jul 07 08:24:12 devstack sudo[97355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:13 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:24:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] Flow 'volume_create_manager' (80884775-d8ad-4d28-b935-7d497ff242cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:24:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9daacee5-7b75-4967-bff9-865567d78a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9daacee5-7b75-4967-bff9-865567d78a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:24:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0622f5a8-eda0-4e76-a654-c6a97a2ab7c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c58b82d5a8c5404d960bf8e047629397',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:24:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:24:13Z,use_quota=True,user_id='a788313974884864a60cb402dc7a683d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8a84fa5-af76-4b4d-89cb-a0cf9b692c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8a84fa5-af76-4b4d-89cb-a0cf9b692c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ef22b5b-cb1d-45d1-9eee-9715ab66ad68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:13 devstack cinder-volume[87199]: DEBUG cinder.image.glance [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] Creating Keystone auth plugin from conf {{(pid=87199) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 08:24:13 devstack sudo[97355]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-dcee29f1-c590-4765-9a05-f371901f8585 tempest-VolumesActionsTest-1764575982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-058b65e3-7b7e-4121-8628-40d5bbbd57bc" returned: 0 in 0.838s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-dcee29f1-c590-4765-9a05-f371901f8585 tempest-VolumesActionsTest-1764575982 None] <== create_volume: return (1851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:24:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-dcee29f1-c590-4765-9a05-f371901f8585 tempest-VolumesActionsTest-1764575982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.854s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-2c0abfc0-c819-40a0-bd29-4770e1dcd2c1 tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.651s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-2c0abfc0-c819-40a0-bd29-4770e1dcd2c1 tempest-VolumesSnapshotTestJSON-1862037507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1606093558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e12e713-7b86-4b5a-8d1f-8a67dd3a901c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09a4265f78884f7396b49574ccdee3af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:24:12Z,use_quota=True,user_id='775b8acb218a4afa93d6a15c0d98c531',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:24:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-2c0abfc0-c819-40a0-bd29-4770e1dcd2c1 tempest-VolumesSnapshotTestJSON-1862037507 None] Creating volume 6e12e713-7b86-4b5a-8d1f-8a67dd3a901c {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:24:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-2c0abfc0-c819-40a0-bd29-4770e1dcd2c1 tempest-VolumesSnapshotTestJSON-1862037507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-2c0abfc0-c819-40a0-bd29-4770e1dcd2c1 tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-2c0abfc0-c819-40a0-bd29-4770e1dcd2c1 tempest-VolumesSnapshotTestJSON-1862037507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:24:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-2c0abfc0-c819-40a0-bd29-4770e1dcd2c1 tempest-VolumesSnapshotTestJSON-1862037507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:24:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-2c0abfc0-c819-40a0-bd29-4770e1dcd2c1 tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-2c0abfc0-c819-40a0-bd29-4770e1dcd2c1 tempest-VolumesSnapshotTestJSON-1862037507 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:24:13 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-2c0abfc0-c819-40a0-bd29-4770e1dcd2c1 tempest-VolumesSnapshotTestJSON-1862037507 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:24:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-2c0abfc0-c819-40a0-bd29-4770e1dcd2c1 tempest-VolumesSnapshotTestJSON-1862037507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-dcee29f1-c590-4765-9a05-f371901f8585 tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25ea342c-0dfd-439c-8d76-85df81aa4970) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-058b65e3-7b7e-4121-8628-40d5bbbd57bc', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-dcee29f1-c590-4765-9a05-f371901f8585 tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edd771a4-2b35-4d15-a404-f0a087383ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:13 devstack sudo[97358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c 1073741824 Jul 07 08:24:13 devstack sudo[97358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:13 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-dcee29f1-c590-4765-9a05-f371901f8585 tempest-VolumesActionsTest-1764575982 None] Volume volume-058b65e3-7b7e-4121-8628-40d5bbbd57bc (058b65e3-7b7e-4121-8628-40d5bbbd57bc): created successfully Jul 07 08:24:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-dcee29f1-c590-4765-9a05-f371901f8585 tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edd771a4-2b35-4d15-a404-f0a087383ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-dcee29f1-c590-4765-9a05-f371901f8585 tempest-VolumesActionsTest-1764575982 None] Flow 'volume_create_manager' (2ef350c0-6bae-4377-bea9-eed410af809e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:24:13 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-dcee29f1-c590-4765-9a05-f371901f8585 tempest-VolumesActionsTest-1764575982 None] Created volume successfully. Jul 07 08:24:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ef22b5b-cb1d-45d1-9eee-9715ab66ad68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0622f5a8-eda0-4e76-a654-c6a97a2ab7c3', 'volume_name': 'volume-0622f5a8-eda0-4e76-a654-c6a97a2ab7c3', 'volume_size': 1, 'image_id': 'd5ca8500-98a9-4e68-ae8f-861f267196b4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d5ca8500-98a9-4e68-ae8f-861f267196b4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e985da561614e6c8862bdcef72a6eb67', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c58b82d5a8c5404d960bf8e047629397', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '38a3c0cc4d91abb17a2be095ebe34147400183107c497e874675c39db5440fb5c1e26f745a4b5e42621e0bb44f6136098256e9065ccdb060a493589d7f8e4128', 'id': 'd5ca8500-98a9-4e68-ae8f-861f267196b4', 'created_at': datetime.datetime(2026, 7, 7, 6, 24, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 6, 24, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d5ca8500-98a9-4e68-ae8f-861f267196b4/file', 'properties': {}}, 'image_service': }' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4134b3d-2712-40de-b557-c617cf465f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4134b3d-2712-40de-b557-c617cf465f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (040debbe-32eb-4ac9-aa54-4a827cac1c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:13 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] Volume 0622f5a8-eda0-4e76-a654-c6a97a2ab7c3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0622f5a8-eda0-4e76-a654-c6a97a2ab7c3', 'volume_size': 1, 'image_id': 'd5ca8500-98a9-4e68-ae8f-861f267196b4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d5ca8500-98a9-4e68-ae8f-861f267196b4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e985da561614e6c8862bdcef72a6eb67', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c58b82d5a8c5404d960bf8e047629397', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '38a3c0cc4d91abb17a2be095ebe34147400183107c497e874675c39db5440fb5c1e26f745a4b5e42621e0bb44f6136098256e9065ccdb060a493589d7f8e4128', 'id': 'd5ca8500-98a9-4e68-ae8f-861f267196b4', 'created_at': datetime.datetime(2026, 7, 7, 6, 24, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 6, 24, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d5ca8500-98a9-4e68-ae8f-861f267196b4/file', 'properties': {}}, 'image_service': } Jul 07 08:24:13 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] Trying to clone 0622f5a8-eda0-4e76-a654-c6a97a2ab7c3 from image d5ca8500-98a9-4e68-ae8f-861f267196b4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d5ca8500-98a9-4e68-ae8f-861f267196b4', 'metadata': {}}]). {{(pid=87199) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 08:24:13 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d5ca8500-98a9-4e68-ae8f-861f267196b4_ia5guc8rdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87199) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 08:24:13 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] Image download 0.00 MB at 0.00 MB/s Jul 07 08:24:14 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[022e8515-1a89-4f5d-8bdf-a1ef11fffdb5]: (4, 'raw') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:24:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d5ca8500-98a9-4e68-ae8f-861f267196b4_ia5guc8rdevstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:14 devstack sudo[97360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d5ca8500-98a9-4e68-ae8f-861f267196b4_ia5guc8rdevstack@QuobyteHD Jul 07 08:24:14 devstack sudo[97360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:14 devstack sudo[97358]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-2c0abfc0-c819-40a0-bd29-4770e1dcd2c1 tempest-VolumesSnapshotTestJSON-1862037507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c 1073741824" returned: 0 in 0.991s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-2c0abfc0-c819-40a0-bd29-4770e1dcd2c1 tempest-VolumesSnapshotTestJSON-1862037507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:14 devstack sudo[97368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c Jul 07 08:24:14 devstack sudo[97368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:14 devstack sudo[97360]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d5ca8500-98a9-4e68-ae8f-861f267196b4_ia5guc8rdevstack@QuobyteHD" returned: 0 in 0.796s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d5ca8500-98a9-4e68-ae8f-861f267196b4_ia5guc8rdevstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:14 devstack sudo[97370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d5ca8500-98a9-4e68-ae8f-861f267196b4_ia5guc8rdevstack@QuobyteHD Jul 07 08:24:14 devstack sudo[97370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:14 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4c9a0f91-e004-42bc-8a71-af9355142ec2 tempest-VolumesActionsTest-1911398733 None] Acquiring lock "cinder-058b65e3-7b7e-4121-8628-40d5bbbd57bc-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:24:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4c9a0f91-e004-42bc-8a71-af9355142ec2 tempest-VolumesActionsTest-1911398733 None] Lock "cinder-058b65e3-7b7e-4121-8628-40d5bbbd57bc-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:24:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4c9a0f91-e004-42bc-8a71-af9355142ec2 tempest-VolumesActionsTest-1911398733 None] Acquiring lock "cinder-quobyte-058b65e3-7b7e-4121-8628-40d5bbbd57bc" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:24:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4c9a0f91-e004-42bc-8a71-af9355142ec2 tempest-VolumesActionsTest-1911398733 None] Lock "cinder-quobyte-058b65e3-7b7e-4121-8628-40d5bbbd57bc" acquired by "delete_volume" :: waited 0.024s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:24:15 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c63676a-d464-42db-a93e-5f4216134f2d]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:24:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4c9a0f91-e004-42bc-8a71-af9355142ec2 tempest-VolumesActionsTest-1911398733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-058b65e3-7b7e-4121-8628-40d5bbbd57bc {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b1376851-9dc6-495e-80a6-e5328d3f7391 tempest-VolumesListTestJSON-1975080058 None] Acquiring lock "cinder-666e7fba-7156-48c4-9793-b8f8e04779e1-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:24:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b1376851-9dc6-495e-80a6-e5328d3f7391 tempest-VolumesListTestJSON-1975080058 None] Lock "cinder-666e7fba-7156-48c4-9793-b8f8e04779e1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:24:15 devstack sudo[97372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-058b65e3-7b7e-4121-8628-40d5bbbd57bc Jul 07 08:24:15 devstack sudo[97372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b1376851-9dc6-495e-80a6-e5328d3f7391 tempest-VolumesListTestJSON-1975080058 None] Acquiring lock "cinder-quobyte-666e7fba-7156-48c4-9793-b8f8e04779e1" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:24:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b1376851-9dc6-495e-80a6-e5328d3f7391 tempest-VolumesListTestJSON-1975080058 None] Lock "cinder-quobyte-666e7fba-7156-48c4-9793-b8f8e04779e1" acquired by "delete_volume" :: waited 0.018s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:24:15 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[7986a67f-e296-49c2-b15e-6b0c9f699788]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:24:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b1376851-9dc6-495e-80a6-e5328d3f7391 tempest-VolumesListTestJSON-1975080058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-666e7fba-7156-48c4-9793-b8f8e04779e1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:15 devstack sudo[97374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-666e7fba-7156-48c4-9793-b8f8e04779e1 Jul 07 08:24:15 devstack sudo[97374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:15 devstack sudo[97368]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-2c0abfc0-c819-40a0-bd29-4770e1dcd2c1 tempest-VolumesSnapshotTestJSON-1862037507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c" returned: 0 in 0.901s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-2c0abfc0-c819-40a0-bd29-4770e1dcd2c1 tempest-VolumesSnapshotTestJSON-1862037507 None] <== create_volume: return (1953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:24:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-2c0abfc0-c819-40a0-bd29-4770e1dcd2c1 tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.956s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2c0abfc0-c819-40a0-bd29-4770e1dcd2c1 tempest-VolumesSnapshotTestJSON-1862037507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (110ffba7-5bf1-4d19-abf1-64dfefb1df07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2c0abfc0-c819-40a0-bd29-4770e1dcd2c1 tempest-VolumesSnapshotTestJSON-1862037507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9758c63a-9e2a-4e61-849e-5a36a09d0f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:15 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-2c0abfc0-c819-40a0-bd29-4770e1dcd2c1 tempest-VolumesSnapshotTestJSON-1862037507 None] Volume volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c (6e12e713-7b86-4b5a-8d1f-8a67dd3a901c): created successfully Jul 07 08:24:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2c0abfc0-c819-40a0-bd29-4770e1dcd2c1 tempest-VolumesSnapshotTestJSON-1862037507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9758c63a-9e2a-4e61-849e-5a36a09d0f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2c0abfc0-c819-40a0-bd29-4770e1dcd2c1 tempest-VolumesSnapshotTestJSON-1862037507 None] Flow 'volume_create_manager' (0d3f9487-b0b3-47fb-80ec-a1d6253f26f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:24:15 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-2c0abfc0-c819-40a0-bd29-4770e1dcd2c1 tempest-VolumesSnapshotTestJSON-1862037507 None] Created volume successfully. Jul 07 08:24:15 devstack sudo[97370]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d5ca8500-98a9-4e68-ae8f-861f267196b4_ia5guc8rdevstack@QuobyteHD" returned: 1 in 0.947s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d5ca8500-98a9-4e68-ae8f-861f267196b4_ia5guc8rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:24:15 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] Temporary image d5ca8500-98a9-4e68-ae8f-861f267196b4 is fetched for user a788313974884864a60cb402dc7a683d. {{(pid=87199) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 08:24:15 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55f9110-05ee-489c-8699-a18e1bd360cd]: (4, 'raw') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:24:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d5ca8500-98a9-4e68-ae8f-861f267196b4_ia5guc8rdevstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:15 devstack sudo[97380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d5ca8500-98a9-4e68-ae8f-861f267196b4_ia5guc8rdevstack@QuobyteHD Jul 07 08:24:15 devstack sudo[97380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:16 devstack sudo[97372]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4c9a0f91-e004-42bc-8a71-af9355142ec2 tempest-VolumesActionsTest-1911398733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-058b65e3-7b7e-4121-8628-40d5bbbd57bc" returned: 0 in 0.976s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4c9a0f91-e004-42bc-8a71-af9355142ec2 tempest-VolumesActionsTest-1911398733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-058b65e3-7b7e-4121-8628-40d5bbbd57bc {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:16 devstack sudo[97386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-058b65e3-7b7e-4121-8628-40d5bbbd57bc Jul 07 08:24:16 devstack sudo[97386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:16 devstack sudo[97374]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b1376851-9dc6-495e-80a6-e5328d3f7391 tempest-VolumesListTestJSON-1975080058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-666e7fba-7156-48c4-9793-b8f8e04779e1" returned: 0 in 0.922s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b1376851-9dc6-495e-80a6-e5328d3f7391 tempest-VolumesListTestJSON-1975080058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-666e7fba-7156-48c4-9793-b8f8e04779e1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:16 devstack sudo[97391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-666e7fba-7156-48c4-9793-b8f8e04779e1 Jul 07 08:24:16 devstack sudo[97391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-18b834c2-09fa-4d64-8451-8873ae8344a6 tempest-VolumesSnapshotTestJSON-1862037507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-18b834c2-09fa-4d64-8451-8873ae8344a6 tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:16 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-18b834c2-09fa-4d64-8451-8873ae8344a6 tempest-VolumesSnapshotTestJSON-1862037507 None] Creating offline snapshot 74c2f2e9-1673-42db-ace9-3c0cb7fa16ea of volume 6e12e713-7b86-4b5a-8d1f-8a67dd3a901c {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:24:16 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33cb359-ff4b-4fe4-8b93-bef8e12f5ea6]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:24:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-18b834c2-09fa-4d64-8451-8873ae8344a6 tempest-VolumesSnapshotTestJSON-1862037507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:16 devstack sudo[97393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c Jul 07 08:24:16 devstack sudo[97393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:16 devstack sudo[97380]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d5ca8500-98a9-4e68-ae8f-861f267196b4_ia5guc8rdevstack@QuobyteHD" returned: 0 in 0.889s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d5ca8500-98a9-4e68-ae8f-861f267196b4_ia5guc8rdevstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:16 devstack sudo[97397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d5ca8500-98a9-4e68-ae8f-861f267196b4_ia5guc8rdevstack@QuobyteHD Jul 07 08:24:16 devstack sudo[97397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:16 devstack sudo[97386]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4c9a0f91-e004-42bc-8a71-af9355142ec2 tempest-VolumesActionsTest-1911398733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-058b65e3-7b7e-4121-8628-40d5bbbd57bc" returned: 0 in 0.873s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:17 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4c9a0f91-e004-42bc-8a71-af9355142ec2 tempest-VolumesActionsTest-1911398733 None] Lock "cinder-quobyte-058b65e3-7b7e-4121-8628-40d5bbbd57bc" released by "delete_volume" :: held 1.915s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:24:17 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-4c9a0f91-e004-42bc-8a71-af9355142ec2 tempest-VolumesActionsTest-1911398733 None] Created reservations ['7d0396df-2936-4b8f-ac0c-a19699cfeb95', 'b3c07e4b-7531-47ff-a9ba-3fc822794569', 'bd5a465e-8271-4b5a-aa51-eccd996ab401', '9ab938f3-051d-4353-aa70-e8319c9e4e44'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:24:17 devstack sudo[97391]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b1376851-9dc6-495e-80a6-e5328d3f7391 tempest-VolumesListTestJSON-1975080058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-666e7fba-7156-48c4-9793-b8f8e04779e1" returned: 0 in 0.773s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:17 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b1376851-9dc6-495e-80a6-e5328d3f7391 tempest-VolumesListTestJSON-1975080058 None] Lock "cinder-quobyte-666e7fba-7156-48c4-9793-b8f8e04779e1" released by "delete_volume" :: held 1.758s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:24:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4c9a0f91-e004-42bc-8a71-af9355142ec2 tempest-VolumesActionsTest-1911398733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4c9a0f91-e004-42bc-8a71-af9355142ec2 tempest-VolumesActionsTest-1911398733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:17 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4c9a0f91-e004-42bc-8a71-af9355142ec2 tempest-VolumesActionsTest-1911398733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:24:17 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4c9a0f91-e004-42bc-8a71-af9355142ec2 tempest-VolumesActionsTest-1911398733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:24:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4c9a0f91-e004-42bc-8a71-af9355142ec2 tempest-VolumesActionsTest-1911398733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4c9a0f91-e004-42bc-8a71-af9355142ec2 tempest-VolumesActionsTest-1911398733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:17 devstack sudo[97401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:24:17 devstack sudo[97401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:17 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-b1376851-9dc6-495e-80a6-e5328d3f7391 tempest-VolumesListTestJSON-1975080058 None] Created reservations ['11b71089-14b8-4e61-b39a-f41b33383ea3', '9f07c554-510b-4281-a2a6-82dcad3ee6fe', 'ec3fa487-da2d-41cf-9dee-ed20a94575a1', '88b84284-676c-44a4-92d1-37f31ba37cc9'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:24:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b1376851-9dc6-495e-80a6-e5328d3f7391 tempest-VolumesListTestJSON-1975080058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b1376851-9dc6-495e-80a6-e5328d3f7391 tempest-VolumesListTestJSON-1975080058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:17 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b1376851-9dc6-495e-80a6-e5328d3f7391 tempest-VolumesListTestJSON-1975080058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:24:17 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b1376851-9dc6-495e-80a6-e5328d3f7391 tempest-VolumesListTestJSON-1975080058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:24:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b1376851-9dc6-495e-80a6-e5328d3f7391 tempest-VolumesListTestJSON-1975080058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b1376851-9dc6-495e-80a6-e5328d3f7391 tempest-VolumesListTestJSON-1975080058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:17 devstack sudo[97406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:24:17 devstack sudo[97406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:17 devstack sudo[97393]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-18b834c2-09fa-4d64-8451-8873ae8344a6 tempest-VolumesSnapshotTestJSON-1862037507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c" returned: 0 in 0.961s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-18b834c2-09fa-4d64-8451-8873ae8344a6 tempest-VolumesSnapshotTestJSON-1862037507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c.74c2f2e9-1673-42db-ace9-3c0cb7fa16ea 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:17 devstack sudo[97409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c.74c2f2e9-1673-42db-ace9-3c0cb7fa16ea 1G Jul 07 08:24:17 devstack sudo[97409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:17 devstack sudo[97397]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d5ca8500-98a9-4e68-ae8f-861f267196b4_ia5guc8rdevstack@QuobyteHD" returned: 1 in 0.920s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d5ca8500-98a9-4e68-ae8f-861f267196b4_ia5guc8rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:24:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:17 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-01a10db5-bdfd-4979-8c6d-416283c3a934 tempest-VolumesListTestJSON-1975080058 None] Acquiring lock "cinder-3f90c37b-dc9f-4456-8eed-9fad6d1a6bb0-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:24:17 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-01a10db5-bdfd-4979-8c6d-416283c3a934 tempest-VolumesListTestJSON-1975080058 None] Lock "cinder-3f90c37b-dc9f-4456-8eed-9fad6d1a6bb0-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:24:17 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-01a10db5-bdfd-4979-8c6d-416283c3a934 tempest-VolumesListTestJSON-1975080058 None] Acquiring lock "cinder-quobyte-3f90c37b-dc9f-4456-8eed-9fad6d1a6bb0" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:24:18 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-01a10db5-bdfd-4979-8c6d-416283c3a934 tempest-VolumesListTestJSON-1975080058 None] Lock "cinder-quobyte-3f90c37b-dc9f-4456-8eed-9fad6d1a6bb0" acquired by "delete_volume" :: waited 0.042s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:24:18 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[947d967a-4849-4752-9b0d-126231a2001a]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:24:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-01a10db5-bdfd-4979-8c6d-416283c3a934 tempest-VolumesListTestJSON-1975080058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3f90c37b-dc9f-4456-8eed-9fad6d1a6bb0 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:18 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9f6ff4b-0b5a-4cbe-9f32-0aa4aa9ab7ae tempest-VolumesActionsTest-1764575982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:24:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d9f6ff4b-0b5a-4cbe-9f32-0aa4aa9ab7ae tempest-VolumesActionsTest-1764575982 None] Flow 'volume_create_manager' (9be4e73f-b5c6-407f-bbf8-d7afaae70642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:24:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d9f6ff4b-0b5a-4cbe-9f32-0aa4aa9ab7ae tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19587b11-9771-4e6e-9eeb-324aee8fc16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:18 devstack sudo[97414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3f90c37b-dc9f-4456-8eed-9fad6d1a6bb0 Jul 07 08:24:18 devstack sudo[97414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:18 devstack sudo[97401]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d9f6ff4b-0b5a-4cbe-9f32-0aa4aa9ab7ae tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19587b11-9771-4e6e-9eeb-324aee8fc16e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:24:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-199961314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=535feb6e-f1be-431a-b412-7b8d9330f49e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68368676a64749b3ba414b1751a5abaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:24:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:24:18Z,use_quota=True,user_id='6717bb48e52b40fc92e585e3937702d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d9f6ff4b-0b5a-4cbe-9f32-0aa4aa9ab7ae tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9caa1e5-32ba-49ea-8e17-9f14dd664f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d9f6ff4b-0b5a-4cbe-9f32-0aa4aa9ab7ae tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9caa1e5-32ba-49ea-8e17-9f14dd664f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d9f6ff4b-0b5a-4cbe-9f32-0aa4aa9ab7ae tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f5b32b1-46ac-40c7-b8ef-c0d8d0e7897d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d9f6ff4b-0b5a-4cbe-9f32-0aa4aa9ab7ae tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f5b32b1-46ac-40c7-b8ef-c0d8d0e7897d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '535feb6e-f1be-431a-b412-7b8d9330f49e', 'volume_name': 'volume-535feb6e-f1be-431a-b412-7b8d9330f49e', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:18 devstack sudo[97406]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d9f6ff4b-0b5a-4cbe-9f32-0aa4aa9ab7ae tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2268464-29ca-4bed-88b1-03cd3e5ee0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d9f6ff4b-0b5a-4cbe-9f32-0aa4aa9ab7ae tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2268464-29ca-4bed-88b1-03cd3e5ee0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d9f6ff4b-0b5a-4cbe-9f32-0aa4aa9ab7ae tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f82e048e-1462-4ece-b0b1-5bd6704772fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:18 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-d9f6ff4b-0b5a-4cbe-9f32-0aa4aa9ab7ae tempest-VolumesActionsTest-1764575982 None] Volume 535feb6e-f1be-431a-b412-7b8d9330f49e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-535feb6e-f1be-431a-b412-7b8d9330f49e', 'volume_size': 1} Jul 07 08:24:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d9f6ff4b-0b5a-4cbe-9f32-0aa4aa9ab7ae tempest-VolumesActionsTest-1764575982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4c9a0f91-e004-42bc-8a71-af9355142ec2 tempest-VolumesActionsTest-1911398733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 1.085s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b1376851-9dc6-495e-80a6-e5328d3f7391 tempest-VolumesListTestJSON-1975080058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.915s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:18 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-4c9a0f91-e004-42bc-8a71-af9355142ec2 tempest-VolumesActionsTest-1911398733 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:24:18 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-b1376851-9dc6-495e-80a6-e5328d3f7391 tempest-VolumesListTestJSON-1975080058 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:24:18 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-4c9a0f91-e004-42bc-8a71-af9355142ec2 tempest-VolumesActionsTest-1911398733 None] Deleted volume successfully. Jul 07 08:24:18 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4c9a0f91-e004-42bc-8a71-af9355142ec2 tempest-VolumesActionsTest-1911398733 None] Lock "cinder-058b65e3-7b7e-4121-8628-40d5bbbd57bc-delete_volume" released by "delete_volume" :: held 3.315s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:24:18 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-b1376851-9dc6-495e-80a6-e5328d3f7391 tempest-VolumesListTestJSON-1975080058 None] Deleted volume successfully. Jul 07 08:24:18 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b1376851-9dc6-495e-80a6-e5328d3f7391 tempest-VolumesListTestJSON-1975080058 None] Lock "cinder-666e7fba-7156-48c4-9793-b8f8e04779e1-delete_volume" released by "delete_volume" :: held 3.035s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:24:18 devstack sudo[97409]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-18b834c2-09fa-4d64-8451-8873ae8344a6 tempest-VolumesSnapshotTestJSON-1862037507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c.74c2f2e9-1673-42db-ace9-3c0cb7fa16ea 1G" returned: 0 in 1.174s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-18b834c2-09fa-4d64-8451-8873ae8344a6 tempest-VolumesSnapshotTestJSON-1862037507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c.74c2f2e9-1673-42db-ace9-3c0cb7fa16ea {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:18 devstack sudo[97420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c.74c2f2e9-1673-42db-ace9-3c0cb7fa16ea Jul 07 08:24:18 devstack sudo[97420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:18 devstack sudo[97414]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-01a10db5-bdfd-4979-8c6d-416283c3a934 tempest-VolumesListTestJSON-1975080058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3f90c37b-dc9f-4456-8eed-9fad6d1a6bb0" returned: 0 in 0.839s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-01a10db5-bdfd-4979-8c6d-416283c3a934 tempest-VolumesListTestJSON-1975080058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3f90c37b-dc9f-4456-8eed-9fad6d1a6bb0 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:18 devstack sudo[97425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3f90c37b-dc9f-4456-8eed-9fad6d1a6bb0 Jul 07 08:24:18 devstack sudo[97425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:19 devstack sudo[97420]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-18b834c2-09fa-4d64-8451-8873ae8344a6 tempest-VolumesSnapshotTestJSON-1862037507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c.74c2f2e9-1673-42db-ace9-3c0cb7fa16ea" returned: 0 in 0.760s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:19 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-18b834c2-09fa-4d64-8451-8873ae8344a6 tempest-VolumesSnapshotTestJSON-1862037507 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c.74c2f2e9-1673-42db-ace9-3c0cb7fa16ea is being set with open permissions: ugo+rw Jul 07 08:24:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-18b834c2-09fa-4d64-8451-8873ae8344a6 tempest-VolumesSnapshotTestJSON-1862037507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c.74c2f2e9-1673-42db-ace9-3c0cb7fa16ea {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:19 devstack sudo[97430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c.74c2f2e9-1673-42db-ace9-3c0cb7fa16ea Jul 07 08:24:19 devstack sudo[97430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:19 devstack sudo[97425]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-01a10db5-bdfd-4979-8c6d-416283c3a934 tempest-VolumesListTestJSON-1975080058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3f90c37b-dc9f-4456-8eed-9fad6d1a6bb0" returned: 0 in 0.712s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:19 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-01a10db5-bdfd-4979-8c6d-416283c3a934 tempest-VolumesListTestJSON-1975080058 None] Lock "cinder-quobyte-3f90c37b-dc9f-4456-8eed-9fad6d1a6bb0" released by "delete_volume" :: held 1.641s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:24:19 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-01a10db5-bdfd-4979-8c6d-416283c3a934 tempest-VolumesListTestJSON-1975080058 None] Created reservations ['bc1335f0-4d30-458b-a182-921644dcb816', '41490ef1-84c7-4045-ac34-a8bdec3d1223', 'f24baf1c-0d7a-4975-b874-6fc5a839bb98', '4bb3b62e-1676-47d5-8ca7-20c69044afbf'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:24:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-01a10db5-bdfd-4979-8c6d-416283c3a934 tempest-VolumesListTestJSON-1975080058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-01a10db5-bdfd-4979-8c6d-416283c3a934 tempest-VolumesListTestJSON-1975080058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:19 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-01a10db5-bdfd-4979-8c6d-416283c3a934 tempest-VolumesListTestJSON-1975080058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:24:19 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-01a10db5-bdfd-4979-8c6d-416283c3a934 tempest-VolumesListTestJSON-1975080058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:24:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-01a10db5-bdfd-4979-8c6d-416283c3a934 tempest-VolumesListTestJSON-1975080058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-01a10db5-bdfd-4979-8c6d-416283c3a934 tempest-VolumesListTestJSON-1975080058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:19 devstack sudo[97433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:24:19 devstack sudo[97433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:20 devstack sudo[97430]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-18b834c2-09fa-4d64-8451-8873ae8344a6 tempest-VolumesSnapshotTestJSON-1862037507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c.74c2f2e9-1673-42db-ace9-3c0cb7fa16ea" returned: 0 in 0.645s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-18b834c2-09fa-4d64-8451-8873ae8344a6 tempest-VolumesSnapshotTestJSON-1862037507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:20 devstack sudo[97436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c.info Jul 07 08:24:20 devstack sudo[97436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:20 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0c2299ae-d23a-4f04-b310-497a164b3e19 tempest-VolumesListTestJSON-1975080058 None] Acquiring lock "cinder-5e57c9a0-691f-46d7-8bc1-a323784e3d9f-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:24:20 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0c2299ae-d23a-4f04-b310-497a164b3e19 tempest-VolumesListTestJSON-1975080058 None] Lock "cinder-5e57c9a0-691f-46d7-8bc1-a323784e3d9f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:24:20 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0c2299ae-d23a-4f04-b310-497a164b3e19 tempest-VolumesListTestJSON-1975080058 None] Acquiring lock "cinder-quobyte-5e57c9a0-691f-46d7-8bc1-a323784e3d9f" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:24:20 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0c2299ae-d23a-4f04-b310-497a164b3e19 tempest-VolumesListTestJSON-1975080058 None] Lock "cinder-quobyte-5e57c9a0-691f-46d7-8bc1-a323784e3d9f" acquired by "delete_volume" :: waited 0.018s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:24:20 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f3bc1d-63cf-4fd9-8f39-ae601fd705e7]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:24:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0c2299ae-d23a-4f04-b310-497a164b3e19 tempest-VolumesListTestJSON-1975080058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5e57c9a0-691f-46d7-8bc1-a323784e3d9f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:20 devstack sudo[97433]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-01a10db5-bdfd-4979-8c6d-416283c3a934 tempest-VolumesListTestJSON-1975080058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.711s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:20 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-01a10db5-bdfd-4979-8c6d-416283c3a934 tempest-VolumesListTestJSON-1975080058 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:24:20 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-01a10db5-bdfd-4979-8c6d-416283c3a934 tempest-VolumesListTestJSON-1975080058 None] Deleted volume successfully. Jul 07 08:24:20 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-01a10db5-bdfd-4979-8c6d-416283c3a934 tempest-VolumesListTestJSON-1975080058 None] Lock "cinder-3f90c37b-dc9f-4456-8eed-9fad6d1a6bb0-delete_volume" released by "delete_volume" :: held 2.618s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:24:20 devstack sudo[97439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5e57c9a0-691f-46d7-8bc1-a323784e3d9f Jul 07 08:24:20 devstack sudo[97439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:20 devstack sudo[97436]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-18b834c2-09fa-4d64-8451-8873ae8344a6 tempest-VolumesSnapshotTestJSON-1862037507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c.info" returned: 0 in 0.675s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:20 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-18b834c2-09fa-4d64-8451-8873ae8344a6 tempest-VolumesSnapshotTestJSON-1862037507 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c.info is being set with open permissions: ugo+rw Jul 07 08:24:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-18b834c2-09fa-4d64-8451-8873ae8344a6 tempest-VolumesSnapshotTestJSON-1862037507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:20 devstack sudo[97443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c.info Jul 07 08:24:20 devstack sudo[97443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:21 devstack sudo[97439]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0c2299ae-d23a-4f04-b310-497a164b3e19 tempest-VolumesListTestJSON-1975080058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5e57c9a0-691f-46d7-8bc1-a323784e3d9f" returned: 0 in 0.768s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0c2299ae-d23a-4f04-b310-497a164b3e19 tempest-VolumesListTestJSON-1975080058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5e57c9a0-691f-46d7-8bc1-a323784e3d9f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:21 devstack sudo[97448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5e57c9a0-691f-46d7-8bc1-a323784e3d9f Jul 07 08:24:21 devstack sudo[97448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:21 devstack sudo[97443]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-18b834c2-09fa-4d64-8451-8873ae8344a6 tempest-VolumesSnapshotTestJSON-1862037507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c.info" returned: 0 in 0.630s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-18b834c2-09fa-4d64-8451-8873ae8344a6 tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.968s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.806s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:21 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:24:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0622f5a8-eda0-4e76-a654-c6a97a2ab7c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c58b82d5a8c5404d960bf8e047629397',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:24:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:24:13Z,use_quota=True,user_id='a788313974884864a60cb402dc7a683d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:24:21 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] Creating volume 0622f5a8-eda0-4e76-a654-c6a97a2ab7c3 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:24:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:21 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:24:21 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:24:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:21 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:24:21 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:24:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0622f5a8-eda0-4e76-a654-c6a97a2ab7c3 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:21 devstack sudo[97451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0622f5a8-eda0-4e76-a654-c6a97a2ab7c3 1073741824 Jul 07 08:24:21 devstack sudo[97451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:21 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-18b834c2-09fa-4d64-8451-8873ae8344a6 tempest-VolumesSnapshotTestJSON-1862037507 None] Create snapshot completed successfully Jul 07 08:24:21 devstack sudo[97448]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0c2299ae-d23a-4f04-b310-497a164b3e19 tempest-VolumesListTestJSON-1975080058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5e57c9a0-691f-46d7-8bc1-a323784e3d9f" returned: 0 in 0.681s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:21 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0c2299ae-d23a-4f04-b310-497a164b3e19 tempest-VolumesListTestJSON-1975080058 None] Lock "cinder-quobyte-5e57c9a0-691f-46d7-8bc1-a323784e3d9f" released by "delete_volume" :: held 1.495s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:24:21 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-0c2299ae-d23a-4f04-b310-497a164b3e19 tempest-VolumesListTestJSON-1975080058 None] Created reservations ['287ae7da-a0ff-485a-9f3a-a7b696f2ca4b', '52929def-fee7-4c21-8c41-04977d997397', '34b872f3-0efa-4301-8535-870b72a1481a', 'd143b196-acca-4940-a232-e1c9625a5e5e'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:24:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0c2299ae-d23a-4f04-b310-497a164b3e19 tempest-VolumesListTestJSON-1975080058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0c2299ae-d23a-4f04-b310-497a164b3e19 tempest-VolumesListTestJSON-1975080058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:22 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-0c2299ae-d23a-4f04-b310-497a164b3e19 tempest-VolumesListTestJSON-1975080058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:24:22 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-0c2299ae-d23a-4f04-b310-497a164b3e19 tempest-VolumesListTestJSON-1975080058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:24:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0c2299ae-d23a-4f04-b310-497a164b3e19 tempest-VolumesListTestJSON-1975080058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0c2299ae-d23a-4f04-b310-497a164b3e19 tempest-VolumesListTestJSON-1975080058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:22 devstack sudo[97457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:24:22 devstack sudo[97457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:22 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc461416-4293-408e-ae80-4a4a6af39877 tempest-VolumesSnapshotTestJSON-1862037507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:24:22 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cc461416-4293-408e-ae80-4a4a6af39877 tempest-VolumesSnapshotTestJSON-1862037507 None] Flow 'volume_create_manager' (bbdd3bd8-d389-4b97-82c3-ccc6a876d898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:24:22 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cc461416-4293-408e-ae80-4a4a6af39877 tempest-VolumesSnapshotTestJSON-1862037507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5b2e970-d4cb-4d24-a489-3c0fa9d3b898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:22 devstack sudo[97451]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:22 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cc461416-4293-408e-ae80-4a4a6af39877 tempest-VolumesSnapshotTestJSON-1862037507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5b2e970-d4cb-4d24-a489-3c0fa9d3b898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:24:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1569063308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4534fab-e9d0-444b-b93f-05d32a81df8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09a4265f78884f7396b49574ccdee3af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:24:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=74c2f2e9-1673-42db-ace9-3c0cb7fa16ea,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:24:22Z,use_quota=True,user_id='775b8acb218a4afa93d6a15c0d98c531',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:22 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cc461416-4293-408e-ae80-4a4a6af39877 tempest-VolumesSnapshotTestJSON-1862037507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb5515d6-65fb-46aa-9db1-13cb6f728b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:22 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cc461416-4293-408e-ae80-4a4a6af39877 tempest-VolumesSnapshotTestJSON-1862037507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb5515d6-65fb-46aa-9db1-13cb6f728b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:22 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cc461416-4293-408e-ae80-4a4a6af39877 tempest-VolumesSnapshotTestJSON-1862037507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67e309c1-1caf-4c8c-86f2-94ad8aa40037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:22 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cc461416-4293-408e-ae80-4a4a6af39877 tempest-VolumesSnapshotTestJSON-1862037507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67e309c1-1caf-4c8c-86f2-94ad8aa40037) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c4534fab-e9d0-444b-b93f-05d32a81df8d', 'volume_name': 'volume-c4534fab-e9d0-444b-b93f-05d32a81df8d', 'volume_size': 2, 'snapshot_id': '74c2f2e9-1673-42db-ace9-3c0cb7fa16ea'}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:22 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cc461416-4293-408e-ae80-4a4a6af39877 tempest-VolumesSnapshotTestJSON-1862037507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88dcff80-9fb8-413c-867b-2032d54a6277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:22 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cc461416-4293-408e-ae80-4a4a6af39877 tempest-VolumesSnapshotTestJSON-1862037507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88dcff80-9fb8-413c-867b-2032d54a6277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:22 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cc461416-4293-408e-ae80-4a4a6af39877 tempest-VolumesSnapshotTestJSON-1862037507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (528abbff-a2dd-4479-9627-26e39daa7dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:22 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-cc461416-4293-408e-ae80-4a4a6af39877 tempest-VolumesSnapshotTestJSON-1862037507 None] Volume c4534fab-e9d0-444b-b93f-05d32a81df8d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c4534fab-e9d0-444b-b93f-05d32a81df8d', 'volume_size': 2, 'snapshot_id': '74c2f2e9-1673-42db-ace9-3c0cb7fa16ea'} Jul 07 08:24:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0622f5a8-eda0-4e76-a654-c6a97a2ab7c3 1073741824" returned: 0 in 0.927s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cc461416-4293-408e-ae80-4a4a6af39877 tempest-VolumesSnapshotTestJSON-1862037507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0622f5a8-eda0-4e76-a654-c6a97a2ab7c3 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:22 devstack sudo[97459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0622f5a8-eda0-4e76-a654-c6a97a2ab7c3 Jul 07 08:24:22 devstack sudo[97459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:22 devstack sudo[97457]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0c2299ae-d23a-4f04-b310-497a164b3e19 tempest-VolumesListTestJSON-1975080058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.753s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:22 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-0c2299ae-d23a-4f04-b310-497a164b3e19 tempest-VolumesListTestJSON-1975080058 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:24:22 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-0c2299ae-d23a-4f04-b310-497a164b3e19 tempest-VolumesListTestJSON-1975080058 None] Deleted volume successfully. Jul 07 08:24:22 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0c2299ae-d23a-4f04-b310-497a164b3e19 tempest-VolumesListTestJSON-1975080058 None] Lock "cinder-5e57c9a0-691f-46d7-8bc1-a323784e3d9f-delete_volume" released by "delete_volume" :: held 2.495s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:24:23 devstack sudo[97459]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0622f5a8-eda0-4e76-a654-c6a97a2ab7c3" returned: 0 in 0.690s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] <== create_volume: return (1660ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:24:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.663s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d9f6ff4b-0b5a-4cbe-9f32-0aa4aa9ab7ae tempest-VolumesActionsTest-1764575982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.834s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d9f6ff4b-0b5a-4cbe-9f32-0aa4aa9ab7ae tempest-VolumesActionsTest-1764575982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:24:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-199961314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=535feb6e-f1be-431a-b412-7b8d9330f49e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68368676a64749b3ba414b1751a5abaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:24:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:24:18Z,use_quota=True,user_id='6717bb48e52b40fc92e585e3937702d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:24:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-d9f6ff4b-0b5a-4cbe-9f32-0aa4aa9ab7ae tempest-VolumesActionsTest-1764575982 None] Creating volume 535feb6e-f1be-431a-b412-7b8d9330f49e {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:24:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d9f6ff4b-0b5a-4cbe-9f32-0aa4aa9ab7ae tempest-VolumesActionsTest-1764575982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d9f6ff4b-0b5a-4cbe-9f32-0aa4aa9ab7ae tempest-VolumesActionsTest-1764575982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d9f6ff4b-0b5a-4cbe-9f32-0aa4aa9ab7ae tempest-VolumesActionsTest-1764575982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:24:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d9f6ff4b-0b5a-4cbe-9f32-0aa4aa9ab7ae tempest-VolumesActionsTest-1764575982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:24:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d9f6ff4b-0b5a-4cbe-9f32-0aa4aa9ab7ae tempest-VolumesActionsTest-1764575982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d9f6ff4b-0b5a-4cbe-9f32-0aa4aa9ab7ae tempest-VolumesActionsTest-1764575982 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:24:23 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-d9f6ff4b-0b5a-4cbe-9f32-0aa4aa9ab7ae tempest-VolumesActionsTest-1764575982 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:24:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d9f6ff4b-0b5a-4cbe-9f32-0aa4aa9ab7ae tempest-VolumesActionsTest-1764575982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-535feb6e-f1be-431a-b412-7b8d9330f49e 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:23 devstack cinder-volume[87199]: DEBUG cinder.volume.volume_utils [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] Attempting download of d5ca8500-98a9-4e68-ae8f-861f267196b4 ((None, [{'url': 'file:///opt/stack/data/glance/images/d5ca8500-98a9-4e68-ae8f-861f267196b4', 'metadata': {}}])) to volume 0622f5a8-eda0-4e76-a654-c6a97a2ab7c3. {{(pid=87199) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 08:24:23 devstack sudo[97463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-535feb6e-f1be-431a-b412-7b8d9330f49e 1073741824 Jul 07 08:24:23 devstack sudo[97463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:23 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[89abc4af-4d8b-4bdc-a84a-0da3c7317e5a]: (4, 'raw') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:24:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d5ca8500-98a9-4e68-ae8f-861f267196b4_quiou_xe {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:23 devstack sudo[97465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d5ca8500-98a9-4e68-ae8f-861f267196b4_quiou_xe Jul 07 08:24:23 devstack sudo[97465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:24 devstack sudo[97465]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d5ca8500-98a9-4e68-ae8f-861f267196b4_quiou_xe" returned: 0 in 0.846s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d5ca8500-98a9-4e68-ae8f-861f267196b4_quiou_xe {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:24 devstack sudo[97463]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d9f6ff4b-0b5a-4cbe-9f32-0aa4aa9ab7ae tempest-VolumesActionsTest-1764575982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-535feb6e-f1be-431a-b412-7b8d9330f49e 1073741824" returned: 0 in 0.992s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d9f6ff4b-0b5a-4cbe-9f32-0aa4aa9ab7ae tempest-VolumesActionsTest-1764575982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-535feb6e-f1be-431a-b412-7b8d9330f49e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:24 devstack sudo[97474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-535feb6e-f1be-431a-b412-7b8d9330f49e Jul 07 08:24:24 devstack sudo[97474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:24 devstack sudo[97473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d5ca8500-98a9-4e68-ae8f-861f267196b4_quiou_xe Jul 07 08:24:24 devstack sudo[97473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:24 devstack sudo[97473]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d5ca8500-98a9-4e68-ae8f-861f267196b4_quiou_xe" returned: 1 in 0.774s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d5ca8500-98a9-4e68-ae8f-861f267196b4_quiou_xe' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:24:24 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88dc617-4e28-4b2a-b611-66db68e9f373]: (4, 'raw') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:24:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d5ca8500-98a9-4e68-ae8f-861f267196b4_ia5guc8rdevstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:24 devstack sudo[97474]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d9f6ff4b-0b5a-4cbe-9f32-0aa4aa9ab7ae tempest-VolumesActionsTest-1764575982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-535feb6e-f1be-431a-b412-7b8d9330f49e" returned: 0 in 0.751s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:24 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d9f6ff4b-0b5a-4cbe-9f32-0aa4aa9ab7ae tempest-VolumesActionsTest-1764575982 None] <== create_volume: return (1808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:24:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d9f6ff4b-0b5a-4cbe-9f32-0aa4aa9ab7ae tempest-VolumesActionsTest-1764575982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.811s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cc461416-4293-408e-ae80-4a4a6af39877 tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.536s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cc461416-4293-408e-ae80-4a4a6af39877 tempest-VolumesSnapshotTestJSON-1862037507 None] Acquiring lock "cinder-quobyte-74c2f2e9-1673-42db-ace9-3c0cb7fa16ea-c4534fab-e9d0-444b-b93f-05d32a81df8d" by "_create_volume_from_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:24:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d9f6ff4b-0b5a-4cbe-9f32-0aa4aa9ab7ae tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f82e048e-1462-4ece-b0b1-5bd6704772fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-535feb6e-f1be-431a-b412-7b8d9330f49e', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d9f6ff4b-0b5a-4cbe-9f32-0aa4aa9ab7ae tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef1fb20a-1113-404a-b237-7fa3b6e60336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cc461416-4293-408e-ae80-4a4a6af39877 tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "cinder-quobyte-74c2f2e9-1673-42db-ace9-3c0cb7fa16ea-c4534fab-e9d0-444b-b93f-05d32a81df8d" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:24:24 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-cc461416-4293-408e-ae80-4a4a6af39877 tempest-VolumesSnapshotTestJSON-1862037507 None] Creating volume c4534fab-e9d0-444b-b93f-05d32a81df8d from snapshot 74c2f2e9-1673-42db-ace9-3c0cb7fa16ea {{(pid=87199) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 08:24:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cc461416-4293-408e-ae80-4a4a6af39877 tempest-VolumesSnapshotTestJSON-1862037507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cc461416-4293-408e-ae80-4a4a6af39877 tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:24 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-cc461416-4293-408e-ae80-4a4a6af39877 tempest-VolumesSnapshotTestJSON-1862037507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:24:24 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-cc461416-4293-408e-ae80-4a4a6af39877 tempest-VolumesSnapshotTestJSON-1862037507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:24:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cc461416-4293-408e-ae80-4a4a6af39877 tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:24 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-cc461416-4293-408e-ae80-4a4a6af39877 tempest-VolumesSnapshotTestJSON-1862037507 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:24:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cc461416-4293-408e-ae80-4a4a6af39877 tempest-VolumesSnapshotTestJSON-1862037507 None] Acquiring lock "cinder-quobyte-c4534fab-e9d0-444b-b93f-05d32a81df8d" by "_copy_volume_from_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:24:24 devstack sudo[97480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d5ca8500-98a9-4e68-ae8f-861f267196b4_ia5guc8rdevstack@QuobyteHD Jul 07 08:24:24 devstack sudo[97480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cc461416-4293-408e-ae80-4a4a6af39877 tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "cinder-quobyte-c4534fab-e9d0-444b-b93f-05d32a81df8d" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:24:24 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-cc461416-4293-408e-ae80-4a4a6af39877 tempest-VolumesSnapshotTestJSON-1862037507 None] snapshot: 74c2f2e9-1673-42db-ace9-3c0cb7fa16ea, volume: c4534fab-e9d0-444b-b93f-05d32a81df8d, {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 08:24:25 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-d9f6ff4b-0b5a-4cbe-9f32-0aa4aa9ab7ae tempest-VolumesActionsTest-1764575982 None] Volume volume-535feb6e-f1be-431a-b412-7b8d9330f49e (535feb6e-f1be-431a-b412-7b8d9330f49e): created successfully Jul 07 08:24:25 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d9f6ff4b-0b5a-4cbe-9f32-0aa4aa9ab7ae tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef1fb20a-1113-404a-b237-7fa3b6e60336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:25 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d9f6ff4b-0b5a-4cbe-9f32-0aa4aa9ab7ae tempest-VolumesActionsTest-1764575982 None] Flow 'volume_create_manager' (9be4e73f-b5c6-407f-bbf8-d7afaae70642) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:24:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cc461416-4293-408e-ae80-4a4a6af39877 tempest-VolumesSnapshotTestJSON-1862037507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cc461416-4293-408e-ae80-4a4a6af39877 tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:25 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-cc461416-4293-408e-ae80-4a4a6af39877 tempest-VolumesSnapshotTestJSON-1862037507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:24:25 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-cc461416-4293-408e-ae80-4a4a6af39877 tempest-VolumesSnapshotTestJSON-1862037507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:24:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cc461416-4293-408e-ae80-4a4a6af39877 tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:25 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-d9f6ff4b-0b5a-4cbe-9f32-0aa4aa9ab7ae tempest-VolumesActionsTest-1764575982 None] Created volume successfully. Jul 07 08:24:25 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[290fa72a-6e28-4af4-a69b-957e06545412]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:24:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cc461416-4293-408e-ae80-4a4a6af39877 tempest-VolumesSnapshotTestJSON-1862037507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c.74c2f2e9-1673-42db-ace9-3c0cb7fa16ea {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:25 devstack sudo[97484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c.74c2f2e9-1673-42db-ace9-3c0cb7fa16ea Jul 07 08:24:25 devstack sudo[97484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:25 devstack sudo[97480]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d5ca8500-98a9-4e68-ae8f-861f267196b4_ia5guc8rdevstack@QuobyteHD" returned: 0 in 0.896s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d5ca8500-98a9-4e68-ae8f-861f267196b4_ia5guc8rdevstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:25 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-049cd501-e5e3-4bd7-b95d-afeb88765db8 tempest-VolumesActionsTest-1911398733 None] Acquiring lock "cinder-535feb6e-f1be-431a-b412-7b8d9330f49e-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:24:25 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-049cd501-e5e3-4bd7-b95d-afeb88765db8 tempest-VolumesActionsTest-1911398733 None] Lock "cinder-535feb6e-f1be-431a-b412-7b8d9330f49e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:24:25 devstack sudo[97488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d5ca8500-98a9-4e68-ae8f-861f267196b4_ia5guc8rdevstack@QuobyteHD Jul 07 08:24:25 devstack sudo[97488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:25 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-049cd501-e5e3-4bd7-b95d-afeb88765db8 tempest-VolumesActionsTest-1911398733 None] Acquiring lock "cinder-quobyte-535feb6e-f1be-431a-b412-7b8d9330f49e" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:24:26 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-049cd501-e5e3-4bd7-b95d-afeb88765db8 tempest-VolumesActionsTest-1911398733 None] Lock "cinder-quobyte-535feb6e-f1be-431a-b412-7b8d9330f49e" acquired by "delete_volume" :: waited 0.034s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:24:26 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[5520665e-03e6-4689-8eb9-ff5f6f285b1a]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:24:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-049cd501-e5e3-4bd7-b95d-afeb88765db8 tempest-VolumesActionsTest-1911398733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-535feb6e-f1be-431a-b412-7b8d9330f49e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:26 devstack sudo[97484]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cc461416-4293-408e-ae80-4a4a6af39877 tempest-VolumesSnapshotTestJSON-1862037507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c.74c2f2e9-1673-42db-ace9-3c0cb7fa16ea" returned: 0 in 1.057s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:26 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-cc461416-4293-408e-ae80-4a4a6af39877 tempest-VolumesSnapshotTestJSON-1862037507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:24:26 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-cc461416-4293-408e-ae80-4a4a6af39877 tempest-VolumesSnapshotTestJSON-1862037507 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 08:24:26 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-cc461416-4293-408e-ae80-4a4a6af39877 tempest-VolumesSnapshotTestJSON-1862037507 None] Creating direct copy from snapshot {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 08:24:26 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d28fd58-cf31-42ef-b7b1-f9c8db3f300b]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:24:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cc461416-4293-408e-ae80-4a4a6af39877 tempest-VolumesSnapshotTestJSON-1862037507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:26 devstack sudo[97493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-535feb6e-f1be-431a-b412-7b8d9330f49e Jul 07 08:24:26 devstack sudo[97493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:26 devstack sudo[97494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c Jul 07 08:24:26 devstack sudo[97494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:26 devstack sudo[97488]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d5ca8500-98a9-4e68-ae8f-861f267196b4_ia5guc8rdevstack@QuobyteHD" returned: 1 in 0.991s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d5ca8500-98a9-4e68-ae8f-861f267196b4_ia5guc8rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:24:26 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] d5ca8500-98a9-4e68-ae8f-861f267196b4 was raw, converting to raw {{(pid=87199) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 08:24:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d5ca8500-98a9-4e68-ae8f-861f267196b4_ia5guc8rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0622f5a8-eda0-4e76-a654-c6a97a2ab7c3 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:26 devstack sudo[97500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d5ca8500-98a9-4e68-ae8f-861f267196b4_ia5guc8rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0622f5a8-eda0-4e76-a654-c6a97a2ab7c3 Jul 07 08:24:26 devstack sudo[97500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:27 devstack sudo[97493]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-049cd501-e5e3-4bd7-b95d-afeb88765db8 tempest-VolumesActionsTest-1911398733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-535feb6e-f1be-431a-b412-7b8d9330f49e" returned: 0 in 1.069s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-049cd501-e5e3-4bd7-b95d-afeb88765db8 tempest-VolumesActionsTest-1911398733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-535feb6e-f1be-431a-b412-7b8d9330f49e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:27 devstack sudo[97508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-535feb6e-f1be-431a-b412-7b8d9330f49e Jul 07 08:24:27 devstack sudo[97508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:27 devstack sudo[97494]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cc461416-4293-408e-ae80-4a4a6af39877 tempest-VolumesSnapshotTestJSON-1862037507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c" returned: 0 in 1.009s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:27 devstack cinder-volume[87199]: DEBUG cinder.utils [None req-cc461416-4293-408e-ae80-4a4a6af39877 tempest-VolumesSnapshotTestJSON-1862037507 None] Path /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c4534fab-e9d0-444b-b93f-05d32a81df8d not found in is_blk_device check {{(pid=87199) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 08:24:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cc461416-4293-408e-ae80-4a4a6af39877 tempest-VolumesSnapshotTestJSON-1862037507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c4534fab-e9d0-444b-b93f-05d32a81df8d {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:27 devstack sudo[97510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c4534fab-e9d0-444b-b93f-05d32a81df8d Jul 07 08:24:27 devstack sudo[97510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:27 devstack sudo[97500]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d5ca8500-98a9-4e68-ae8f-861f267196b4_ia5guc8rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0622f5a8-eda0-4e76-a654-c6a97a2ab7c3" returned: 0 in 0.977s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:27 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d5ca8500-98a9-4e68-ae8f-861f267196b4_ia5guc8rdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0622f5a8-eda0-4e76-a654-c6a97a2ab7c3 {{(pid=87199) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 08:24:27 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] Converted 0.00 MB image at 0.00 MB/s Jul 07 08:24:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0622f5a8-eda0-4e76-a654-c6a97a2ab7c3 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:27 devstack sudo[97515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0622f5a8-eda0-4e76-a654-c6a97a2ab7c3 1G Jul 07 08:24:27 devstack sudo[97515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:27 devstack sudo[97508]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-049cd501-e5e3-4bd7-b95d-afeb88765db8 tempest-VolumesActionsTest-1911398733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-535feb6e-f1be-431a-b412-7b8d9330f49e" returned: 0 in 0.843s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:27 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-049cd501-e5e3-4bd7-b95d-afeb88765db8 tempest-VolumesActionsTest-1911398733 None] Lock "cinder-quobyte-535feb6e-f1be-431a-b412-7b8d9330f49e" released by "delete_volume" :: held 1.970s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:24:28 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-049cd501-e5e3-4bd7-b95d-afeb88765db8 tempest-VolumesActionsTest-1911398733 None] Created reservations ['6cc3efaf-48bf-456d-8ca9-3f84edf8c463', 'e23f34ba-47a8-495c-8f27-839ec7983f09', 'aa0ac049-87b3-4002-9f06-15ccf6c98cbc', 'd3f7b36d-faac-4124-9a0a-f686b3bd40a2'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:24:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-049cd501-e5e3-4bd7-b95d-afeb88765db8 tempest-VolumesActionsTest-1911398733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-049cd501-e5e3-4bd7-b95d-afeb88765db8 tempest-VolumesActionsTest-1911398733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:28 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-049cd501-e5e3-4bd7-b95d-afeb88765db8 tempest-VolumesActionsTest-1911398733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:24:28 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-049cd501-e5e3-4bd7-b95d-afeb88765db8 tempest-VolumesActionsTest-1911398733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:24:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-049cd501-e5e3-4bd7-b95d-afeb88765db8 tempest-VolumesActionsTest-1911398733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-049cd501-e5e3-4bd7-b95d-afeb88765db8 tempest-VolumesActionsTest-1911398733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:28 devstack sudo[97522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:24:28 devstack sudo[97522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:29 devstack sudo[97515]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0622f5a8-eda0-4e76-a654-c6a97a2ab7c3 1G" returned: 0 in 1.841s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:29 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe6d238-4337-473f-90de-42d8a569fc1b]: (4, 'raw') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:24:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0622f5a8-eda0-4e76-a654-c6a97a2ab7c3 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:30 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-212a4202-5346-4ce4-bac7-e06434cc4550 tempest-VolumesActionsTest-1764575982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:24:30 devstack sudo[97569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0622f5a8-eda0-4e76-a654-c6a97a2ab7c3 Jul 07 08:24:30 devstack sudo[97569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-212a4202-5346-4ce4-bac7-e06434cc4550 tempest-VolumesActionsTest-1764575982 None] Flow 'volume_create_manager' (23daee6e-1098-4435-88d2-ebecbbffa7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:24:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-212a4202-5346-4ce4-bac7-e06434cc4550 tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b94ed51c-d020-4885-b932-6df9e651c444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-212a4202-5346-4ce4-bac7-e06434cc4550 tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b94ed51c-d020-4885-b932-6df9e651c444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:24:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-378467209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de2c6c04-886f-4eea-bb42-30e9c6e05252,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68368676a64749b3ba414b1751a5abaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:24:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:24:30Z,use_quota=True,user_id='6717bb48e52b40fc92e585e3937702d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-212a4202-5346-4ce4-bac7-e06434cc4550 tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd22d603-f8b9-4984-ad68-2d51ef66fd32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-212a4202-5346-4ce4-bac7-e06434cc4550 tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd22d603-f8b9-4984-ad68-2d51ef66fd32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-212a4202-5346-4ce4-bac7-e06434cc4550 tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36389208-159c-4a1a-b74c-865c09595da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-212a4202-5346-4ce4-bac7-e06434cc4550 tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36389208-159c-4a1a-b74c-865c09595da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de2c6c04-886f-4eea-bb42-30e9c6e05252', 'volume_name': 'volume-de2c6c04-886f-4eea-bb42-30e9c6e05252', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-212a4202-5346-4ce4-bac7-e06434cc4550 tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f109c072-69c6-4390-adfc-799a5720c447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-212a4202-5346-4ce4-bac7-e06434cc4550 tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f109c072-69c6-4390-adfc-799a5720c447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-212a4202-5346-4ce4-bac7-e06434cc4550 tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d204c25b-640a-4d49-8e6d-df3a4b1c3179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:30 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-212a4202-5346-4ce4-bac7-e06434cc4550 tempest-VolumesActionsTest-1764575982 None] Volume de2c6c04-886f-4eea-bb42-30e9c6e05252: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de2c6c04-886f-4eea-bb42-30e9c6e05252', 'volume_size': 1} Jul 07 08:24:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-212a4202-5346-4ce4-bac7-e06434cc4550 tempest-VolumesActionsTest-1764575982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:30 devstack sudo[97522]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-049cd501-e5e3-4bd7-b95d-afeb88765db8 tempest-VolumesActionsTest-1911398733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 2.137s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:30 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-049cd501-e5e3-4bd7-b95d-afeb88765db8 tempest-VolumesActionsTest-1911398733 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:24:30 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-049cd501-e5e3-4bd7-b95d-afeb88765db8 tempest-VolumesActionsTest-1911398733 None] Deleted volume successfully. Jul 07 08:24:30 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-049cd501-e5e3-4bd7-b95d-afeb88765db8 tempest-VolumesActionsTest-1911398733 None] Lock "cinder-535feb6e-f1be-431a-b412-7b8d9330f49e-delete_volume" released by "delete_volume" :: held 4.511s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:24:31 devstack sudo[97569]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0622f5a8-eda0-4e76-a654-c6a97a2ab7c3" returned: 0 in 1.273s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0622f5a8-eda0-4e76-a654-c6a97a2ab7c3 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:31 devstack sudo[97577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0622f5a8-eda0-4e76-a654-c6a97a2ab7c3 Jul 07 08:24:31 devstack sudo[97577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:32 devstack sudo[97577]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0622f5a8-eda0-4e76-a654-c6a97a2ab7c3" returned: 1 in 1.407s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0622f5a8-eda0-4e76-a654-c6a97a2ab7c3' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:24:32 devstack cinder-volume[87199]: DEBUG cinder.volume.volume_utils [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] Downloaded image d5ca8500-98a9-4e68-ae8f-861f267196b4 ((None, [{'url': 'file:///opt/stack/data/glance/images/d5ca8500-98a9-4e68-ae8f-861f267196b4', 'metadata': {}}])) to volume 0622f5a8-eda0-4e76-a654-c6a97a2ab7c3 successfully. {{(pid=87199) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 08:24:32 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] Temporary image d5ca8500-98a9-4e68-ae8f-861f267196b4 for user a788313974884864a60cb402dc7a683d is deleted. {{(pid=87199) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 08:24:32 devstack cinder-volume[87199]: DEBUG cinder.volume.volume_utils [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] Marking volume 0622f5a8-eda0-4e76-a654-c6a97a2ab7c3 as bootable. {{(pid=87199) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 08:24:32 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] Copying metadata from image d5ca8500-98a9-4e68-ae8f-861f267196b4 to 0622f5a8-eda0-4e76-a654-c6a97a2ab7c3. {{(pid=87199) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 08:24:32 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] Creating volume glance metadata for volume 0622f5a8-eda0-4e76-a654-c6a97a2ab7c3 backed by image d5ca8500-98a9-4e68-ae8f-861f267196b4 with: {'image_id': 'd5ca8500-98a9-4e68-ae8f-861f267196b4', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'e985da561614e6c8862bdcef72a6eb67', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87199) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 08:24:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (040debbe-32eb-4ac9-aa54-4a827cac1c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0622f5a8-eda0-4e76-a654-c6a97a2ab7c3', 'volume_size': 1, 'image_id': 'd5ca8500-98a9-4e68-ae8f-861f267196b4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d5ca8500-98a9-4e68-ae8f-861f267196b4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e985da561614e6c8862bdcef72a6eb67', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c58b82d5a8c5404d960bf8e047629397', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '38a3c0cc4d91abb17a2be095ebe34147400183107c497e874675c39db5440fb5c1e26f745a4b5e42621e0bb44f6136098256e9065ccdb060a493589d7f8e4128', 'id': 'd5ca8500-98a9-4e68-ae8f-861f267196b4', 'created_at': datetime.datetime(2026, 7, 7, 6, 24, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 6, 24, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d5ca8500-98a9-4e68-ae8f-861f267196b4/file', 'properties': {}}, 'image_service': }' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aab8f5f-2532-4df8-9fd6-d8b2c83cb02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:32 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] Volume volume-0622f5a8-eda0-4e76-a654-c6a97a2ab7c3 (0622f5a8-eda0-4e76-a654-c6a97a2ab7c3): created successfully Jul 07 08:24:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aab8f5f-2532-4df8-9fd6-d8b2c83cb02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] Flow 'volume_create_manager' (80884775-d8ad-4d28-b935-7d497ff242cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:24:32 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-08860247-401a-42af-9832-27bae777c497 tempest-VolumeImageDependencyTests-1697235978 None] Created volume successfully. Jul 07 08:24:33 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8bf46ce7-0058-4bf2-bcce-735f29061d2e tempest-VolumeImageDependencyTests-1697235978 None] Acquiring lock "cinder-0622f5a8-eda0-4e76-a654-c6a97a2ab7c3-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:24:33 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8bf46ce7-0058-4bf2-bcce-735f29061d2e tempest-VolumeImageDependencyTests-1697235978 None] Lock "cinder-0622f5a8-eda0-4e76-a654-c6a97a2ab7c3-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:24:33 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8bf46ce7-0058-4bf2-bcce-735f29061d2e tempest-VolumeImageDependencyTests-1697235978 None] Acquiring lock "cinder-quobyte-0622f5a8-eda0-4e76-a654-c6a97a2ab7c3" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:24:33 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8bf46ce7-0058-4bf2-bcce-735f29061d2e tempest-VolumeImageDependencyTests-1697235978 None] Lock "cinder-quobyte-0622f5a8-eda0-4e76-a654-c6a97a2ab7c3" acquired by "delete_volume" :: waited 0.016s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:24:33 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba6122a-a1f7-48f8-b8cd-0d4e23b5b1e5]: (4, 'raw') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:24:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8bf46ce7-0058-4bf2-bcce-735f29061d2e tempest-VolumeImageDependencyTests-1697235978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0622f5a8-eda0-4e76-a654-c6a97a2ab7c3 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:33 devstack sudo[97510]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cc461416-4293-408e-ae80-4a4a6af39877 tempest-VolumesSnapshotTestJSON-1862037507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c4534fab-e9d0-444b-b93f-05d32a81df8d" returned: 0 in 6.748s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:33 devstack sudo[97582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0622f5a8-eda0-4e76-a654-c6a97a2ab7c3 Jul 07 08:24:33 devstack sudo[97582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:34 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[2111d402-5e19-4db3-9a3f-11bd4c37d55f]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:24:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cc461416-4293-408e-ae80-4a4a6af39877 tempest-VolumesSnapshotTestJSON-1862037507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:34 devstack sudo[97584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c Jul 07 08:24:34 devstack sudo[97584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:34 devstack sudo[97582]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8bf46ce7-0058-4bf2-bcce-735f29061d2e tempest-VolumeImageDependencyTests-1697235978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0622f5a8-eda0-4e76-a654-c6a97a2ab7c3" returned: 0 in 0.926s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8bf46ce7-0058-4bf2-bcce-735f29061d2e tempest-VolumeImageDependencyTests-1697235978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0622f5a8-eda0-4e76-a654-c6a97a2ab7c3 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:34 devstack sudo[97590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0622f5a8-eda0-4e76-a654-c6a97a2ab7c3 Jul 07 08:24:34 devstack sudo[97590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:35 devstack sudo[97584]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cc461416-4293-408e-ae80-4a4a6af39877 tempest-VolumesSnapshotTestJSON-1862037507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c" returned: 0 in 1.096s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:35 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-cc461416-4293-408e-ae80-4a4a6af39877 tempest-VolumesSnapshotTestJSON-1862037507 None] Image conversion details: src /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c, size 1024.00 MB, duration 6.75 sec, destination /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c4534fab-e9d0-444b-b93f-05d32a81df8d {{(pid=87199) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 08:24:35 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-cc461416-4293-408e-ae80-4a4a6af39877 tempest-VolumesSnapshotTestJSON-1862037507 None] Converted 1024.00 MB image at 151.73 MB/s Jul 07 08:24:35 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-cc461416-4293-408e-ae80-4a4a6af39877 tempest-VolumesSnapshotTestJSON-1862037507 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c4534fab-e9d0-444b-b93f-05d32a81df8d is being set with open permissions: ugo+rw Jul 07 08:24:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cc461416-4293-408e-ae80-4a4a6af39877 tempest-VolumesSnapshotTestJSON-1862037507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c4534fab-e9d0-444b-b93f-05d32a81df8d {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:35 devstack sudo[97593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c4534fab-e9d0-444b-b93f-05d32a81df8d Jul 07 08:24:35 devstack sudo[97593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:35 devstack sudo[97590]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8bf46ce7-0058-4bf2-bcce-735f29061d2e tempest-VolumeImageDependencyTests-1697235978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0622f5a8-eda0-4e76-a654-c6a97a2ab7c3" returned: 1 in 0.920s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8bf46ce7-0058-4bf2-bcce-735f29061d2e tempest-VolumeImageDependencyTests-1697235978 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0622f5a8-eda0-4e76-a654-c6a97a2ab7c3' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:24:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8bf46ce7-0058-4bf2-bcce-735f29061d2e tempest-VolumeImageDependencyTests-1697235978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0622f5a8-eda0-4e76-a654-c6a97a2ab7c3 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:35 devstack sudo[97598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0622f5a8-eda0-4e76-a654-c6a97a2ab7c3 Jul 07 08:24:35 devstack sudo[97598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:35 devstack sudo[97593]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cc461416-4293-408e-ae80-4a4a6af39877 tempest-VolumesSnapshotTestJSON-1862037507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c4534fab-e9d0-444b-b93f-05d32a81df8d" returned: 0 in 0.859s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:35 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cc461416-4293-408e-ae80-4a4a6af39877 tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "cinder-quobyte-c4534fab-e9d0-444b-b93f-05d32a81df8d" released by "_copy_volume_from_snapshot" :: held 10.991s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:24:36 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cc461416-4293-408e-ae80-4a4a6af39877 tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "cinder-quobyte-74c2f2e9-1673-42db-ace9-3c0cb7fa16ea-c4534fab-e9d0-444b-b93f-05d32a81df8d" released by "_create_volume_from_snapshot" :: held 11.050s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:24:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cc461416-4293-408e-ae80-4a4a6af39877 tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.084s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-212a4202-5346-4ce4-bac7-e06434cc4550 tempest-VolumesActionsTest-1764575982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.769s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-212a4202-5346-4ce4-bac7-e06434cc4550 tempest-VolumesActionsTest-1764575982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:24:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-378467209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de2c6c04-886f-4eea-bb42-30e9c6e05252,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68368676a64749b3ba414b1751a5abaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:24:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:24:30Z,use_quota=True,user_id='6717bb48e52b40fc92e585e3937702d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:24:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-212a4202-5346-4ce4-bac7-e06434cc4550 tempest-VolumesActionsTest-1764575982 None] Creating volume de2c6c04-886f-4eea-bb42-30e9c6e05252 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:24:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-212a4202-5346-4ce4-bac7-e06434cc4550 tempest-VolumesActionsTest-1764575982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-212a4202-5346-4ce4-bac7-e06434cc4550 tempest-VolumesActionsTest-1764575982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-212a4202-5346-4ce4-bac7-e06434cc4550 tempest-VolumesActionsTest-1764575982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:24:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-212a4202-5346-4ce4-bac7-e06434cc4550 tempest-VolumesActionsTest-1764575982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:24:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-212a4202-5346-4ce4-bac7-e06434cc4550 tempest-VolumesActionsTest-1764575982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-212a4202-5346-4ce4-bac7-e06434cc4550 tempest-VolumesActionsTest-1764575982 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:24:36 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-212a4202-5346-4ce4-bac7-e06434cc4550 tempest-VolumesActionsTest-1764575982 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:24:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-212a4202-5346-4ce4-bac7-e06434cc4550 tempest-VolumesActionsTest-1764575982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-de2c6c04-886f-4eea-bb42-30e9c6e05252 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:36 devstack sudo[97601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-de2c6c04-886f-4eea-bb42-30e9c6e05252 1073741824 Jul 07 08:24:36 devstack sudo[97601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cc461416-4293-408e-ae80-4a4a6af39877 tempest-VolumesSnapshotTestJSON-1862037507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (528abbff-a2dd-4479-9627-26e39daa7dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4534fab-e9d0-444b-b93f-05d32a81df8d', 'volume_size': 2, 'snapshot_id': '74c2f2e9-1673-42db-ace9-3c0cb7fa16ea'}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cc461416-4293-408e-ae80-4a4a6af39877 tempest-VolumesSnapshotTestJSON-1862037507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0af55544-243a-4946-ad96-d02518583c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:36 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-cc461416-4293-408e-ae80-4a4a6af39877 tempest-VolumesSnapshotTestJSON-1862037507 None] Volume volume-c4534fab-e9d0-444b-b93f-05d32a81df8d (c4534fab-e9d0-444b-b93f-05d32a81df8d): created successfully Jul 07 08:24:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cc461416-4293-408e-ae80-4a4a6af39877 tempest-VolumesSnapshotTestJSON-1862037507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0af55544-243a-4946-ad96-d02518583c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cc461416-4293-408e-ae80-4a4a6af39877 tempest-VolumesSnapshotTestJSON-1862037507 None] Flow 'volume_create_manager' (bbdd3bd8-d389-4b97-82c3-ccc6a876d898) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:24:36 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-cc461416-4293-408e-ae80-4a4a6af39877 tempest-VolumesSnapshotTestJSON-1862037507 None] Created volume successfully. Jul 07 08:24:36 devstack sudo[97598]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8bf46ce7-0058-4bf2-bcce-735f29061d2e tempest-VolumeImageDependencyTests-1697235978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0622f5a8-eda0-4e76-a654-c6a97a2ab7c3" returned: 0 in 1.091s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:36 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8bf46ce7-0058-4bf2-bcce-735f29061d2e tempest-VolumeImageDependencyTests-1697235978 None] Lock "cinder-quobyte-0622f5a8-eda0-4e76-a654-c6a97a2ab7c3" released by "delete_volume" :: held 3.023s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:24:36 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-8bf46ce7-0058-4bf2-bcce-735f29061d2e tempest-VolumeImageDependencyTests-1697235978 None] Created reservations ['56d3db9b-6138-49df-9cc0-07b9e387cb69', '10cacb87-cc34-47e3-a9b3-2d30486d2ef5', '83944fed-fdbe-41fd-a27e-4a38f18900ae', '7ef0cd25-c80a-445b-8368-ee38ab560db3'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:24:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8bf46ce7-0058-4bf2-bcce-735f29061d2e tempest-VolumeImageDependencyTests-1697235978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8bf46ce7-0058-4bf2-bcce-735f29061d2e tempest-VolumeImageDependencyTests-1697235978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:37 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8bf46ce7-0058-4bf2-bcce-735f29061d2e tempest-VolumeImageDependencyTests-1697235978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:24:37 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8bf46ce7-0058-4bf2-bcce-735f29061d2e tempest-VolumeImageDependencyTests-1697235978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:24:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8bf46ce7-0058-4bf2-bcce-735f29061d2e tempest-VolumeImageDependencyTests-1697235978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8bf46ce7-0058-4bf2-bcce-735f29061d2e tempest-VolumeImageDependencyTests-1697235978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:37 devstack sudo[97608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:24:37 devstack sudo[97608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:37 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-06d06a15-40ef-4264-a8da-50fed813a429 tempest-VolumesSnapshotTestJSON-1862037507 None] Acquiring lock "cinder-c4534fab-e9d0-444b-b93f-05d32a81df8d-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:24:37 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-06d06a15-40ef-4264-a8da-50fed813a429 tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "cinder-c4534fab-e9d0-444b-b93f-05d32a81df8d-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:24:37 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-06d06a15-40ef-4264-a8da-50fed813a429 tempest-VolumesSnapshotTestJSON-1862037507 None] Acquiring lock "cinder-quobyte-c4534fab-e9d0-444b-b93f-05d32a81df8d" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:24:37 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-06d06a15-40ef-4264-a8da-50fed813a429 tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "cinder-quobyte-c4534fab-e9d0-444b-b93f-05d32a81df8d" acquired by "delete_volume" :: waited 0.046s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:24:37 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71f888c-7577-4191-b14a-334921da18d5]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:24:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-06d06a15-40ef-4264-a8da-50fed813a429 tempest-VolumesSnapshotTestJSON-1862037507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c4534fab-e9d0-444b-b93f-05d32a81df8d {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:37 devstack sudo[97601]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-212a4202-5346-4ce4-bac7-e06434cc4550 tempest-VolumesActionsTest-1764575982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-de2c6c04-886f-4eea-bb42-30e9c6e05252 1073741824" returned: 0 in 1.554s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-212a4202-5346-4ce4-bac7-e06434cc4550 tempest-VolumesActionsTest-1764575982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-de2c6c04-886f-4eea-bb42-30e9c6e05252 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:37 devstack sudo[97610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c4534fab-e9d0-444b-b93f-05d32a81df8d Jul 07 08:24:37 devstack sudo[97610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:37 devstack sudo[97612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-de2c6c04-886f-4eea-bb42-30e9c6e05252 Jul 07 08:24:37 devstack sudo[97612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:38 devstack sudo[97610]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-06d06a15-40ef-4264-a8da-50fed813a429 tempest-VolumesSnapshotTestJSON-1862037507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c4534fab-e9d0-444b-b93f-05d32a81df8d" returned: 0 in 1.289s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-06d06a15-40ef-4264-a8da-50fed813a429 tempest-VolumesSnapshotTestJSON-1862037507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c4534fab-e9d0-444b-b93f-05d32a81df8d {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:38 devstack sudo[97619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c4534fab-e9d0-444b-b93f-05d32a81df8d Jul 07 08:24:38 devstack sudo[97619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:38 devstack sudo[97608]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8bf46ce7-0058-4bf2-bcce-735f29061d2e tempest-VolumeImageDependencyTests-1697235978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 1.777s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:38 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-8bf46ce7-0058-4bf2-bcce-735f29061d2e tempest-VolumeImageDependencyTests-1697235978 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:24:38 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-8bf46ce7-0058-4bf2-bcce-735f29061d2e tempest-VolumeImageDependencyTests-1697235978 None] Deleted volume successfully. Jul 07 08:24:38 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8bf46ce7-0058-4bf2-bcce-735f29061d2e tempest-VolumeImageDependencyTests-1697235978 None] Lock "cinder-0622f5a8-eda0-4e76-a654-c6a97a2ab7c3-delete_volume" released by "delete_volume" :: held 5.297s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:24:39 devstack sudo[97612]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-212a4202-5346-4ce4-bac7-e06434cc4550 tempest-VolumesActionsTest-1764575982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-de2c6c04-886f-4eea-bb42-30e9c6e05252" returned: 0 in 1.328s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:39 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-212a4202-5346-4ce4-bac7-e06434cc4550 tempest-VolumesActionsTest-1764575982 None] <== create_volume: return (3010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:24:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-212a4202-5346-4ce4-bac7-e06434cc4550 tempest-VolumesActionsTest-1764575982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.015s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-212a4202-5346-4ce4-bac7-e06434cc4550 tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d204c25b-640a-4d49-8e6d-df3a4b1c3179) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de2c6c04-886f-4eea-bb42-30e9c6e05252', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-212a4202-5346-4ce4-bac7-e06434cc4550 tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c309bfd-d149-42fa-9637-b79e96199d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:39 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-212a4202-5346-4ce4-bac7-e06434cc4550 tempest-VolumesActionsTest-1764575982 None] Volume volume-de2c6c04-886f-4eea-bb42-30e9c6e05252 (de2c6c04-886f-4eea-bb42-30e9c6e05252): created successfully Jul 07 08:24:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-212a4202-5346-4ce4-bac7-e06434cc4550 tempest-VolumesActionsTest-1764575982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c309bfd-d149-42fa-9637-b79e96199d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-212a4202-5346-4ce4-bac7-e06434cc4550 tempest-VolumesActionsTest-1764575982 None] Flow 'volume_create_manager' (23daee6e-1098-4435-88d2-ebecbbffa7dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:24:39 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-212a4202-5346-4ce4-bac7-e06434cc4550 tempest-VolumesActionsTest-1764575982 None] Created volume successfully. Jul 07 08:24:39 devstack sudo[97619]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-06d06a15-40ef-4264-a8da-50fed813a429 tempest-VolumesSnapshotTestJSON-1862037507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c4534fab-e9d0-444b-b93f-05d32a81df8d" returned: 0 in 0.938s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:39 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-06d06a15-40ef-4264-a8da-50fed813a429 tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "cinder-quobyte-c4534fab-e9d0-444b-b93f-05d32a81df8d" released by "delete_volume" :: held 2.317s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:24:39 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-06d06a15-40ef-4264-a8da-50fed813a429 tempest-VolumesSnapshotTestJSON-1862037507 None] Created reservations ['93d19717-caaf-47cb-aa4d-36f48dc9f155', 'daadec82-276a-477b-95b1-312400227b48', 'dae48886-0e18-4749-ad12-d1ef60341ee3', '805843d8-e32e-4e06-ad65-6386c4da97fc'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:24:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-06d06a15-40ef-4264-a8da-50fed813a429 tempest-VolumesSnapshotTestJSON-1862037507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-06d06a15-40ef-4264-a8da-50fed813a429 tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:39 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-06d06a15-40ef-4264-a8da-50fed813a429 tempest-VolumesSnapshotTestJSON-1862037507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:24:40 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-06d06a15-40ef-4264-a8da-50fed813a429 tempest-VolumesSnapshotTestJSON-1862037507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:24:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-06d06a15-40ef-4264-a8da-50fed813a429 tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-06d06a15-40ef-4264-a8da-50fed813a429 tempest-VolumesSnapshotTestJSON-1862037507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:40 devstack sudo[97622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:24:40 devstack sudo[97622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-384eeaff-0b27-435f-a0a9-0db87ac8331b tempest-VolumesActionsTest-1764575982 None] Acquiring lock "cinder-de2c6c04-886f-4eea-bb42-30e9c6e05252-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:24:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-384eeaff-0b27-435f-a0a9-0db87ac8331b tempest-VolumesActionsTest-1764575982 None] Lock "cinder-de2c6c04-886f-4eea-bb42-30e9c6e05252-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:24:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-384eeaff-0b27-435f-a0a9-0db87ac8331b tempest-VolumesActionsTest-1764575982 None] Acquiring lock "cinder-quobyte-de2c6c04-886f-4eea-bb42-30e9c6e05252" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:24:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-384eeaff-0b27-435f-a0a9-0db87ac8331b tempest-VolumesActionsTest-1764575982 None] Lock "cinder-quobyte-de2c6c04-886f-4eea-bb42-30e9c6e05252" acquired by "delete_volume" :: waited 0.032s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:24:40 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5bcfa9-31e9-4690-9083-69e8364ca237]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:24:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-384eeaff-0b27-435f-a0a9-0db87ac8331b tempest-VolumesActionsTest-1764575982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-de2c6c04-886f-4eea-bb42-30e9c6e05252 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-73858d5a-9325-4a3e-abd6-4bf9292725e2 tempest-VolumesSnapshotTestJSON-1862037507 None] Acquiring lock "cinder-74c2f2e9-1673-42db-ace9-3c0cb7fa16ea-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:24:40 devstack sudo[97624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-de2c6c04-886f-4eea-bb42-30e9c6e05252 Jul 07 08:24:40 devstack sudo[97624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:41 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-73858d5a-9325-4a3e-abd6-4bf9292725e2 tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "cinder-74c2f2e9-1673-42db-ace9-3c0cb7fa16ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:24:41 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-73858d5a-9325-4a3e-abd6-4bf9292725e2 tempest-VolumesSnapshotTestJSON-1862037507 None] Acquiring lock "cinder-quobyte-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:24:41 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-73858d5a-9325-4a3e-abd6-4bf9292725e2 tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "cinder-quobyte-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:24:41 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-73858d5a-9325-4a3e-abd6-4bf9292725e2 tempest-VolumesSnapshotTestJSON-1862037507 None] Acquiring lock "cinder-quobyte-74c2f2e9-1673-42db-ace9-3c0cb7fa16ea" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:24:41 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-73858d5a-9325-4a3e-abd6-4bf9292725e2 tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "cinder-quobyte-74c2f2e9-1673-42db-ace9-3c0cb7fa16ea" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:24:41 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-73858d5a-9325-4a3e-abd6-4bf9292725e2 tempest-VolumesSnapshotTestJSON-1862037507 None] Deleting offline snapshot 74c2f2e9-1673-42db-ace9-3c0cb7fa16ea of volume 6e12e713-7b86-4b5a-8d1f-8a67dd3a901c {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:24:41 devstack sudo[97622]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:41 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-73858d5a-9325-4a3e-abd6-4bf9292725e2 tempest-VolumesSnapshotTestJSON-1862037507 None] snapshot_file for this snap is: volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c.74c2f2e9-1673-42db-ace9-3c0cb7fa16ea {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:24:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-06d06a15-40ef-4264-a8da-50fed813a429 tempest-VolumesSnapshotTestJSON-1862037507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 1.108s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:41 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-06d06a15-40ef-4264-a8da-50fed813a429 tempest-VolumesSnapshotTestJSON-1862037507 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:24:41 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-06d06a15-40ef-4264-a8da-50fed813a429 tempest-VolumesSnapshotTestJSON-1862037507 None] Deleted volume successfully. Jul 07 08:24:41 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b914704-faea-411c-8f5e-b3138d66221f]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:24:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-73858d5a-9325-4a3e-abd6-4bf9292725e2 tempest-VolumesSnapshotTestJSON-1862037507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c.74c2f2e9-1673-42db-ace9-3c0cb7fa16ea {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:41 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-06d06a15-40ef-4264-a8da-50fed813a429 tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "cinder-c4534fab-e9d0-444b-b93f-05d32a81df8d-delete_volume" released by "delete_volume" :: held 3.856s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:24:41 devstack sudo[97628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c.74c2f2e9-1673-42db-ace9-3c0cb7fa16ea Jul 07 08:24:41 devstack sudo[97628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:41 devstack sudo[97624]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-384eeaff-0b27-435f-a0a9-0db87ac8331b tempest-VolumesActionsTest-1764575982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-de2c6c04-886f-4eea-bb42-30e9c6e05252" returned: 0 in 1.094s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-384eeaff-0b27-435f-a0a9-0db87ac8331b tempest-VolumesActionsTest-1764575982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-de2c6c04-886f-4eea-bb42-30e9c6e05252 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:41 devstack sudo[97633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-de2c6c04-886f-4eea-bb42-30e9c6e05252 Jul 07 08:24:41 devstack sudo[97633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:42 devstack sudo[97628]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-73858d5a-9325-4a3e-abd6-4bf9292725e2 tempest-VolumesSnapshotTestJSON-1862037507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c.74c2f2e9-1673-42db-ace9-3c0cb7fa16ea" returned: 0 in 1.031s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-73858d5a-9325-4a3e-abd6-4bf9292725e2 tempest-VolumesSnapshotTestJSON-1862037507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:24:42 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[840de6e6-6631-471e-a745-9827b006b268]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:24:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-73858d5a-9325-4a3e-abd6-4bf9292725e2 tempest-VolumesSnapshotTestJSON-1862037507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:42 devstack sudo[97638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c Jul 07 08:24:42 devstack sudo[97638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:42 devstack sudo[97633]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-384eeaff-0b27-435f-a0a9-0db87ac8331b tempest-VolumesActionsTest-1764575982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-de2c6c04-886f-4eea-bb42-30e9c6e05252" returned: 0 in 0.769s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:42 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-384eeaff-0b27-435f-a0a9-0db87ac8331b tempest-VolumesActionsTest-1764575982 None] Lock "cinder-quobyte-de2c6c04-886f-4eea-bb42-30e9c6e05252" released by "delete_volume" :: held 1.936s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:24:42 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-384eeaff-0b27-435f-a0a9-0db87ac8331b tempest-VolumesActionsTest-1764575982 None] Created reservations ['3feb02ca-492a-4123-ae71-6f7a4bf7bd8e', 'db8fd3e9-f8dd-40bb-b4e6-2627b915def8', 'f8e9dffe-8b07-4250-b24f-ef29316e3598', '6c723675-abe9-471e-8a5a-20fccc746fe1'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:24:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-384eeaff-0b27-435f-a0a9-0db87ac8331b tempest-VolumesActionsTest-1764575982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-384eeaff-0b27-435f-a0a9-0db87ac8331b tempest-VolumesActionsTest-1764575982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-384eeaff-0b27-435f-a0a9-0db87ac8331b tempest-VolumesActionsTest-1764575982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:24:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-384eeaff-0b27-435f-a0a9-0db87ac8331b tempest-VolumesActionsTest-1764575982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:24:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-384eeaff-0b27-435f-a0a9-0db87ac8331b tempest-VolumesActionsTest-1764575982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-384eeaff-0b27-435f-a0a9-0db87ac8331b tempest-VolumesActionsTest-1764575982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:42 devstack sudo[97641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:24:42 devstack sudo[97641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:43 devstack sudo[97638]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-73858d5a-9325-4a3e-abd6-4bf9292725e2 tempest-VolumesSnapshotTestJSON-1862037507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c" returned: 0 in 1.077s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-73858d5a-9325-4a3e-abd6-4bf9292725e2 tempest-VolumesSnapshotTestJSON-1862037507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c.74c2f2e9-1673-42db-ace9-3c0cb7fa16ea {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:43 devstack sudo[97646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c.74c2f2e9-1673-42db-ace9-3c0cb7fa16ea Jul 07 08:24:43 devstack sudo[97646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:43 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-29fbbd67-d16a-45d5-a06b-b86f95b06d5a tempest-CinderUnicodeTest-1443437654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:24:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-29fbbd67-d16a-45d5-a06b-b86f95b06d5a tempest-CinderUnicodeTest-1443437654 None] Flow 'volume_create_manager' (2b6467ce-5914-481f-baf4-db8a51952c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:24:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-29fbbd67-d16a-45d5-a06b-b86f95b06d5a tempest-CinderUnicodeTest-1443437654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c94caa0d-ea93-40c9-be65-0ec0fe4670d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-29fbbd67-d16a-45d5-a06b-b86f95b06d5a tempest-CinderUnicodeTest-1443437654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c94caa0d-ea93-40c9-be65-0ec0fe4670d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1273fd8f-ae06-407f-b650-c96b46285400,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4235ec624f94c1ca7b10f96a94a59fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:24:43Z,use_quota=True,user_id='9475388525814378b1dd19cbc41bf29f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-29fbbd67-d16a-45d5-a06b-b86f95b06d5a tempest-CinderUnicodeTest-1443437654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ba6ea0e-783f-4fcb-94e8-33ebf7b31cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-29fbbd67-d16a-45d5-a06b-b86f95b06d5a tempest-CinderUnicodeTest-1443437654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ba6ea0e-783f-4fcb-94e8-33ebf7b31cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-29fbbd67-d16a-45d5-a06b-b86f95b06d5a tempest-CinderUnicodeTest-1443437654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b8e2d7f-e50b-4689-a9e2-24c92adba412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-29fbbd67-d16a-45d5-a06b-b86f95b06d5a tempest-CinderUnicodeTest-1443437654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b8e2d7f-e50b-4689-a9e2-24c92adba412) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1273fd8f-ae06-407f-b650-c96b46285400', 'volume_name': 'volume-1273fd8f-ae06-407f-b650-c96b46285400', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-29fbbd67-d16a-45d5-a06b-b86f95b06d5a tempest-CinderUnicodeTest-1443437654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0796cfbe-5ed4-4b9d-84ed-0b3f9924ac52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-29fbbd67-d16a-45d5-a06b-b86f95b06d5a tempest-CinderUnicodeTest-1443437654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0796cfbe-5ed4-4b9d-84ed-0b3f9924ac52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-29fbbd67-d16a-45d5-a06b-b86f95b06d5a tempest-CinderUnicodeTest-1443437654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27669b71-2bf6-4dd3-abb0-b003a53851ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:43 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-29fbbd67-d16a-45d5-a06b-b86f95b06d5a tempest-CinderUnicodeTest-1443437654 None] Volume 1273fd8f-ae06-407f-b650-c96b46285400: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1273fd8f-ae06-407f-b650-c96b46285400', 'volume_size': 1} Jul 07 08:24:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-29fbbd67-d16a-45d5-a06b-b86f95b06d5a tempest-CinderUnicodeTest-1443437654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-29fbbd67-d16a-45d5-a06b-b86f95b06d5a tempest-CinderUnicodeTest-1443437654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:43 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-29fbbd67-d16a-45d5-a06b-b86f95b06d5a tempest-CinderUnicodeTest-1443437654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1273fd8f-ae06-407f-b650-c96b46285400,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4235ec624f94c1ca7b10f96a94a59fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:24:43Z,use_quota=True,user_id='9475388525814378b1dd19cbc41bf29f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:24:43 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-29fbbd67-d16a-45d5-a06b-b86f95b06d5a tempest-CinderUnicodeTest-1443437654 None] Creating volume 1273fd8f-ae06-407f-b650-c96b46285400 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:24:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-29fbbd67-d16a-45d5-a06b-b86f95b06d5a tempest-CinderUnicodeTest-1443437654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-29fbbd67-d16a-45d5-a06b-b86f95b06d5a tempest-CinderUnicodeTest-1443437654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:43 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-29fbbd67-d16a-45d5-a06b-b86f95b06d5a tempest-CinderUnicodeTest-1443437654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:24:43 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-29fbbd67-d16a-45d5-a06b-b86f95b06d5a tempest-CinderUnicodeTest-1443437654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:24:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-29fbbd67-d16a-45d5-a06b-b86f95b06d5a tempest-CinderUnicodeTest-1443437654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:43 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-29fbbd67-d16a-45d5-a06b-b86f95b06d5a tempest-CinderUnicodeTest-1443437654 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:24:43 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-29fbbd67-d16a-45d5-a06b-b86f95b06d5a tempest-CinderUnicodeTest-1443437654 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:24:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-29fbbd67-d16a-45d5-a06b-b86f95b06d5a tempest-CinderUnicodeTest-1443437654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1273fd8f-ae06-407f-b650-c96b46285400 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:43 devstack sudo[97648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1273fd8f-ae06-407f-b650-c96b46285400 1073741824 Jul 07 08:24:43 devstack sudo[97648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:43 devstack sudo[97641]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-384eeaff-0b27-435f-a0a9-0db87ac8331b tempest-VolumesActionsTest-1764575982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 1.099s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:43 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-384eeaff-0b27-435f-a0a9-0db87ac8331b tempest-VolumesActionsTest-1764575982 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:24:43 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-384eeaff-0b27-435f-a0a9-0db87ac8331b tempest-VolumesActionsTest-1764575982 None] Deleted volume successfully. Jul 07 08:24:44 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-384eeaff-0b27-435f-a0a9-0db87ac8331b tempest-VolumesActionsTest-1764575982 None] Lock "cinder-de2c6c04-886f-4eea-bb42-30e9c6e05252-delete_volume" released by "delete_volume" :: held 3.475s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:24:44 devstack sudo[97646]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-73858d5a-9325-4a3e-abd6-4bf9292725e2 tempest-VolumesSnapshotTestJSON-1862037507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c.74c2f2e9-1673-42db-ace9-3c0cb7fa16ea" returned: 0 in 1.067s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-73858d5a-9325-4a3e-abd6-4bf9292725e2 tempest-VolumesSnapshotTestJSON-1862037507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c.74c2f2e9-1673-42db-ace9-3c0cb7fa16ea {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:44 devstack sudo[97657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c.74c2f2e9-1673-42db-ace9-3c0cb7fa16ea Jul 07 08:24:44 devstack sudo[97657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:44 devstack sudo[97648]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-29fbbd67-d16a-45d5-a06b-b86f95b06d5a tempest-CinderUnicodeTest-1443437654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1273fd8f-ae06-407f-b650-c96b46285400 1073741824" returned: 0 in 1.179s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-29fbbd67-d16a-45d5-a06b-b86f95b06d5a tempest-CinderUnicodeTest-1443437654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1273fd8f-ae06-407f-b650-c96b46285400 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:44 devstack sudo[97662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1273fd8f-ae06-407f-b650-c96b46285400 Jul 07 08:24:44 devstack sudo[97662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:45 devstack sudo[97657]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-73858d5a-9325-4a3e-abd6-4bf9292725e2 tempest-VolumesSnapshotTestJSON-1862037507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c.74c2f2e9-1673-42db-ace9-3c0cb7fa16ea" returned: 0 in 0.770s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-73858d5a-9325-4a3e-abd6-4bf9292725e2 tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "cinder-quobyte-74c2f2e9-1673-42db-ace9-3c0cb7fa16ea" released by "_delete_snapshot" :: held 4.104s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:24:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-73858d5a-9325-4a3e-abd6-4bf9292725e2 tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "cinder-quobyte-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c" released by "delete_snapshot" :: held 4.147s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:24:45 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-73858d5a-9325-4a3e-abd6-4bf9292725e2 tempest-VolumesSnapshotTestJSON-1862037507 None] Created reservations ['0fee04c5-6c87-4a61-be5d-90b0853b01ff', '66e7406a-a65b-432d-9430-f38ebed906d8', 'bb31b6c0-1639-4303-8db9-3d12f4ad9cb8', '25f3facc-f5b9-4182-ba26-e6ce46a85090'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:24:45 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-73858d5a-9325-4a3e-abd6-4bf9292725e2 tempest-VolumesSnapshotTestJSON-1862037507 None] Delete snapshot completed successfully. Jul 07 08:24:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-73858d5a-9325-4a3e-abd6-4bf9292725e2 tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "cinder-74c2f2e9-1673-42db-ace9-3c0cb7fa16ea-delete_snapshot" released by "delete_snapshot" :: held 4.417s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:24:45 devstack sudo[97662]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-29fbbd67-d16a-45d5-a06b-b86f95b06d5a tempest-CinderUnicodeTest-1443437654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1273fd8f-ae06-407f-b650-c96b46285400" returned: 0 in 0.879s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:45 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-29fbbd67-d16a-45d5-a06b-b86f95b06d5a tempest-CinderUnicodeTest-1443437654 None] <== create_volume: return (2115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:24:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-29fbbd67-d16a-45d5-a06b-b86f95b06d5a tempest-CinderUnicodeTest-1443437654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.118s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-29fbbd67-d16a-45d5-a06b-b86f95b06d5a tempest-CinderUnicodeTest-1443437654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27669b71-2bf6-4dd3-abb0-b003a53851ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1273fd8f-ae06-407f-b650-c96b46285400', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-29fbbd67-d16a-45d5-a06b-b86f95b06d5a tempest-CinderUnicodeTest-1443437654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (511627ad-44e5-4d88-abfe-ff18f644b7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:45 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-29fbbd67-d16a-45d5-a06b-b86f95b06d5a tempest-CinderUnicodeTest-1443437654 None] Volume volume-1273fd8f-ae06-407f-b650-c96b46285400 (1273fd8f-ae06-407f-b650-c96b46285400): created successfully Jul 07 08:24:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-29fbbd67-d16a-45d5-a06b-b86f95b06d5a tempest-CinderUnicodeTest-1443437654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (511627ad-44e5-4d88-abfe-ff18f644b7d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-29fbbd67-d16a-45d5-a06b-b86f95b06d5a tempest-CinderUnicodeTest-1443437654 None] Flow 'volume_create_manager' (2b6467ce-5914-481f-baf4-db8a51952c0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:24:45 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-29fbbd67-d16a-45d5-a06b-b86f95b06d5a tempest-CinderUnicodeTest-1443437654 None] Created volume successfully. Jul 07 08:24:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c3bf80c0-85cd-44bb-a70e-282dae34053e tempest-VolumesSnapshotTestJSON-1862037507 None] Acquiring lock "cinder-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:24:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c3bf80c0-85cd-44bb-a70e-282dae34053e tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "cinder-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:24:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c3bf80c0-85cd-44bb-a70e-282dae34053e tempest-VolumesSnapshotTestJSON-1862037507 None] Acquiring lock "cinder-quobyte-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:24:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c3bf80c0-85cd-44bb-a70e-282dae34053e tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "cinder-quobyte-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c" acquired by "delete_volume" :: waited 0.023s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:24:46 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a63f3ca-880d-4031-bf84-eb4b84427dc5]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:24:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c3bf80c0-85cd-44bb-a70e-282dae34053e tempest-VolumesSnapshotTestJSON-1862037507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:46 devstack sudo[97672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c Jul 07 08:24:46 devstack sudo[97672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:47 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe82c937-cc64-4797-ac83-48ec315896f1 tempest-CinderUnicodeTest-1443437654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:24:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-fe82c937-cc64-4797-ac83-48ec315896f1 tempest-CinderUnicodeTest-1443437654 None] Flow 'volume_create_manager' (97f35024-e1d3-4692-a9fb-ad9f65cf9824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:24:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-fe82c937-cc64-4797-ac83-48ec315896f1 tempest-CinderUnicodeTest-1443437654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (764399b1-75d3-4051-a327-5ac084b0eacf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-fe82c937-cc64-4797-ac83-48ec315896f1 tempest-CinderUnicodeTest-1443437654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (764399b1-75d3-4051-a327-5ac084b0eacf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:24:47Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1248971967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7642e6ce-1572-49a9-8aba-d9fb1312d825,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4235ec624f94c1ca7b10f96a94a59fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:24:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:24:47Z,use_quota=True,user_id='9475388525814378b1dd19cbc41bf29f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-fe82c937-cc64-4797-ac83-48ec315896f1 tempest-CinderUnicodeTest-1443437654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aa43148-ecb9-4410-91c0-4ce21ac1bd98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-fe82c937-cc64-4797-ac83-48ec315896f1 tempest-CinderUnicodeTest-1443437654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aa43148-ecb9-4410-91c0-4ce21ac1bd98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-fe82c937-cc64-4797-ac83-48ec315896f1 tempest-CinderUnicodeTest-1443437654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d960096c-0059-4044-9508-ff46e659e6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-fe82c937-cc64-4797-ac83-48ec315896f1 tempest-CinderUnicodeTest-1443437654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d960096c-0059-4044-9508-ff46e659e6fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7642e6ce-1572-49a9-8aba-d9fb1312d825', 'volume_name': 'volume-7642e6ce-1572-49a9-8aba-d9fb1312d825', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-fe82c937-cc64-4797-ac83-48ec315896f1 tempest-CinderUnicodeTest-1443437654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d91a8db-46a6-4f3b-8b17-59c7c0f19b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-fe82c937-cc64-4797-ac83-48ec315896f1 tempest-CinderUnicodeTest-1443437654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d91a8db-46a6-4f3b-8b17-59c7c0f19b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-fe82c937-cc64-4797-ac83-48ec315896f1 tempest-CinderUnicodeTest-1443437654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (532db8fe-6794-4a74-a51d-32aa8b1403b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:47 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-fe82c937-cc64-4797-ac83-48ec315896f1 tempest-CinderUnicodeTest-1443437654 None] Volume 7642e6ce-1572-49a9-8aba-d9fb1312d825: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7642e6ce-1572-49a9-8aba-d9fb1312d825', 'volume_size': 1} Jul 07 08:24:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-fe82c937-cc64-4797-ac83-48ec315896f1 tempest-CinderUnicodeTest-1443437654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-fe82c937-cc64-4797-ac83-48ec315896f1 tempest-CinderUnicodeTest-1443437654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-fe82c937-cc64-4797-ac83-48ec315896f1 tempest-CinderUnicodeTest-1443437654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:24:47Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1248971967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7642e6ce-1572-49a9-8aba-d9fb1312d825,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4235ec624f94c1ca7b10f96a94a59fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:24:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:24:47Z,use_quota=True,user_id='9475388525814378b1dd19cbc41bf29f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:24:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-fe82c937-cc64-4797-ac83-48ec315896f1 tempest-CinderUnicodeTest-1443437654 None] Creating volume 7642e6ce-1572-49a9-8aba-d9fb1312d825 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:24:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-fe82c937-cc64-4797-ac83-48ec315896f1 tempest-CinderUnicodeTest-1443437654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-fe82c937-cc64-4797-ac83-48ec315896f1 tempest-CinderUnicodeTest-1443437654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-fe82c937-cc64-4797-ac83-48ec315896f1 tempest-CinderUnicodeTest-1443437654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:24:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-fe82c937-cc64-4797-ac83-48ec315896f1 tempest-CinderUnicodeTest-1443437654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:24:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-fe82c937-cc64-4797-ac83-48ec315896f1 tempest-CinderUnicodeTest-1443437654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-fe82c937-cc64-4797-ac83-48ec315896f1 tempest-CinderUnicodeTest-1443437654 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:24:47 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-fe82c937-cc64-4797-ac83-48ec315896f1 tempest-CinderUnicodeTest-1443437654 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:24:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fe82c937-cc64-4797-ac83-48ec315896f1 tempest-CinderUnicodeTest-1443437654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7642e6ce-1572-49a9-8aba-d9fb1312d825 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:47 devstack sudo[97675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7642e6ce-1572-49a9-8aba-d9fb1312d825 1073741824 Jul 07 08:24:47 devstack sudo[97675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:47 devstack sudo[97672]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c3bf80c0-85cd-44bb-a70e-282dae34053e tempest-VolumesSnapshotTestJSON-1862037507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c" returned: 0 in 1.184s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c3bf80c0-85cd-44bb-a70e-282dae34053e tempest-VolumesSnapshotTestJSON-1862037507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:47 devstack sudo[97680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c Jul 07 08:24:47 devstack sudo[97680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:48 devstack sudo[97680]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c3bf80c0-85cd-44bb-a70e-282dae34053e tempest-VolumesSnapshotTestJSON-1862037507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c" returned: 0 in 1.052s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c3bf80c0-85cd-44bb-a70e-282dae34053e tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "cinder-quobyte-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c" released by "delete_volume" :: held 2.336s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:24:48 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-c3bf80c0-85cd-44bb-a70e-282dae34053e tempest-VolumesSnapshotTestJSON-1862037507 None] Created reservations ['07e4f9d7-272f-43e9-878b-83ada8387fb5', '470630a1-a7b6-44df-b673-942fb40b0420', '0a0179d8-c078-4b2e-a29c-47ebae7d5304', '762d2b00-59b0-4e3c-9eea-9b27b84fb2c8'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:24:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c3bf80c0-85cd-44bb-a70e-282dae34053e tempest-VolumesSnapshotTestJSON-1862037507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c3bf80c0-85cd-44bb-a70e-282dae34053e tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:49 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c3bf80c0-85cd-44bb-a70e-282dae34053e tempest-VolumesSnapshotTestJSON-1862037507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:24:49 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c3bf80c0-85cd-44bb-a70e-282dae34053e tempest-VolumesSnapshotTestJSON-1862037507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:24:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c3bf80c0-85cd-44bb-a70e-282dae34053e tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c3bf80c0-85cd-44bb-a70e-282dae34053e tempest-VolumesSnapshotTestJSON-1862037507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:49 devstack sudo[97688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:24:49 devstack sudo[97688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:49 devstack sudo[97675]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fe82c937-cc64-4797-ac83-48ec315896f1 tempest-CinderUnicodeTest-1443437654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7642e6ce-1572-49a9-8aba-d9fb1312d825 1073741824" returned: 0 in 1.583s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fe82c937-cc64-4797-ac83-48ec315896f1 tempest-CinderUnicodeTest-1443437654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7642e6ce-1572-49a9-8aba-d9fb1312d825 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:49 devstack sudo[97690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7642e6ce-1572-49a9-8aba-d9fb1312d825 Jul 07 08:24:49 devstack sudo[97690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:49 devstack sudo[97688]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c3bf80c0-85cd-44bb-a70e-282dae34053e tempest-VolumesSnapshotTestJSON-1862037507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.966s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:49 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-c3bf80c0-85cd-44bb-a70e-282dae34053e tempest-VolumesSnapshotTestJSON-1862037507 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:24:49 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-c3bf80c0-85cd-44bb-a70e-282dae34053e tempest-VolumesSnapshotTestJSON-1862037507 None] Deleted volume successfully. Jul 07 08:24:50 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c3bf80c0-85cd-44bb-a70e-282dae34053e tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "cinder-6e12e713-7b86-4b5a-8d1f-8a67dd3a901c-delete_volume" released by "delete_volume" :: held 3.602s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:24:50 devstack sudo[97690]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fe82c937-cc64-4797-ac83-48ec315896f1 tempest-CinderUnicodeTest-1443437654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7642e6ce-1572-49a9-8aba-d9fb1312d825" returned: 0 in 0.986s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:50 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-fe82c937-cc64-4797-ac83-48ec315896f1 tempest-CinderUnicodeTest-1443437654 None] <== create_volume: return (2631ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:24:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-fe82c937-cc64-4797-ac83-48ec315896f1 tempest-CinderUnicodeTest-1443437654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.634s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-fe82c937-cc64-4797-ac83-48ec315896f1 tempest-CinderUnicodeTest-1443437654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (532db8fe-6794-4a74-a51d-32aa8b1403b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7642e6ce-1572-49a9-8aba-d9fb1312d825', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-fe82c937-cc64-4797-ac83-48ec315896f1 tempest-CinderUnicodeTest-1443437654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2159b84d-2c05-4a9a-b309-8330d0148e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:50 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-fe82c937-cc64-4797-ac83-48ec315896f1 tempest-CinderUnicodeTest-1443437654 None] Volume volume-7642e6ce-1572-49a9-8aba-d9fb1312d825 (7642e6ce-1572-49a9-8aba-d9fb1312d825): created successfully Jul 07 08:24:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-fe82c937-cc64-4797-ac83-48ec315896f1 tempest-CinderUnicodeTest-1443437654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2159b84d-2c05-4a9a-b309-8330d0148e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-fe82c937-cc64-4797-ac83-48ec315896f1 tempest-CinderUnicodeTest-1443437654 None] Flow 'volume_create_manager' (97f35024-e1d3-4692-a9fb-ad9f65cf9824) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:24:50 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-fe82c937-cc64-4797-ac83-48ec315896f1 tempest-CinderUnicodeTest-1443437654 None] Created volume successfully. Jul 07 08:24:50 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-78e012a3-63c9-4c24-967f-e7adbf1676d9 tempest-VolumesSnapshotTestJSON-1862037507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:24:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-78e012a3-63c9-4c24-967f-e7adbf1676d9 tempest-VolumesSnapshotTestJSON-1862037507 None] Flow 'volume_create_manager' (870e4e9f-5a5c-47bc-9de2-bbb4d35732db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:24:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-78e012a3-63c9-4c24-967f-e7adbf1676d9 tempest-VolumesSnapshotTestJSON-1862037507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b4867f1-e6fa-4218-8718-b59b0fbe5902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-78e012a3-63c9-4c24-967f-e7adbf1676d9 tempest-VolumesSnapshotTestJSON-1862037507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b4867f1-e6fa-4218-8718-b59b0fbe5902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1922509933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07fd59c1-109d-4271-bd52-646241ecacea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09a4265f78884f7396b49574ccdee3af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:24:51Z,use_quota=True,user_id='775b8acb218a4afa93d6a15c0d98c531',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-78e012a3-63c9-4c24-967f-e7adbf1676d9 tempest-VolumesSnapshotTestJSON-1862037507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41124cdf-4ce3-49e9-8c20-c5b40feb5771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-78e012a3-63c9-4c24-967f-e7adbf1676d9 tempest-VolumesSnapshotTestJSON-1862037507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41124cdf-4ce3-49e9-8c20-c5b40feb5771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-78e012a3-63c9-4c24-967f-e7adbf1676d9 tempest-VolumesSnapshotTestJSON-1862037507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac7bafc9-7192-4016-936c-14f623ceade2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-78e012a3-63c9-4c24-967f-e7adbf1676d9 tempest-VolumesSnapshotTestJSON-1862037507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac7bafc9-7192-4016-936c-14f623ceade2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07fd59c1-109d-4271-bd52-646241ecacea', 'volume_name': 'volume-07fd59c1-109d-4271-bd52-646241ecacea', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-78e012a3-63c9-4c24-967f-e7adbf1676d9 tempest-VolumesSnapshotTestJSON-1862037507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c965d92b-fbad-42b2-87d0-2c4c0961db25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-78e012a3-63c9-4c24-967f-e7adbf1676d9 tempest-VolumesSnapshotTestJSON-1862037507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c965d92b-fbad-42b2-87d0-2c4c0961db25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-78e012a3-63c9-4c24-967f-e7adbf1676d9 tempest-VolumesSnapshotTestJSON-1862037507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f80c1858-6e52-441a-84cf-ab42ca070e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:50 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-78e012a3-63c9-4c24-967f-e7adbf1676d9 tempest-VolumesSnapshotTestJSON-1862037507 None] Volume 07fd59c1-109d-4271-bd52-646241ecacea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07fd59c1-109d-4271-bd52-646241ecacea', 'volume_size': 1} Jul 07 08:24:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-78e012a3-63c9-4c24-967f-e7adbf1676d9 tempest-VolumesSnapshotTestJSON-1862037507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-78e012a3-63c9-4c24-967f-e7adbf1676d9 tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:50 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-78e012a3-63c9-4c24-967f-e7adbf1676d9 tempest-VolumesSnapshotTestJSON-1862037507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1922509933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07fd59c1-109d-4271-bd52-646241ecacea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09a4265f78884f7396b49574ccdee3af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:24:51Z,use_quota=True,user_id='775b8acb218a4afa93d6a15c0d98c531',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:24:50 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-78e012a3-63c9-4c24-967f-e7adbf1676d9 tempest-VolumesSnapshotTestJSON-1862037507 None] Creating volume 07fd59c1-109d-4271-bd52-646241ecacea {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:24:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-78e012a3-63c9-4c24-967f-e7adbf1676d9 tempest-VolumesSnapshotTestJSON-1862037507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-78e012a3-63c9-4c24-967f-e7adbf1676d9 tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:50 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-78e012a3-63c9-4c24-967f-e7adbf1676d9 tempest-VolumesSnapshotTestJSON-1862037507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:24:50 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-78e012a3-63c9-4c24-967f-e7adbf1676d9 tempest-VolumesSnapshotTestJSON-1862037507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:24:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-78e012a3-63c9-4c24-967f-e7adbf1676d9 tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:50 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-78e012a3-63c9-4c24-967f-e7adbf1676d9 tempest-VolumesSnapshotTestJSON-1862037507 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:24:50 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-78e012a3-63c9-4c24-967f-e7adbf1676d9 tempest-VolumesSnapshotTestJSON-1862037507 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:24:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-78e012a3-63c9-4c24-967f-e7adbf1676d9 tempest-VolumesSnapshotTestJSON-1862037507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07fd59c1-109d-4271-bd52-646241ecacea 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:50 devstack sudo[97696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07fd59c1-109d-4271-bd52-646241ecacea 1073741824 Jul 07 08:24:50 devstack sudo[97696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b4d5bf3a-30e5-48d0-9c39-49e0fee8d9be tempest-CinderUnicodeTest-1443437654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:52 devstack sudo[97696]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-78e012a3-63c9-4c24-967f-e7adbf1676d9 tempest-VolumesSnapshotTestJSON-1862037507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07fd59c1-109d-4271-bd52-646241ecacea 1073741824" returned: 0 in 1.201s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-78e012a3-63c9-4c24-967f-e7adbf1676d9 tempest-VolumesSnapshotTestJSON-1862037507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07fd59c1-109d-4271-bd52-646241ecacea {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:52 devstack sudo[97702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07fd59c1-109d-4271-bd52-646241ecacea Jul 07 08:24:52 devstack sudo[97702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:52 devstack sudo[97702]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-78e012a3-63c9-4c24-967f-e7adbf1676d9 tempest-VolumesSnapshotTestJSON-1862037507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07fd59c1-109d-4271-bd52-646241ecacea" returned: 0 in 0.776s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:52 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-78e012a3-63c9-4c24-967f-e7adbf1676d9 tempest-VolumesSnapshotTestJSON-1862037507 None] <== create_volume: return (2044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:24:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-78e012a3-63c9-4c24-967f-e7adbf1676d9 tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.047s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b4d5bf3a-30e5-48d0-9c39-49e0fee8d9be tempest-CinderUnicodeTest-1443437654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.769s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:52 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-b4d5bf3a-30e5-48d0-9c39-49e0fee8d9be tempest-CinderUnicodeTest-1443437654 None] Creating offline snapshot a18cfe4d-a68d-4107-af7e-8404462a08b7 of volume 7642e6ce-1572-49a9-8aba-d9fb1312d825 {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:24:52 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-78e012a3-63c9-4c24-967f-e7adbf1676d9 tempest-VolumesSnapshotTestJSON-1862037507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f80c1858-6e52-441a-84cf-ab42ca070e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07fd59c1-109d-4271-bd52-646241ecacea', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:52 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-78e012a3-63c9-4c24-967f-e7adbf1676d9 tempest-VolumesSnapshotTestJSON-1862037507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9a5f3d2-fd6f-4b4a-bc65-a5169f421388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:52 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6ecf7a-8aca-4b94-92fb-f97093de3379]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:24:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b4d5bf3a-30e5-48d0-9c39-49e0fee8d9be tempest-CinderUnicodeTest-1443437654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7642e6ce-1572-49a9-8aba-d9fb1312d825 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:53 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-78e012a3-63c9-4c24-967f-e7adbf1676d9 tempest-VolumesSnapshotTestJSON-1862037507 None] Volume volume-07fd59c1-109d-4271-bd52-646241ecacea (07fd59c1-109d-4271-bd52-646241ecacea): created successfully Jul 07 08:24:53 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-78e012a3-63c9-4c24-967f-e7adbf1676d9 tempest-VolumesSnapshotTestJSON-1862037507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9a5f3d2-fd6f-4b4a-bc65-a5169f421388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:53 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-78e012a3-63c9-4c24-967f-e7adbf1676d9 tempest-VolumesSnapshotTestJSON-1862037507 None] Flow 'volume_create_manager' (870e4e9f-5a5c-47bc-9de2-bbb4d35732db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:24:53 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-78e012a3-63c9-4c24-967f-e7adbf1676d9 tempest-VolumesSnapshotTestJSON-1862037507 None] Created volume successfully. Jul 07 08:24:53 devstack sudo[97706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7642e6ce-1572-49a9-8aba-d9fb1312d825 Jul 07 08:24:53 devstack sudo[97706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:53 devstack sudo[97706]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b4d5bf3a-30e5-48d0-9c39-49e0fee8d9be tempest-CinderUnicodeTest-1443437654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7642e6ce-1572-49a9-8aba-d9fb1312d825" returned: 0 in 0.905s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b4d5bf3a-30e5-48d0-9c39-49e0fee8d9be tempest-CinderUnicodeTest-1443437654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7642e6ce-1572-49a9-8aba-d9fb1312d825,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7642e6ce-1572-49a9-8aba-d9fb1312d825.a18cfe4d-a68d-4107-af7e-8404462a08b7 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:53 devstack sudo[97711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7642e6ce-1572-49a9-8aba-d9fb1312d825,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7642e6ce-1572-49a9-8aba-d9fb1312d825.a18cfe4d-a68d-4107-af7e-8404462a08b7 1G Jul 07 08:24:53 devstack sudo[97711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-83d42d9c-9724-46c4-a48f-ab02ee40fca1 tempest-VolumesSnapshotTestJSON-1862037507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:54 devstack sudo[97711]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b4d5bf3a-30e5-48d0-9c39-49e0fee8d9be tempest-CinderUnicodeTest-1443437654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7642e6ce-1572-49a9-8aba-d9fb1312d825,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7642e6ce-1572-49a9-8aba-d9fb1312d825.a18cfe4d-a68d-4107-af7e-8404462a08b7 1G" returned: 0 in 1.004s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b4d5bf3a-30e5-48d0-9c39-49e0fee8d9be tempest-CinderUnicodeTest-1443437654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7642e6ce-1572-49a9-8aba-d9fb1312d825 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7642e6ce-1572-49a9-8aba-d9fb1312d825.a18cfe4d-a68d-4107-af7e-8404462a08b7 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:54 devstack sudo[97716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7642e6ce-1572-49a9-8aba-d9fb1312d825 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7642e6ce-1572-49a9-8aba-d9fb1312d825.a18cfe4d-a68d-4107-af7e-8404462a08b7 Jul 07 08:24:54 devstack sudo[97716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:55 devstack sudo[97716]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b4d5bf3a-30e5-48d0-9c39-49e0fee8d9be tempest-CinderUnicodeTest-1443437654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7642e6ce-1572-49a9-8aba-d9fb1312d825 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7642e6ce-1572-49a9-8aba-d9fb1312d825.a18cfe4d-a68d-4107-af7e-8404462a08b7" returned: 0 in 0.925s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:55 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-b4d5bf3a-30e5-48d0-9c39-49e0fee8d9be tempest-CinderUnicodeTest-1443437654 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7642e6ce-1572-49a9-8aba-d9fb1312d825.a18cfe4d-a68d-4107-af7e-8404462a08b7 is being set with open permissions: ugo+rw Jul 07 08:24:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b4d5bf3a-30e5-48d0-9c39-49e0fee8d9be tempest-CinderUnicodeTest-1443437654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7642e6ce-1572-49a9-8aba-d9fb1312d825.a18cfe4d-a68d-4107-af7e-8404462a08b7 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:55 devstack sudo[97721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7642e6ce-1572-49a9-8aba-d9fb1312d825.a18cfe4d-a68d-4107-af7e-8404462a08b7 Jul 07 08:24:55 devstack sudo[97721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:56 devstack sudo[97721]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b4d5bf3a-30e5-48d0-9c39-49e0fee8d9be tempest-CinderUnicodeTest-1443437654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7642e6ce-1572-49a9-8aba-d9fb1312d825.a18cfe4d-a68d-4107-af7e-8404462a08b7" returned: 0 in 0.748s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:56 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:UPDATE=181,cinder:DELETE=17,cinder:SELECT=151,cinder:INSERT=48 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:24:56 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=124,cinder:INSERT=48,cinder:UPDATE=189,cinder:DELETE=16 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:24:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b4d5bf3a-30e5-48d0-9c39-49e0fee8d9be tempest-CinderUnicodeTest-1443437654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7642e6ce-1572-49a9-8aba-d9fb1312d825.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:56 devstack sudo[97724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7642e6ce-1572-49a9-8aba-d9fb1312d825.info Jul 07 08:24:56 devstack sudo[97724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:57 devstack sudo[97724]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b4d5bf3a-30e5-48d0-9c39-49e0fee8d9be tempest-CinderUnicodeTest-1443437654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7642e6ce-1572-49a9-8aba-d9fb1312d825.info" returned: 0 in 0.695s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:57 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-b4d5bf3a-30e5-48d0-9c39-49e0fee8d9be tempest-CinderUnicodeTest-1443437654 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7642e6ce-1572-49a9-8aba-d9fb1312d825.info is being set with open permissions: ugo+rw Jul 07 08:24:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b4d5bf3a-30e5-48d0-9c39-49e0fee8d9be tempest-CinderUnicodeTest-1443437654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7642e6ce-1572-49a9-8aba-d9fb1312d825.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:57 devstack sudo[97727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7642e6ce-1572-49a9-8aba-d9fb1312d825.info Jul 07 08:24:57 devstack sudo[97727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:58 devstack sudo[97727]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b4d5bf3a-30e5-48d0-9c39-49e0fee8d9be tempest-CinderUnicodeTest-1443437654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7642e6ce-1572-49a9-8aba-d9fb1312d825.info" returned: 0 in 0.687s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b4d5bf3a-30e5-48d0-9c39-49e0fee8d9be tempest-CinderUnicodeTest-1443437654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.111s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-83d42d9c-9724-46c4-a48f-ab02ee40fca1 tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.947s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-83d42d9c-9724-46c4-a48f-ab02ee40fca1 tempest-VolumesSnapshotTestJSON-1862037507 None] Creating offline snapshot 602c450a-acfd-4716-bc00-a9ab5a3f1ac3 of volume 07fd59c1-109d-4271-bd52-646241ecacea {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:24:58 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7eb43e6-3481-41d7-b9a1-c82d2ddd03c8]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:24:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-83d42d9c-9724-46c4-a48f-ab02ee40fca1 tempest-VolumesSnapshotTestJSON-1862037507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07fd59c1-109d-4271-bd52-646241ecacea {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:58 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-b4d5bf3a-30e5-48d0-9c39-49e0fee8d9be tempest-CinderUnicodeTest-1443437654 None] Create snapshot completed successfully Jul 07 08:24:58 devstack sudo[97730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07fd59c1-109d-4271-bd52-646241ecacea Jul 07 08:24:58 devstack sudo[97730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:58 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-74b98f9b-ec5c-4547-96bf-494fa987756d tempest-AbsoluteLimitsTests-1784902728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:24:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-74b98f9b-ec5c-4547-96bf-494fa987756d tempest-AbsoluteLimitsTests-1784902728 None] Flow 'volume_create_manager' (c25e67c7-519a-4b2b-ad77-33f3f988f90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:24:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-74b98f9b-ec5c-4547-96bf-494fa987756d tempest-AbsoluteLimitsTests-1784902728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18262c23-c091-45cf-9348-2f10ad251206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-74b98f9b-ec5c-4547-96bf-494fa987756d tempest-AbsoluteLimitsTests-1784902728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18262c23-c091-45cf-9348-2f10ad251206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1119991653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eecebbbc-c348-459f-804a-577802a99521,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8826b4566db94a6daa03f9817fe5df8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:24:58Z,use_quota=True,user_id='3c15de4d8d254c66aa1e961b8ba71d12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-74b98f9b-ec5c-4547-96bf-494fa987756d tempest-AbsoluteLimitsTests-1784902728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d299f610-31d4-407b-9001-7dd729b4bdf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-74b98f9b-ec5c-4547-96bf-494fa987756d tempest-AbsoluteLimitsTests-1784902728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d299f610-31d4-407b-9001-7dd729b4bdf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-74b98f9b-ec5c-4547-96bf-494fa987756d tempest-AbsoluteLimitsTests-1784902728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (248f5468-a7fc-4047-9d33-93a34ecf25fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-74b98f9b-ec5c-4547-96bf-494fa987756d tempest-AbsoluteLimitsTests-1784902728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (248f5468-a7fc-4047-9d33-93a34ecf25fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eecebbbc-c348-459f-804a-577802a99521', 'volume_name': 'volume-eecebbbc-c348-459f-804a-577802a99521', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-74b98f9b-ec5c-4547-96bf-494fa987756d tempest-AbsoluteLimitsTests-1784902728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92527892-38ca-4068-bbf8-7e92d618352c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-74b98f9b-ec5c-4547-96bf-494fa987756d tempest-AbsoluteLimitsTests-1784902728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92527892-38ca-4068-bbf8-7e92d618352c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-74b98f9b-ec5c-4547-96bf-494fa987756d tempest-AbsoluteLimitsTests-1784902728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94936343-1e69-4985-83b1-9ab1f404ad0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:58 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-74b98f9b-ec5c-4547-96bf-494fa987756d tempest-AbsoluteLimitsTests-1784902728 None] Volume eecebbbc-c348-459f-804a-577802a99521: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eecebbbc-c348-459f-804a-577802a99521', 'volume_size': 1} Jul 07 08:24:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-74b98f9b-ec5c-4547-96bf-494fa987756d tempest-AbsoluteLimitsTests-1784902728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:58 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c6cb3816-36fe-4184-bd77-4e4b85c55199 tempest-CinderUnicodeTest-1443437654 None] Acquiring lock "cinder-a18cfe4d-a68d-4107-af7e-8404462a08b7-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:24:58 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c6cb3816-36fe-4184-bd77-4e4b85c55199 tempest-CinderUnicodeTest-1443437654 None] Lock "cinder-a18cfe4d-a68d-4107-af7e-8404462a08b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:24:58 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c6cb3816-36fe-4184-bd77-4e4b85c55199 tempest-CinderUnicodeTest-1443437654 None] Acquiring lock "cinder-quobyte-7642e6ce-1572-49a9-8aba-d9fb1312d825" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:24:58 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c6cb3816-36fe-4184-bd77-4e4b85c55199 tempest-CinderUnicodeTest-1443437654 None] Lock "cinder-quobyte-7642e6ce-1572-49a9-8aba-d9fb1312d825" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:24:58 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c6cb3816-36fe-4184-bd77-4e4b85c55199 tempest-CinderUnicodeTest-1443437654 None] Acquiring lock "cinder-quobyte-a18cfe4d-a68d-4107-af7e-8404462a08b7" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:24:58 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c6cb3816-36fe-4184-bd77-4e4b85c55199 tempest-CinderUnicodeTest-1443437654 None] Lock "cinder-quobyte-a18cfe4d-a68d-4107-af7e-8404462a08b7" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:24:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-c6cb3816-36fe-4184-bd77-4e4b85c55199 tempest-CinderUnicodeTest-1443437654 None] Deleting offline snapshot a18cfe4d-a68d-4107-af7e-8404462a08b7 of volume 7642e6ce-1572-49a9-8aba-d9fb1312d825 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:24:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-c6cb3816-36fe-4184-bd77-4e4b85c55199 tempest-CinderUnicodeTest-1443437654 None] snapshot_file for this snap is: volume-7642e6ce-1572-49a9-8aba-d9fb1312d825.a18cfe4d-a68d-4107-af7e-8404462a08b7 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:24:58 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d51bc1-2410-4ec2-a828-4655a1e563d0]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:24:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c6cb3816-36fe-4184-bd77-4e4b85c55199 tempest-CinderUnicodeTest-1443437654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7642e6ce-1572-49a9-8aba-d9fb1312d825.a18cfe4d-a68d-4107-af7e-8404462a08b7 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:58 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-13ce5d4f-f1cf-4e22-af39-4f411b998c11 tempest-TestStampPattern-2031995845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:24:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-13ce5d4f-f1cf-4e22-af39-4f411b998c11 tempest-TestStampPattern-2031995845 None] Flow 'volume_create_manager' (8e10dbd4-20c8-40b7-b396-e9f03870987d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:24:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-13ce5d4f-f1cf-4e22-af39-4f411b998c11 tempest-TestStampPattern-2031995845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13160103-5b02-41f7-a2cd-3bc2844d837e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-13ce5d4f-f1cf-4e22-af39-4f411b998c11 tempest-TestStampPattern-2031995845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13160103-5b02-41f7-a2cd-3bc2844d837e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1450432506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ab52e0c-f1b1-4225-b8bd-7bc07317f788,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='323a038e8c0d4dfea8968d1a5f7f5544',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:24:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:24:59Z,use_quota=True,user_id='3f17c7d5b59d4a2d90921d3d9db63175',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-13ce5d4f-f1cf-4e22-af39-4f411b998c11 tempest-TestStampPattern-2031995845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90f506b2-d916-480b-acd2-2806e4fabed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-13ce5d4f-f1cf-4e22-af39-4f411b998c11 tempest-TestStampPattern-2031995845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90f506b2-d916-480b-acd2-2806e4fabed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-13ce5d4f-f1cf-4e22-af39-4f411b998c11 tempest-TestStampPattern-2031995845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2fd00e9-b8e3-4eb4-841a-1697139d57ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-13ce5d4f-f1cf-4e22-af39-4f411b998c11 tempest-TestStampPattern-2031995845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2fd00e9-b8e3-4eb4-841a-1697139d57ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ab52e0c-f1b1-4225-b8bd-7bc07317f788', 'volume_name': 'volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-13ce5d4f-f1cf-4e22-af39-4f411b998c11 tempest-TestStampPattern-2031995845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24b07cd9-81ba-44de-bc71-802c856e32fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-13ce5d4f-f1cf-4e22-af39-4f411b998c11 tempest-TestStampPattern-2031995845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24b07cd9-81ba-44de-bc71-802c856e32fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-13ce5d4f-f1cf-4e22-af39-4f411b998c11 tempest-TestStampPattern-2031995845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fa22ae5-389a-4b9c-906f-e1ceda400290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:58 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-13ce5d4f-f1cf-4e22-af39-4f411b998c11 tempest-TestStampPattern-2031995845 None] Volume 5ab52e0c-f1b1-4225-b8bd-7bc07317f788: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788', 'volume_size': 1} Jul 07 08:24:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-13ce5d4f-f1cf-4e22-af39-4f411b998c11 tempest-TestStampPattern-2031995845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:58 devstack sudo[97733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7642e6ce-1572-49a9-8aba-d9fb1312d825.a18cfe4d-a68d-4107-af7e-8404462a08b7 Jul 07 08:24:58 devstack sudo[97733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:58 devstack sudo[97730]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-83d42d9c-9724-46c4-a48f-ab02ee40fca1 tempest-VolumesSnapshotTestJSON-1862037507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07fd59c1-109d-4271-bd52-646241ecacea" returned: 0 in 0.906s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-83d42d9c-9724-46c4-a48f-ab02ee40fca1 tempest-VolumesSnapshotTestJSON-1862037507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07fd59c1-109d-4271-bd52-646241ecacea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07fd59c1-109d-4271-bd52-646241ecacea.602c450a-acfd-4716-bc00-a9ab5a3f1ac3 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:59 devstack sudo[97738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07fd59c1-109d-4271-bd52-646241ecacea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07fd59c1-109d-4271-bd52-646241ecacea.602c450a-acfd-4716-bc00-a9ab5a3f1ac3 1G Jul 07 08:24:59 devstack sudo[97738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:59 devstack sudo[97733]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c6cb3816-36fe-4184-bd77-4e4b85c55199 tempest-CinderUnicodeTest-1443437654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7642e6ce-1572-49a9-8aba-d9fb1312d825.a18cfe4d-a68d-4107-af7e-8404462a08b7" returned: 0 in 0.835s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:59 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-c6cb3816-36fe-4184-bd77-4e4b85c55199 tempest-CinderUnicodeTest-1443437654 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7642e6ce-1572-49a9-8aba-d9fb1312d825(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:24:59 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e07aceb-512b-4342-b685-770761a221c9]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:24:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c6cb3816-36fe-4184-bd77-4e4b85c55199 tempest-CinderUnicodeTest-1443437654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7642e6ce-1572-49a9-8aba-d9fb1312d825 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:59 devstack sudo[97746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7642e6ce-1572-49a9-8aba-d9fb1312d825 Jul 07 08:24:59 devstack sudo[97746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:59 devstack sudo[97738]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-83d42d9c-9724-46c4-a48f-ab02ee40fca1 tempest-VolumesSnapshotTestJSON-1862037507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07fd59c1-109d-4271-bd52-646241ecacea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07fd59c1-109d-4271-bd52-646241ecacea.602c450a-acfd-4716-bc00-a9ab5a3f1ac3 1G" returned: 0 in 0.927s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-83d42d9c-9724-46c4-a48f-ab02ee40fca1 tempest-VolumesSnapshotTestJSON-1862037507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07fd59c1-109d-4271-bd52-646241ecacea -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07fd59c1-109d-4271-bd52-646241ecacea.602c450a-acfd-4716-bc00-a9ab5a3f1ac3 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:59 devstack sudo[97752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07fd59c1-109d-4271-bd52-646241ecacea -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07fd59c1-109d-4271-bd52-646241ecacea.602c450a-acfd-4716-bc00-a9ab5a3f1ac3 Jul 07 08:24:59 devstack sudo[97752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:00 devstack sudo[97746]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c6cb3816-36fe-4184-bd77-4e4b85c55199 tempest-CinderUnicodeTest-1443437654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7642e6ce-1572-49a9-8aba-d9fb1312d825" returned: 0 in 0.910s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c6cb3816-36fe-4184-bd77-4e4b85c55199 tempest-CinderUnicodeTest-1443437654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7642e6ce-1572-49a9-8aba-d9fb1312d825.a18cfe4d-a68d-4107-af7e-8404462a08b7 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:00 devstack sudo[97758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7642e6ce-1572-49a9-8aba-d9fb1312d825.a18cfe4d-a68d-4107-af7e-8404462a08b7 Jul 07 08:25:00 devstack sudo[97758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:00 devstack sudo[97752]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-83d42d9c-9724-46c4-a48f-ab02ee40fca1 tempest-VolumesSnapshotTestJSON-1862037507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07fd59c1-109d-4271-bd52-646241ecacea -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07fd59c1-109d-4271-bd52-646241ecacea.602c450a-acfd-4716-bc00-a9ab5a3f1ac3" returned: 0 in 0.824s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:00 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-83d42d9c-9724-46c4-a48f-ab02ee40fca1 tempest-VolumesSnapshotTestJSON-1862037507 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07fd59c1-109d-4271-bd52-646241ecacea.602c450a-acfd-4716-bc00-a9ab5a3f1ac3 is being set with open permissions: ugo+rw Jul 07 08:25:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-83d42d9c-9724-46c4-a48f-ab02ee40fca1 tempest-VolumesSnapshotTestJSON-1862037507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07fd59c1-109d-4271-bd52-646241ecacea.602c450a-acfd-4716-bc00-a9ab5a3f1ac3 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:00 devstack sudo[97763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07fd59c1-109d-4271-bd52-646241ecacea.602c450a-acfd-4716-bc00-a9ab5a3f1ac3 Jul 07 08:25:00 devstack sudo[97763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:01 devstack sudo[97758]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c6cb3816-36fe-4184-bd77-4e4b85c55199 tempest-CinderUnicodeTest-1443437654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7642e6ce-1572-49a9-8aba-d9fb1312d825.a18cfe4d-a68d-4107-af7e-8404462a08b7" returned: 0 in 0.809s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c6cb3816-36fe-4184-bd77-4e4b85c55199 tempest-CinderUnicodeTest-1443437654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7642e6ce-1572-49a9-8aba-d9fb1312d825.a18cfe4d-a68d-4107-af7e-8404462a08b7 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:01 devstack sudo[97772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7642e6ce-1572-49a9-8aba-d9fb1312d825.a18cfe4d-a68d-4107-af7e-8404462a08b7 Jul 07 08:25:01 devstack sudo[97772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:01 devstack sudo[97763]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-83d42d9c-9724-46c4-a48f-ab02ee40fca1 tempest-VolumesSnapshotTestJSON-1862037507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07fd59c1-109d-4271-bd52-646241ecacea.602c450a-acfd-4716-bc00-a9ab5a3f1ac3" returned: 0 in 0.657s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-83d42d9c-9724-46c4-a48f-ab02ee40fca1 tempest-VolumesSnapshotTestJSON-1862037507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07fd59c1-109d-4271-bd52-646241ecacea.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:01 devstack sudo[97774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07fd59c1-109d-4271-bd52-646241ecacea.info Jul 07 08:25:01 devstack sudo[97774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:02 devstack sudo[97772]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c6cb3816-36fe-4184-bd77-4e4b85c55199 tempest-CinderUnicodeTest-1443437654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7642e6ce-1572-49a9-8aba-d9fb1312d825.a18cfe4d-a68d-4107-af7e-8404462a08b7" returned: 0 in 0.716s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:02 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c6cb3816-36fe-4184-bd77-4e4b85c55199 tempest-CinderUnicodeTest-1443437654 None] Lock "cinder-quobyte-a18cfe4d-a68d-4107-af7e-8404462a08b7" released by "_delete_snapshot" :: held 3.395s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:25:02 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c6cb3816-36fe-4184-bd77-4e4b85c55199 tempest-CinderUnicodeTest-1443437654 None] Lock "cinder-quobyte-7642e6ce-1572-49a9-8aba-d9fb1312d825" released by "delete_snapshot" :: held 3.438s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:25:02 devstack sudo[97774]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-83d42d9c-9724-46c4-a48f-ab02ee40fca1 tempest-VolumesSnapshotTestJSON-1862037507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07fd59c1-109d-4271-bd52-646241ecacea.info" returned: 0 in 0.690s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:02 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-83d42d9c-9724-46c4-a48f-ab02ee40fca1 tempest-VolumesSnapshotTestJSON-1862037507 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07fd59c1-109d-4271-bd52-646241ecacea.info is being set with open permissions: ugo+rw Jul 07 08:25:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-83d42d9c-9724-46c4-a48f-ab02ee40fca1 tempest-VolumesSnapshotTestJSON-1862037507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07fd59c1-109d-4271-bd52-646241ecacea.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:02 devstack sudo[97781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07fd59c1-109d-4271-bd52-646241ecacea.info Jul 07 08:25:02 devstack sudo[97781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:02 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-c6cb3816-36fe-4184-bd77-4e4b85c55199 tempest-CinderUnicodeTest-1443437654 None] Created reservations ['b0b6fb4f-3cab-44e1-a143-e2c60668c2b0', '5f302fe0-419e-4b23-af4a-f96349490f01', '31b2ffe8-7a4f-4155-9779-d66963242c74', '9a12d51a-2138-4682-98f1-77b0fefc960d'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:25:02 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-c6cb3816-36fe-4184-bd77-4e4b85c55199 tempest-CinderUnicodeTest-1443437654 None] Delete snapshot completed successfully. Jul 07 08:25:02 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c6cb3816-36fe-4184-bd77-4e4b85c55199 tempest-CinderUnicodeTest-1443437654 None] Lock "cinder-a18cfe4d-a68d-4107-af7e-8404462a08b7-delete_snapshot" released by "delete_snapshot" :: held 3.612s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:25:02 devstack sudo[97781]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-83d42d9c-9724-46c4-a48f-ab02ee40fca1 tempest-VolumesSnapshotTestJSON-1862037507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07fd59c1-109d-4271-bd52-646241ecacea.info" returned: 0 in 0.629s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-83d42d9c-9724-46c4-a48f-ab02ee40fca1 tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.742s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-74b98f9b-ec5c-4547-96bf-494fa987756d tempest-AbsoluteLimitsTests-1784902728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.206s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:02 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-74b98f9b-ec5c-4547-96bf-494fa987756d tempest-AbsoluteLimitsTests-1784902728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1119991653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eecebbbc-c348-459f-804a-577802a99521,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8826b4566db94a6daa03f9817fe5df8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:24:58Z,use_quota=True,user_id='3c15de4d8d254c66aa1e961b8ba71d12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:25:02 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-74b98f9b-ec5c-4547-96bf-494fa987756d tempest-AbsoluteLimitsTests-1784902728 None] Creating volume eecebbbc-c348-459f-804a-577802a99521 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:25:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-74b98f9b-ec5c-4547-96bf-494fa987756d tempest-AbsoluteLimitsTests-1784902728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-74b98f9b-ec5c-4547-96bf-494fa987756d tempest-AbsoluteLimitsTests-1784902728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:02 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-74b98f9b-ec5c-4547-96bf-494fa987756d tempest-AbsoluteLimitsTests-1784902728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:25:02 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-74b98f9b-ec5c-4547-96bf-494fa987756d tempest-AbsoluteLimitsTests-1784902728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:25:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-74b98f9b-ec5c-4547-96bf-494fa987756d tempest-AbsoluteLimitsTests-1784902728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:02 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-74b98f9b-ec5c-4547-96bf-494fa987756d tempest-AbsoluteLimitsTests-1784902728 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:25:02 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-74b98f9b-ec5c-4547-96bf-494fa987756d tempest-AbsoluteLimitsTests-1784902728 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:25:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-74b98f9b-ec5c-4547-96bf-494fa987756d tempest-AbsoluteLimitsTests-1784902728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-eecebbbc-c348-459f-804a-577802a99521 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:02 devstack sudo[97784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-eecebbbc-c348-459f-804a-577802a99521 1073741824 Jul 07 08:25:02 devstack sudo[97784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:02 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-83d42d9c-9724-46c4-a48f-ab02ee40fca1 tempest-VolumesSnapshotTestJSON-1862037507 None] Create snapshot completed successfully Jul 07 08:25:02 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b7a158dc-be6a-4868-acfd-e6ad9f0c6f39 tempest-CinderUnicodeTest-1443437654 None] Acquiring lock "cinder-7642e6ce-1572-49a9-8aba-d9fb1312d825-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:25:02 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b7a158dc-be6a-4868-acfd-e6ad9f0c6f39 tempest-CinderUnicodeTest-1443437654 None] Lock "cinder-7642e6ce-1572-49a9-8aba-d9fb1312d825-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:25:02 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b7a158dc-be6a-4868-acfd-e6ad9f0c6f39 tempest-CinderUnicodeTest-1443437654 None] Acquiring lock "cinder-quobyte-7642e6ce-1572-49a9-8aba-d9fb1312d825" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:25:02 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b7a158dc-be6a-4868-acfd-e6ad9f0c6f39 tempest-CinderUnicodeTest-1443437654 None] Lock "cinder-quobyte-7642e6ce-1572-49a9-8aba-d9fb1312d825" acquired by "delete_volume" :: waited 0.014s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:25:02 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c965035-ec36-4366-aa03-35f139f1fa4d]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:25:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b7a158dc-be6a-4868-acfd-e6ad9f0c6f39 tempest-CinderUnicodeTest-1443437654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7642e6ce-1572-49a9-8aba-d9fb1312d825 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:03 devstack sudo[97786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7642e6ce-1572-49a9-8aba-d9fb1312d825 Jul 07 08:25:03 devstack sudo[97786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:03 devstack sudo[97784]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-74b98f9b-ec5c-4547-96bf-494fa987756d tempest-AbsoluteLimitsTests-1784902728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-eecebbbc-c348-459f-804a-577802a99521 1073741824" returned: 0 in 0.857s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-74b98f9b-ec5c-4547-96bf-494fa987756d tempest-AbsoluteLimitsTests-1784902728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-eecebbbc-c348-459f-804a-577802a99521 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:03 devstack sudo[97786]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b7a158dc-be6a-4868-acfd-e6ad9f0c6f39 tempest-CinderUnicodeTest-1443437654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7642e6ce-1572-49a9-8aba-d9fb1312d825" returned: 0 in 0.791s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b7a158dc-be6a-4868-acfd-e6ad9f0c6f39 tempest-CinderUnicodeTest-1443437654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7642e6ce-1572-49a9-8aba-d9fb1312d825 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:03 devstack sudo[97794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-eecebbbc-c348-459f-804a-577802a99521 Jul 07 08:25:03 devstack sudo[97794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:03 devstack sudo[97795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7642e6ce-1572-49a9-8aba-d9fb1312d825 Jul 07 08:25:03 devstack sudo[97795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:04 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d974f44-323a-488d-8956-1b5c1dddaead tempest-VolumesSnapshotTestJSON-1862037507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:25:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6d974f44-323a-488d-8956-1b5c1dddaead tempest-VolumesSnapshotTestJSON-1862037507 None] Flow 'volume_create_manager' (a4ea9564-4bfd-4f24-8f51-5579392eed7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:25:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6d974f44-323a-488d-8956-1b5c1dddaead tempest-VolumesSnapshotTestJSON-1862037507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14f9094b-ef16-4075-8e46-f0c6f44a2567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6d974f44-323a-488d-8956-1b5c1dddaead tempest-VolumesSnapshotTestJSON-1862037507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14f9094b-ef16-4075-8e46-f0c6f44a2567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1623830662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79cb5e3b-5576-4a1c-bdee-1d2dde6ab553,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09a4265f78884f7396b49574ccdee3af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=602c450a-acfd-4716-bc00-a9ab5a3f1ac3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:25:04Z,use_quota=True,user_id='775b8acb218a4afa93d6a15c0d98c531',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6d974f44-323a-488d-8956-1b5c1dddaead tempest-VolumesSnapshotTestJSON-1862037507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c9b5f61-ce0b-401c-96b2-e4f71dbd6bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6d974f44-323a-488d-8956-1b5c1dddaead tempest-VolumesSnapshotTestJSON-1862037507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c9b5f61-ce0b-401c-96b2-e4f71dbd6bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6d974f44-323a-488d-8956-1b5c1dddaead tempest-VolumesSnapshotTestJSON-1862037507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0220e610-2dbb-46c0-bfe5-d134d2c67451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6d974f44-323a-488d-8956-1b5c1dddaead tempest-VolumesSnapshotTestJSON-1862037507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0220e610-2dbb-46c0-bfe5-d134d2c67451) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '79cb5e3b-5576-4a1c-bdee-1d2dde6ab553', 'volume_name': 'volume-79cb5e3b-5576-4a1c-bdee-1d2dde6ab553', 'volume_size': 1, 'snapshot_id': '602c450a-acfd-4716-bc00-a9ab5a3f1ac3'}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6d974f44-323a-488d-8956-1b5c1dddaead tempest-VolumesSnapshotTestJSON-1862037507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecbf8321-6f73-4d2f-b9a7-5762c79c417a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6d974f44-323a-488d-8956-1b5c1dddaead tempest-VolumesSnapshotTestJSON-1862037507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecbf8321-6f73-4d2f-b9a7-5762c79c417a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6d974f44-323a-488d-8956-1b5c1dddaead tempest-VolumesSnapshotTestJSON-1862037507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (245c45cd-d4a7-4f19-9d0a-85719bae88e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:04 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-6d974f44-323a-488d-8956-1b5c1dddaead tempest-VolumesSnapshotTestJSON-1862037507 None] Volume 79cb5e3b-5576-4a1c-bdee-1d2dde6ab553: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-79cb5e3b-5576-4a1c-bdee-1d2dde6ab553', 'volume_size': 1, 'snapshot_id': '602c450a-acfd-4716-bc00-a9ab5a3f1ac3'} Jul 07 08:25:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6d974f44-323a-488d-8956-1b5c1dddaead tempest-VolumesSnapshotTestJSON-1862037507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:04 devstack sudo[97794]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-74b98f9b-ec5c-4547-96bf-494fa987756d tempest-AbsoluteLimitsTests-1784902728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-eecebbbc-c348-459f-804a-577802a99521" returned: 0 in 0.778s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-74b98f9b-ec5c-4547-96bf-494fa987756d tempest-AbsoluteLimitsTests-1784902728 None] <== create_volume: return (1706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:25:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-74b98f9b-ec5c-4547-96bf-494fa987756d tempest-AbsoluteLimitsTests-1784902728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.709s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-13ce5d4f-f1cf-4e22-af39-4f411b998c11 tempest-TestStampPattern-2031995845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.626s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-13ce5d4f-f1cf-4e22-af39-4f411b998c11 tempest-TestStampPattern-2031995845 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1450432506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ab52e0c-f1b1-4225-b8bd-7bc07317f788,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='323a038e8c0d4dfea8968d1a5f7f5544',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:24:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:24:59Z,use_quota=True,user_id='3f17c7d5b59d4a2d90921d3d9db63175',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:25:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-13ce5d4f-f1cf-4e22-af39-4f411b998c11 tempest-TestStampPattern-2031995845 None] Creating volume 5ab52e0c-f1b1-4225-b8bd-7bc07317f788 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:25:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-13ce5d4f-f1cf-4e22-af39-4f411b998c11 tempest-TestStampPattern-2031995845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-13ce5d4f-f1cf-4e22-af39-4f411b998c11 tempest-TestStampPattern-2031995845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-13ce5d4f-f1cf-4e22-af39-4f411b998c11 tempest-TestStampPattern-2031995845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:25:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-13ce5d4f-f1cf-4e22-af39-4f411b998c11 tempest-TestStampPattern-2031995845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:25:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-13ce5d4f-f1cf-4e22-af39-4f411b998c11 tempest-TestStampPattern-2031995845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-13ce5d4f-f1cf-4e22-af39-4f411b998c11 tempest-TestStampPattern-2031995845 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:25:04 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-13ce5d4f-f1cf-4e22-af39-4f411b998c11 tempest-TestStampPattern-2031995845 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:25:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-13ce5d4f-f1cf-4e22-af39-4f411b998c11 tempest-TestStampPattern-2031995845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-74b98f9b-ec5c-4547-96bf-494fa987756d tempest-AbsoluteLimitsTests-1784902728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94936343-1e69-4985-83b1-9ab1f404ad0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eecebbbc-c348-459f-804a-577802a99521', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-74b98f9b-ec5c-4547-96bf-494fa987756d tempest-AbsoluteLimitsTests-1784902728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b35e6446-8d36-40db-b04a-8cf4f2ea574d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:04 devstack sudo[97800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788 1073741824 Jul 07 08:25:04 devstack sudo[97800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:04 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-74b98f9b-ec5c-4547-96bf-494fa987756d tempest-AbsoluteLimitsTests-1784902728 None] Volume volume-eecebbbc-c348-459f-804a-577802a99521 (eecebbbc-c348-459f-804a-577802a99521): created successfully Jul 07 08:25:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-74b98f9b-ec5c-4547-96bf-494fa987756d tempest-AbsoluteLimitsTests-1784902728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b35e6446-8d36-40db-b04a-8cf4f2ea574d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-74b98f9b-ec5c-4547-96bf-494fa987756d tempest-AbsoluteLimitsTests-1784902728 None] Flow 'volume_create_manager' (c25e67c7-519a-4b2b-ad77-33f3f988f90a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:25:04 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-74b98f9b-ec5c-4547-96bf-494fa987756d tempest-AbsoluteLimitsTests-1784902728 None] Created volume successfully. Jul 07 08:25:04 devstack sudo[97795]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b7a158dc-be6a-4868-acfd-e6ad9f0c6f39 tempest-CinderUnicodeTest-1443437654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7642e6ce-1572-49a9-8aba-d9fb1312d825" returned: 0 in 0.860s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:04 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b7a158dc-be6a-4868-acfd-e6ad9f0c6f39 tempest-CinderUnicodeTest-1443437654 None] Lock "cinder-quobyte-7642e6ce-1572-49a9-8aba-d9fb1312d825" released by "delete_volume" :: held 1.716s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:25:04 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-b7a158dc-be6a-4868-acfd-e6ad9f0c6f39 tempest-CinderUnicodeTest-1443437654 None] Created reservations ['3f5001b6-e21d-40e5-9d4d-95e94cfccd5e', '0af1bcbb-9086-4cab-91fa-fa1209bcbee4', 'f54eed06-86b8-49fc-a774-cf477a026515', '2560b815-b666-4f0f-9ded-627a9a64b43c'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:25:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b7a158dc-be6a-4868-acfd-e6ad9f0c6f39 tempest-CinderUnicodeTest-1443437654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b7a158dc-be6a-4868-acfd-e6ad9f0c6f39 tempest-CinderUnicodeTest-1443437654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b7a158dc-be6a-4868-acfd-e6ad9f0c6f39 tempest-CinderUnicodeTest-1443437654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:25:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b7a158dc-be6a-4868-acfd-e6ad9f0c6f39 tempest-CinderUnicodeTest-1443437654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:25:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b7a158dc-be6a-4868-acfd-e6ad9f0c6f39 tempest-CinderUnicodeTest-1443437654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b7a158dc-be6a-4868-acfd-e6ad9f0c6f39 tempest-CinderUnicodeTest-1443437654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:04 devstack sudo[97802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:25:04 devstack sudo[97802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c046f09c-9507-442f-8e26-031b9d4473d4 tempest-AbsoluteLimitsTests-1784902728 None] Acquiring lock "cinder-eecebbbc-c348-459f-804a-577802a99521-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:25:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c046f09c-9507-442f-8e26-031b9d4473d4 tempest-AbsoluteLimitsTests-1784902728 None] Lock "cinder-eecebbbc-c348-459f-804a-577802a99521-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:25:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c046f09c-9507-442f-8e26-031b9d4473d4 tempest-AbsoluteLimitsTests-1784902728 None] Acquiring lock "cinder-quobyte-eecebbbc-c348-459f-804a-577802a99521" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:25:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c046f09c-9507-442f-8e26-031b9d4473d4 tempest-AbsoluteLimitsTests-1784902728 None] Lock "cinder-quobyte-eecebbbc-c348-459f-804a-577802a99521" acquired by "delete_volume" :: waited 0.047s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:25:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b6dded19-f51c-4262-ac7c-9e97e3ad5304 tempest-CinderUnicodeTest-1443437654 None] Acquiring lock "cinder-1273fd8f-ae06-407f-b650-c96b46285400-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:25:05 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[d833a8ed-62e8-47c9-b9b4-56389949ecb0]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:25:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c046f09c-9507-442f-8e26-031b9d4473d4 tempest-AbsoluteLimitsTests-1784902728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-eecebbbc-c348-459f-804a-577802a99521 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b6dded19-f51c-4262-ac7c-9e97e3ad5304 tempest-CinderUnicodeTest-1443437654 None] Lock "cinder-1273fd8f-ae06-407f-b650-c96b46285400-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:25:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b6dded19-f51c-4262-ac7c-9e97e3ad5304 tempest-CinderUnicodeTest-1443437654 None] Acquiring lock "cinder-quobyte-1273fd8f-ae06-407f-b650-c96b46285400" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:25:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b6dded19-f51c-4262-ac7c-9e97e3ad5304 tempest-CinderUnicodeTest-1443437654 None] Lock "cinder-quobyte-1273fd8f-ae06-407f-b650-c96b46285400" acquired by "delete_volume" :: waited 0.025s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:25:05 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c92e6e-83a4-42e1-a4a3-b48f9746c3df]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:25:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b6dded19-f51c-4262-ac7c-9e97e3ad5304 tempest-CinderUnicodeTest-1443437654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1273fd8f-ae06-407f-b650-c96b46285400 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:05 devstack sudo[97805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-eecebbbc-c348-459f-804a-577802a99521 Jul 07 08:25:05 devstack sudo[97805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:05 devstack sudo[97808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1273fd8f-ae06-407f-b650-c96b46285400 Jul 07 08:25:05 devstack sudo[97808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:05 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:25:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:25:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:25:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:05 devstack sudo[97812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:25:05 devstack sudo[97812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:06 devstack sudo[97800]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-13ce5d4f-f1cf-4e22-af39-4f411b998c11 tempest-TestStampPattern-2031995845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788 1073741824" returned: 0 in 1.532s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-13ce5d4f-f1cf-4e22-af39-4f411b998c11 tempest-TestStampPattern-2031995845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:06 devstack sudo[97814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788 Jul 07 08:25:06 devstack sudo[97814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:06 devstack sudo[97802]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b7a158dc-be6a-4868-acfd-e6ad9f0c6f39 tempest-CinderUnicodeTest-1443437654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 1.447s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:06 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-b7a158dc-be6a-4868-acfd-e6ad9f0c6f39 tempest-CinderUnicodeTest-1443437654 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:25:06 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-b7a158dc-be6a-4868-acfd-e6ad9f0c6f39 tempest-CinderUnicodeTest-1443437654 None] Deleted volume successfully. Jul 07 08:25:06 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b7a158dc-be6a-4868-acfd-e6ad9f0c6f39 tempest-CinderUnicodeTest-1443437654 None] Lock "cinder-7642e6ce-1572-49a9-8aba-d9fb1312d825-delete_volume" released by "delete_volume" :: held 3.443s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:25:06 devstack sudo[97812]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.929s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:06 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:25:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running periodic task VolumeManager._thread_info {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:25:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] thread count: 29 {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 08:25:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] thread info: [<_MainThread(MainThread, started 133056092332160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 08:25:06 devstack sudo[97805]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c046f09c-9507-442f-8e26-031b9d4473d4 tempest-AbsoluteLimitsTests-1784902728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-eecebbbc-c348-459f-804a-577802a99521" returned: 0 in 1.556s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c046f09c-9507-442f-8e26-031b9d4473d4 tempest-AbsoluteLimitsTests-1784902728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-eecebbbc-c348-459f-804a-577802a99521 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:06 devstack sudo[97835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-eecebbbc-c348-459f-804a-577802a99521 Jul 07 08:25:06 devstack sudo[97835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:07 devstack sudo[97808]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b6dded19-f51c-4262-ac7c-9e97e3ad5304 tempest-CinderUnicodeTest-1443437654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1273fd8f-ae06-407f-b650-c96b46285400" returned: 0 in 1.594s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b6dded19-f51c-4262-ac7c-9e97e3ad5304 tempest-CinderUnicodeTest-1443437654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1273fd8f-ae06-407f-b650-c96b46285400 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:07 devstack sudo[97840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1273fd8f-ae06-407f-b650-c96b46285400 Jul 07 08:25:07 devstack sudo[97840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:07 devstack sudo[97814]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-13ce5d4f-f1cf-4e22-af39-4f411b998c11 tempest-TestStampPattern-2031995845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788" returned: 0 in 1.338s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:07 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-13ce5d4f-f1cf-4e22-af39-4f411b998c11 tempest-TestStampPattern-2031995845 None] <== create_volume: return (2950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:25:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-13ce5d4f-f1cf-4e22-af39-4f411b998c11 tempest-TestStampPattern-2031995845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.956s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6d974f44-323a-488d-8956-1b5c1dddaead tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.053s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:07 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6d974f44-323a-488d-8956-1b5c1dddaead tempest-VolumesSnapshotTestJSON-1862037507 None] Acquiring lock "cinder-quobyte-602c450a-acfd-4716-bc00-a9ab5a3f1ac3-79cb5e3b-5576-4a1c-bdee-1d2dde6ab553" by "_create_volume_from_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:25:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-13ce5d4f-f1cf-4e22-af39-4f411b998c11 tempest-TestStampPattern-2031995845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fa22ae5-389a-4b9c-906f-e1ceda400290) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-13ce5d4f-f1cf-4e22-af39-4f411b998c11 tempest-TestStampPattern-2031995845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e47c3d34-aa1b-4e74-be7f-a5fc76047f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:07 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6d974f44-323a-488d-8956-1b5c1dddaead tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "cinder-quobyte-602c450a-acfd-4716-bc00-a9ab5a3f1ac3-79cb5e3b-5576-4a1c-bdee-1d2dde6ab553" acquired by "_create_volume_from_snapshot" :: waited 0.058s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:25:07 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6d974f44-323a-488d-8956-1b5c1dddaead tempest-VolumesSnapshotTestJSON-1862037507 None] Creating volume 79cb5e3b-5576-4a1c-bdee-1d2dde6ab553 from snapshot 602c450a-acfd-4716-bc00-a9ab5a3f1ac3 {{(pid=87199) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 08:25:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6d974f44-323a-488d-8956-1b5c1dddaead tempest-VolumesSnapshotTestJSON-1862037507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6d974f44-323a-488d-8956-1b5c1dddaead tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:07 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6d974f44-323a-488d-8956-1b5c1dddaead tempest-VolumesSnapshotTestJSON-1862037507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:25:07 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6d974f44-323a-488d-8956-1b5c1dddaead tempest-VolumesSnapshotTestJSON-1862037507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:25:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6d974f44-323a-488d-8956-1b5c1dddaead tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:07 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6d974f44-323a-488d-8956-1b5c1dddaead tempest-VolumesSnapshotTestJSON-1862037507 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:25:07 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6d974f44-323a-488d-8956-1b5c1dddaead tempest-VolumesSnapshotTestJSON-1862037507 None] Acquiring lock "cinder-quobyte-79cb5e3b-5576-4a1c-bdee-1d2dde6ab553" by "_copy_volume_from_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:25:07 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-13ce5d4f-f1cf-4e22-af39-4f411b998c11 tempest-TestStampPattern-2031995845 None] Volume volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788 (5ab52e0c-f1b1-4225-b8bd-7bc07317f788): created successfully Jul 07 08:25:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-13ce5d4f-f1cf-4e22-af39-4f411b998c11 tempest-TestStampPattern-2031995845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e47c3d34-aa1b-4e74-be7f-a5fc76047f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-13ce5d4f-f1cf-4e22-af39-4f411b998c11 tempest-TestStampPattern-2031995845 None] Flow 'volume_create_manager' (8e10dbd4-20c8-40b7-b396-e9f03870987d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:25:07 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6d974f44-323a-488d-8956-1b5c1dddaead tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "cinder-quobyte-79cb5e3b-5576-4a1c-bdee-1d2dde6ab553" acquired by "_copy_volume_from_snapshot" :: waited 0.043s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:25:07 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6d974f44-323a-488d-8956-1b5c1dddaead tempest-VolumesSnapshotTestJSON-1862037507 None] snapshot: 602c450a-acfd-4716-bc00-a9ab5a3f1ac3, volume: 79cb5e3b-5576-4a1c-bdee-1d2dde6ab553, {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 08:25:07 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-13ce5d4f-f1cf-4e22-af39-4f411b998c11 tempest-TestStampPattern-2031995845 None] Created volume successfully. Jul 07 08:25:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6d974f44-323a-488d-8956-1b5c1dddaead tempest-VolumesSnapshotTestJSON-1862037507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6d974f44-323a-488d-8956-1b5c1dddaead tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:07 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6d974f44-323a-488d-8956-1b5c1dddaead tempest-VolumesSnapshotTestJSON-1862037507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:25:07 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6d974f44-323a-488d-8956-1b5c1dddaead tempest-VolumesSnapshotTestJSON-1862037507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:25:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6d974f44-323a-488d-8956-1b5c1dddaead tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:07 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f29fe6-cf2f-42b3-991e-89d6c6736a52]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:25:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6d974f44-323a-488d-8956-1b5c1dddaead tempest-VolumesSnapshotTestJSON-1862037507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07fd59c1-109d-4271-bd52-646241ecacea.602c450a-acfd-4716-bc00-a9ab5a3f1ac3 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:07 devstack sudo[97847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07fd59c1-109d-4271-bd52-646241ecacea.602c450a-acfd-4716-bc00-a9ab5a3f1ac3 Jul 07 08:25:07 devstack sudo[97847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:07 devstack sudo[97835]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c046f09c-9507-442f-8e26-031b9d4473d4 tempest-AbsoluteLimitsTests-1784902728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-eecebbbc-c348-459f-804a-577802a99521" returned: 0 in 0.965s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:07 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c046f09c-9507-442f-8e26-031b9d4473d4 tempest-AbsoluteLimitsTests-1784902728 None] Lock "cinder-quobyte-eecebbbc-c348-459f-804a-577802a99521" released by "delete_volume" :: held 2.615s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:25:07 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-c046f09c-9507-442f-8e26-031b9d4473d4 tempest-AbsoluteLimitsTests-1784902728 None] Created reservations ['9a6b51b6-a847-4d96-a0e3-08f02f9dd127', '71a27849-8242-47fc-b6b9-e789648e0c47', 'd059119b-92d1-4758-985e-83a69b9fada7', 'c3ff3c02-eb6c-4878-802d-3ef30de1dac1'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:25:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c046f09c-9507-442f-8e26-031b9d4473d4 tempest-AbsoluteLimitsTests-1784902728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c046f09c-9507-442f-8e26-031b9d4473d4 tempest-AbsoluteLimitsTests-1784902728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:07 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c046f09c-9507-442f-8e26-031b9d4473d4 tempest-AbsoluteLimitsTests-1784902728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:25:07 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c046f09c-9507-442f-8e26-031b9d4473d4 tempest-AbsoluteLimitsTests-1784902728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:25:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c046f09c-9507-442f-8e26-031b9d4473d4 tempest-AbsoluteLimitsTests-1784902728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c046f09c-9507-442f-8e26-031b9d4473d4 tempest-AbsoluteLimitsTests-1784902728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:08 devstack sudo[97840]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b6dded19-f51c-4262-ac7c-9e97e3ad5304 tempest-CinderUnicodeTest-1443437654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1273fd8f-ae06-407f-b650-c96b46285400" returned: 0 in 0.885s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:08 devstack sudo[97851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:25:08 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b6dded19-f51c-4262-ac7c-9e97e3ad5304 tempest-CinderUnicodeTest-1443437654 None] Lock "cinder-quobyte-1273fd8f-ae06-407f-b650-c96b46285400" released by "delete_volume" :: held 2.536s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:25:08 devstack sudo[97851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:08 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-b6dded19-f51c-4262-ac7c-9e97e3ad5304 tempest-CinderUnicodeTest-1443437654 None] Created reservations ['1082d41f-b90e-420c-8626-236215e74ae5', '1a6fc014-66f0-408c-92a4-0533ba35485b', '2723093f-916a-4abe-a4db-13df4945cf98', '08cac841-2eb1-4ceb-a52b-c32a4a4d749c'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:25:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b6dded19-f51c-4262-ac7c-9e97e3ad5304 tempest-CinderUnicodeTest-1443437654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b6dded19-f51c-4262-ac7c-9e97e3ad5304 tempest-CinderUnicodeTest-1443437654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:08 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b6dded19-f51c-4262-ac7c-9e97e3ad5304 tempest-CinderUnicodeTest-1443437654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:25:08 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b6dded19-f51c-4262-ac7c-9e97e3ad5304 tempest-CinderUnicodeTest-1443437654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:25:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b6dded19-f51c-4262-ac7c-9e97e3ad5304 tempest-CinderUnicodeTest-1443437654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b6dded19-f51c-4262-ac7c-9e97e3ad5304 tempest-CinderUnicodeTest-1443437654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:08 devstack sudo[97853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:25:08 devstack sudo[97853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:08 devstack sudo[97847]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6d974f44-323a-488d-8956-1b5c1dddaead tempest-VolumesSnapshotTestJSON-1862037507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07fd59c1-109d-4271-bd52-646241ecacea.602c450a-acfd-4716-bc00-a9ab5a3f1ac3" returned: 0 in 0.976s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:08 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-6d974f44-323a-488d-8956-1b5c1dddaead tempest-VolumesSnapshotTestJSON-1862037507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07fd59c1-109d-4271-bd52-646241ecacea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:25:08 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6d974f44-323a-488d-8956-1b5c1dddaead tempest-VolumesSnapshotTestJSON-1862037507 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07fd59c1-109d-4271-bd52-646241ecacea {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 08:25:08 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6d974f44-323a-488d-8956-1b5c1dddaead tempest-VolumesSnapshotTestJSON-1862037507 None] Creating direct copy from snapshot {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 08:25:08 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3d82e7-5905-4768-ad9a-bed45a1729f4]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:25:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6d974f44-323a-488d-8956-1b5c1dddaead tempest-VolumesSnapshotTestJSON-1862037507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07fd59c1-109d-4271-bd52-646241ecacea {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:08 devstack sudo[97860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07fd59c1-109d-4271-bd52-646241ecacea Jul 07 08:25:08 devstack sudo[97860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:08 devstack sudo[97851]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c046f09c-9507-442f-8e26-031b9d4473d4 tempest-AbsoluteLimitsTests-1784902728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.870s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:08 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-c046f09c-9507-442f-8e26-031b9d4473d4 tempest-AbsoluteLimitsTests-1784902728 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:25:08 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-c046f09c-9507-442f-8e26-031b9d4473d4 tempest-AbsoluteLimitsTests-1784902728 None] Deleted volume successfully. Jul 07 08:25:08 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c046f09c-9507-442f-8e26-031b9d4473d4 tempest-AbsoluteLimitsTests-1784902728 None] Lock "cinder-eecebbbc-c348-459f-804a-577802a99521-delete_volume" released by "delete_volume" :: held 3.860s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:25:09 devstack sudo[97853]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b6dded19-f51c-4262-ac7c-9e97e3ad5304 tempest-CinderUnicodeTest-1443437654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.815s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:09 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-b6dded19-f51c-4262-ac7c-9e97e3ad5304 tempest-CinderUnicodeTest-1443437654 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:25:09 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-b6dded19-f51c-4262-ac7c-9e97e3ad5304 tempest-CinderUnicodeTest-1443437654 None] Deleted volume successfully. Jul 07 08:25:09 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b6dded19-f51c-4262-ac7c-9e97e3ad5304 tempest-CinderUnicodeTest-1443437654 None] Lock "cinder-1273fd8f-ae06-407f-b650-c96b46285400-delete_volume" released by "delete_volume" :: held 3.735s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:25:09 devstack sudo[97860]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6d974f44-323a-488d-8956-1b5c1dddaead tempest-VolumesSnapshotTestJSON-1862037507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07fd59c1-109d-4271-bd52-646241ecacea" returned: 0 in 0.999s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:09 devstack cinder-volume[87199]: DEBUG cinder.utils [None req-6d974f44-323a-488d-8956-1b5c1dddaead tempest-VolumesSnapshotTestJSON-1862037507 None] Path /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-79cb5e3b-5576-4a1c-bdee-1d2dde6ab553 not found in is_blk_device check {{(pid=87199) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 08:25:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6d974f44-323a-488d-8956-1b5c1dddaead tempest-VolumesSnapshotTestJSON-1862037507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07fd59c1-109d-4271-bd52-646241ecacea /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-79cb5e3b-5576-4a1c-bdee-1d2dde6ab553 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:09 devstack sudo[97866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07fd59c1-109d-4271-bd52-646241ecacea /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-79cb5e3b-5576-4a1c-bdee-1d2dde6ab553 Jul 07 08:25:09 devstack sudo[97866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:18 devstack sudo[97866]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6d974f44-323a-488d-8956-1b5c1dddaead tempest-VolumesSnapshotTestJSON-1862037507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07fd59c1-109d-4271-bd52-646241ecacea /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-79cb5e3b-5576-4a1c-bdee-1d2dde6ab553" returned: 0 in 8.454s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:18 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f08255e-2475-4ec8-b7cc-f8dbb41ebd72]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:25:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6d974f44-323a-488d-8956-1b5c1dddaead tempest-VolumesSnapshotTestJSON-1862037507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07fd59c1-109d-4271-bd52-646241ecacea {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:18 devstack sudo[98365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07fd59c1-109d-4271-bd52-646241ecacea Jul 07 08:25:18 devstack sudo[98365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:18 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=36,cinder:UPDATE=33,cinder:INSERT=12,cinder:DELETE=3 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:25:19 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=26,cinder:UPDATE=43,cinder:INSERT=8,cinder:DELETE=4 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:25:19 devstack sudo[98365]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6d974f44-323a-488d-8956-1b5c1dddaead tempest-VolumesSnapshotTestJSON-1862037507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07fd59c1-109d-4271-bd52-646241ecacea" returned: 0 in 1.268s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:19 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-6d974f44-323a-488d-8956-1b5c1dddaead tempest-VolumesSnapshotTestJSON-1862037507 None] Image conversion details: src /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07fd59c1-109d-4271-bd52-646241ecacea, size 1024.00 MB, duration 8.46 sec, destination /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-79cb5e3b-5576-4a1c-bdee-1d2dde6ab553 {{(pid=87199) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 08:25:19 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-6d974f44-323a-488d-8956-1b5c1dddaead tempest-VolumesSnapshotTestJSON-1862037507 None] Converted 1024.00 MB image at 121.09 MB/s Jul 07 08:25:19 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-6d974f44-323a-488d-8956-1b5c1dddaead tempest-VolumesSnapshotTestJSON-1862037507 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-79cb5e3b-5576-4a1c-bdee-1d2dde6ab553 is being set with open permissions: ugo+rw Jul 07 08:25:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6d974f44-323a-488d-8956-1b5c1dddaead tempest-VolumesSnapshotTestJSON-1862037507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-79cb5e3b-5576-4a1c-bdee-1d2dde6ab553 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:19 devstack sudo[98370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-79cb5e3b-5576-4a1c-bdee-1d2dde6ab553 Jul 07 08:25:19 devstack sudo[98370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:20 devstack sudo[98370]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6d974f44-323a-488d-8956-1b5c1dddaead tempest-VolumesSnapshotTestJSON-1862037507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-79cb5e3b-5576-4a1c-bdee-1d2dde6ab553" returned: 0 in 0.717s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:20 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6d974f44-323a-488d-8956-1b5c1dddaead tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "cinder-quobyte-79cb5e3b-5576-4a1c-bdee-1d2dde6ab553" released by "_copy_volume_from_snapshot" :: held 12.584s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:25:20 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6d974f44-323a-488d-8956-1b5c1dddaead tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "cinder-quobyte-602c450a-acfd-4716-bc00-a9ab5a3f1ac3-79cb5e3b-5576-4a1c-bdee-1d2dde6ab553" released by "_create_volume_from_snapshot" :: held 12.656s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:25:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6d974f44-323a-488d-8956-1b5c1dddaead tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.719s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6d974f44-323a-488d-8956-1b5c1dddaead tempest-VolumesSnapshotTestJSON-1862037507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (245c45cd-d4a7-4f19-9d0a-85719bae88e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79cb5e3b-5576-4a1c-bdee-1d2dde6ab553', 'volume_size': 1, 'snapshot_id': '602c450a-acfd-4716-bc00-a9ab5a3f1ac3'}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6d974f44-323a-488d-8956-1b5c1dddaead tempest-VolumesSnapshotTestJSON-1862037507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2ba7903-0cda-482c-9e1d-dcaf41fe4a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:20 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-6d974f44-323a-488d-8956-1b5c1dddaead tempest-VolumesSnapshotTestJSON-1862037507 None] Volume volume-79cb5e3b-5576-4a1c-bdee-1d2dde6ab553 (79cb5e3b-5576-4a1c-bdee-1d2dde6ab553): created successfully Jul 07 08:25:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6d974f44-323a-488d-8956-1b5c1dddaead tempest-VolumesSnapshotTestJSON-1862037507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2ba7903-0cda-482c-9e1d-dcaf41fe4a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-6d974f44-323a-488d-8956-1b5c1dddaead tempest-VolumesSnapshotTestJSON-1862037507 None] Flow 'volume_create_manager' (a4ea9564-4bfd-4f24-8f51-5579392eed7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:25:20 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-6d974f44-323a-488d-8956-1b5c1dddaead tempest-VolumesSnapshotTestJSON-1862037507 None] Created volume successfully. Jul 07 08:25:21 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a5b8d4eb-ecbf-41c3-81f7-628618d0857d tempest-VolumesSnapshotTestJSON-1862037507 None] Acquiring lock "cinder-79cb5e3b-5576-4a1c-bdee-1d2dde6ab553-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:25:21 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a5b8d4eb-ecbf-41c3-81f7-628618d0857d tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "cinder-79cb5e3b-5576-4a1c-bdee-1d2dde6ab553-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:25:21 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a5b8d4eb-ecbf-41c3-81f7-628618d0857d tempest-VolumesSnapshotTestJSON-1862037507 None] Acquiring lock "cinder-quobyte-79cb5e3b-5576-4a1c-bdee-1d2dde6ab553" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:25:21 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a5b8d4eb-ecbf-41c3-81f7-628618d0857d tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "cinder-quobyte-79cb5e3b-5576-4a1c-bdee-1d2dde6ab553" acquired by "delete_volume" :: waited 0.036s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:25:21 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[869a0563-e274-432f-9d38-3aa551d2c1a2]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:25:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a5b8d4eb-ecbf-41c3-81f7-628618d0857d tempest-VolumesSnapshotTestJSON-1862037507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-79cb5e3b-5576-4a1c-bdee-1d2dde6ab553 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:21 devstack sudo[98374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-79cb5e3b-5576-4a1c-bdee-1d2dde6ab553 Jul 07 08:25:21 devstack sudo[98374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:22 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2512131-5ed1-4b3a-856f-70c078589cc5 tempest-VolumesTransfersV357Test-1961313587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:25:22 devstack sudo[98374]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:22 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e2512131-5ed1-4b3a-856f-70c078589cc5 tempest-VolumesTransfersV357Test-1961313587 None] Flow 'volume_create_manager' (76674289-76c9-4419-8347-9ff51bd0f801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:25:22 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e2512131-5ed1-4b3a-856f-70c078589cc5 tempest-VolumesTransfersV357Test-1961313587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d75195d-2b32-4dd4-943c-b3a253e00b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a5b8d4eb-ecbf-41c3-81f7-628618d0857d tempest-VolumesSnapshotTestJSON-1862037507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-79cb5e3b-5576-4a1c-bdee-1d2dde6ab553" returned: 0 in 1.521s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a5b8d4eb-ecbf-41c3-81f7-628618d0857d tempest-VolumesSnapshotTestJSON-1862037507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-79cb5e3b-5576-4a1c-bdee-1d2dde6ab553 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:22 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e2512131-5ed1-4b3a-856f-70c078589cc5 tempest-VolumesTransfersV357Test-1961313587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d75195d-2b32-4dd4-943c-b3a253e00b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1694935492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6f386ce-d056-4f24-a2c6-90fe7dcdf6db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abf2cee743644b7f8db506f7b456edbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:25:23Z,use_quota=True,user_id='3490c28eb6714694b343d2fd83e53f0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:22 devstack sudo[98379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-79cb5e3b-5576-4a1c-bdee-1d2dde6ab553 Jul 07 08:25:22 devstack sudo[98379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:22 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e2512131-5ed1-4b3a-856f-70c078589cc5 tempest-VolumesTransfersV357Test-1961313587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (331c87aa-b760-4fa8-a873-7fd17a5cbaa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:22 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e2512131-5ed1-4b3a-856f-70c078589cc5 tempest-VolumesTransfersV357Test-1961313587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (331c87aa-b760-4fa8-a873-7fd17a5cbaa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:22 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e2512131-5ed1-4b3a-856f-70c078589cc5 tempest-VolumesTransfersV357Test-1961313587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68e838d4-0583-41eb-8467-4d4042434e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:22 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e2512131-5ed1-4b3a-856f-70c078589cc5 tempest-VolumesTransfersV357Test-1961313587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68e838d4-0583-41eb-8467-4d4042434e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6f386ce-d056-4f24-a2c6-90fe7dcdf6db', 'volume_name': 'volume-b6f386ce-d056-4f24-a2c6-90fe7dcdf6db', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:22 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e2512131-5ed1-4b3a-856f-70c078589cc5 tempest-VolumesTransfersV357Test-1961313587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3c1e66b-ac7c-46b6-8e52-9b24c020dd24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:22 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e2512131-5ed1-4b3a-856f-70c078589cc5 tempest-VolumesTransfersV357Test-1961313587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3c1e66b-ac7c-46b6-8e52-9b24c020dd24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:22 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e2512131-5ed1-4b3a-856f-70c078589cc5 tempest-VolumesTransfersV357Test-1961313587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65c8aa2b-6168-4dbe-a994-b8e658b2b668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:22 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-e2512131-5ed1-4b3a-856f-70c078589cc5 tempest-VolumesTransfersV357Test-1961313587 None] Volume b6f386ce-d056-4f24-a2c6-90fe7dcdf6db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6f386ce-d056-4f24-a2c6-90fe7dcdf6db', 'volume_size': 1} Jul 07 08:25:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e2512131-5ed1-4b3a-856f-70c078589cc5 tempest-VolumesTransfersV357Test-1961313587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e2512131-5ed1-4b3a-856f-70c078589cc5 tempest-VolumesTransfersV357Test-1961313587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:22 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e2512131-5ed1-4b3a-856f-70c078589cc5 tempest-VolumesTransfersV357Test-1961313587 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1694935492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6f386ce-d056-4f24-a2c6-90fe7dcdf6db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abf2cee743644b7f8db506f7b456edbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:25:23Z,use_quota=True,user_id='3490c28eb6714694b343d2fd83e53f0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:25:22 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-e2512131-5ed1-4b3a-856f-70c078589cc5 tempest-VolumesTransfersV357Test-1961313587 None] Creating volume b6f386ce-d056-4f24-a2c6-90fe7dcdf6db {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:25:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e2512131-5ed1-4b3a-856f-70c078589cc5 tempest-VolumesTransfersV357Test-1961313587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e2512131-5ed1-4b3a-856f-70c078589cc5 tempest-VolumesTransfersV357Test-1961313587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:22 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e2512131-5ed1-4b3a-856f-70c078589cc5 tempest-VolumesTransfersV357Test-1961313587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:25:22 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e2512131-5ed1-4b3a-856f-70c078589cc5 tempest-VolumesTransfersV357Test-1961313587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:25:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e2512131-5ed1-4b3a-856f-70c078589cc5 tempest-VolumesTransfersV357Test-1961313587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:22 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e2512131-5ed1-4b3a-856f-70c078589cc5 tempest-VolumesTransfersV357Test-1961313587 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:25:22 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-e2512131-5ed1-4b3a-856f-70c078589cc5 tempest-VolumesTransfersV357Test-1961313587 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:25:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e2512131-5ed1-4b3a-856f-70c078589cc5 tempest-VolumesTransfersV357Test-1961313587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b6f386ce-d056-4f24-a2c6-90fe7dcdf6db 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:23 devstack sudo[98381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b6f386ce-d056-4f24-a2c6-90fe7dcdf6db 1073741824 Jul 07 08:25:23 devstack sudo[98381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:23 devstack sudo[98379]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a5b8d4eb-ecbf-41c3-81f7-628618d0857d tempest-VolumesSnapshotTestJSON-1862037507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-79cb5e3b-5576-4a1c-bdee-1d2dde6ab553" returned: 0 in 1.003s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:23 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a5b8d4eb-ecbf-41c3-81f7-628618d0857d tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "cinder-quobyte-79cb5e3b-5576-4a1c-bdee-1d2dde6ab553" released by "delete_volume" :: held 2.596s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:25:23 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-a5b8d4eb-ecbf-41c3-81f7-628618d0857d tempest-VolumesSnapshotTestJSON-1862037507 None] Created reservations ['2ee23799-2dc7-4f8d-b041-1a398e68417b', 'fe98861b-f214-4cc6-b78a-69ad4ba65e9e', '7dc75ec2-e8a6-450e-9bb9-54f1abc6abb6', 'a5039e91-6c15-4d35-bb2f-f7ba5345c4e1'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:25:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a5b8d4eb-ecbf-41c3-81f7-628618d0857d tempest-VolumesSnapshotTestJSON-1862037507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a5b8d4eb-ecbf-41c3-81f7-628618d0857d tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:24 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a5b8d4eb-ecbf-41c3-81f7-628618d0857d tempest-VolumesSnapshotTestJSON-1862037507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:25:24 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a5b8d4eb-ecbf-41c3-81f7-628618d0857d tempest-VolumesSnapshotTestJSON-1862037507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:25:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a5b8d4eb-ecbf-41c3-81f7-628618d0857d tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a5b8d4eb-ecbf-41c3-81f7-628618d0857d tempest-VolumesSnapshotTestJSON-1862037507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:24 devstack sudo[98389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:25:24 devstack sudo[98389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:24 devstack sudo[98381]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e2512131-5ed1-4b3a-856f-70c078589cc5 tempest-VolumesTransfersV357Test-1961313587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b6f386ce-d056-4f24-a2c6-90fe7dcdf6db 1073741824" returned: 0 in 1.416s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e2512131-5ed1-4b3a-856f-70c078589cc5 tempest-VolumesTransfersV357Test-1961313587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b6f386ce-d056-4f24-a2c6-90fe7dcdf6db {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:24 devstack sudo[98392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b6f386ce-d056-4f24-a2c6-90fe7dcdf6db Jul 07 08:25:24 devstack sudo[98392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-02db7a87-fba6-4e51-b6d0-fb10ef86e6bd tempest-VolumesSnapshotTestJSON-1862037507 None] Acquiring lock "cinder-602c450a-acfd-4716-bc00-a9ab5a3f1ac3-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:25:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-02db7a87-fba6-4e51-b6d0-fb10ef86e6bd tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "cinder-602c450a-acfd-4716-bc00-a9ab5a3f1ac3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:25:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-02db7a87-fba6-4e51-b6d0-fb10ef86e6bd tempest-VolumesSnapshotTestJSON-1862037507 None] Acquiring lock "cinder-quobyte-07fd59c1-109d-4271-bd52-646241ecacea" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:25:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-02db7a87-fba6-4e51-b6d0-fb10ef86e6bd tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "cinder-quobyte-07fd59c1-109d-4271-bd52-646241ecacea" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:25:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-02db7a87-fba6-4e51-b6d0-fb10ef86e6bd tempest-VolumesSnapshotTestJSON-1862037507 None] Acquiring lock "cinder-quobyte-602c450a-acfd-4716-bc00-a9ab5a3f1ac3" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:25:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-02db7a87-fba6-4e51-b6d0-fb10ef86e6bd tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "cinder-quobyte-602c450a-acfd-4716-bc00-a9ab5a3f1ac3" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:25:24 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-02db7a87-fba6-4e51-b6d0-fb10ef86e6bd tempest-VolumesSnapshotTestJSON-1862037507 None] Deleting offline snapshot 602c450a-acfd-4716-bc00-a9ab5a3f1ac3 of volume 07fd59c1-109d-4271-bd52-646241ecacea {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:25:24 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-02db7a87-fba6-4e51-b6d0-fb10ef86e6bd tempest-VolumesSnapshotTestJSON-1862037507 None] snapshot_file for this snap is: volume-07fd59c1-109d-4271-bd52-646241ecacea.602c450a-acfd-4716-bc00-a9ab5a3f1ac3 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:25:24 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[179854d9-ca53-45c0-8017-ef1ebf1b0852]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:25:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-02db7a87-fba6-4e51-b6d0-fb10ef86e6bd tempest-VolumesSnapshotTestJSON-1862037507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07fd59c1-109d-4271-bd52-646241ecacea.602c450a-acfd-4716-bc00-a9ab5a3f1ac3 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:25 devstack sudo[98394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07fd59c1-109d-4271-bd52-646241ecacea.602c450a-acfd-4716-bc00-a9ab5a3f1ac3 Jul 07 08:25:25 devstack sudo[98394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:25 devstack sudo[98389]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a5b8d4eb-ecbf-41c3-81f7-628618d0857d tempest-VolumesSnapshotTestJSON-1862037507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 1.261s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:25 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-a5b8d4eb-ecbf-41c3-81f7-628618d0857d tempest-VolumesSnapshotTestJSON-1862037507 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:25:25 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-a5b8d4eb-ecbf-41c3-81f7-628618d0857d tempest-VolumesSnapshotTestJSON-1862037507 None] Deleted volume successfully. Jul 07 08:25:25 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a5b8d4eb-ecbf-41c3-81f7-628618d0857d tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "cinder-79cb5e3b-5576-4a1c-bdee-1d2dde6ab553-delete_volume" released by "delete_volume" :: held 4.256s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:25:25 devstack sudo[98392]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e2512131-5ed1-4b3a-856f-70c078589cc5 tempest-VolumesTransfersV357Test-1961313587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b6f386ce-d056-4f24-a2c6-90fe7dcdf6db" returned: 0 in 1.231s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:25 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e2512131-5ed1-4b3a-856f-70c078589cc5 tempest-VolumesTransfersV357Test-1961313587 None] <== create_volume: return (2732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:25:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e2512131-5ed1-4b3a-856f-70c078589cc5 tempest-VolumesTransfersV357Test-1961313587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.737s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:25 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e2512131-5ed1-4b3a-856f-70c078589cc5 tempest-VolumesTransfersV357Test-1961313587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65c8aa2b-6168-4dbe-a994-b8e658b2b668) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6f386ce-d056-4f24-a2c6-90fe7dcdf6db', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:25 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e2512131-5ed1-4b3a-856f-70c078589cc5 tempest-VolumesTransfersV357Test-1961313587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a1de707-5899-405f-807e-055f264f8877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:25 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-e2512131-5ed1-4b3a-856f-70c078589cc5 tempest-VolumesTransfersV357Test-1961313587 None] Volume volume-b6f386ce-d056-4f24-a2c6-90fe7dcdf6db (b6f386ce-d056-4f24-a2c6-90fe7dcdf6db): created successfully Jul 07 08:25:25 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e2512131-5ed1-4b3a-856f-70c078589cc5 tempest-VolumesTransfersV357Test-1961313587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a1de707-5899-405f-807e-055f264f8877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:25 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e2512131-5ed1-4b3a-856f-70c078589cc5 tempest-VolumesTransfersV357Test-1961313587 None] Flow 'volume_create_manager' (76674289-76c9-4419-8347-9ff51bd0f801) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:25:25 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-e2512131-5ed1-4b3a-856f-70c078589cc5 tempest-VolumesTransfersV357Test-1961313587 None] Created volume successfully. Jul 07 08:25:25 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-70220d1c-2ac9-453c-9205-2200df3f0688 tempest-ProjectReaderTests-1858111303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:25:25 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-70220d1c-2ac9-453c-9205-2200df3f0688 tempest-ProjectReaderTests-1858111303 None] Flow 'volume_create_manager' (38f9721b-2fd0-4b66-a066-3b3b26d964cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:25:25 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-70220d1c-2ac9-453c-9205-2200df3f0688 tempest-ProjectReaderTests-1858111303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afc9df55-4051-409d-aae8-c5e2309909b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:25 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-70220d1c-2ac9-453c-9205-2200df3f0688 tempest-ProjectReaderTests-1858111303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afc9df55-4051-409d-aae8-c5e2309909b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:25:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-52610566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1a985e4-770d-44e8-ab5a-5128a911c4e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68e07939fad647ceb6e76c7e8c1929fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:25:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:25:26Z,use_quota=True,user_id='04b13a36a2f74922acee87db9997965c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:25 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-70220d1c-2ac9-453c-9205-2200df3f0688 tempest-ProjectReaderTests-1858111303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (902b6089-a5af-4fea-9797-d500aa81dec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:25 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-70220d1c-2ac9-453c-9205-2200df3f0688 tempest-ProjectReaderTests-1858111303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (902b6089-a5af-4fea-9797-d500aa81dec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:25 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-70220d1c-2ac9-453c-9205-2200df3f0688 tempest-ProjectReaderTests-1858111303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1226e229-3653-48c9-974b-7fbd1cb350f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:25 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-70220d1c-2ac9-453c-9205-2200df3f0688 tempest-ProjectReaderTests-1858111303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1226e229-3653-48c9-974b-7fbd1cb350f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1a985e4-770d-44e8-ab5a-5128a911c4e6', 'volume_name': 'volume-c1a985e4-770d-44e8-ab5a-5128a911c4e6', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:25 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-70220d1c-2ac9-453c-9205-2200df3f0688 tempest-ProjectReaderTests-1858111303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b91cf8f5-65d1-436f-9c07-1dee64cc895d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:25 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-70220d1c-2ac9-453c-9205-2200df3f0688 tempest-ProjectReaderTests-1858111303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b91cf8f5-65d1-436f-9c07-1dee64cc895d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:25 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-70220d1c-2ac9-453c-9205-2200df3f0688 tempest-ProjectReaderTests-1858111303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (199713f8-1e0c-4e90-abbf-0f35cb821460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:25 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-70220d1c-2ac9-453c-9205-2200df3f0688 tempest-ProjectReaderTests-1858111303 None] Volume c1a985e4-770d-44e8-ab5a-5128a911c4e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1a985e4-770d-44e8-ab5a-5128a911c4e6', 'volume_size': 1} Jul 07 08:25:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-70220d1c-2ac9-453c-9205-2200df3f0688 tempest-ProjectReaderTests-1858111303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-70220d1c-2ac9-453c-9205-2200df3f0688 tempest-ProjectReaderTests-1858111303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:25 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-70220d1c-2ac9-453c-9205-2200df3f0688 tempest-ProjectReaderTests-1858111303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:25:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-52610566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1a985e4-770d-44e8-ab5a-5128a911c4e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68e07939fad647ceb6e76c7e8c1929fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:25:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:25:26Z,use_quota=True,user_id='04b13a36a2f74922acee87db9997965c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:25:25 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-70220d1c-2ac9-453c-9205-2200df3f0688 tempest-ProjectReaderTests-1858111303 None] Creating volume c1a985e4-770d-44e8-ab5a-5128a911c4e6 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:25:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-70220d1c-2ac9-453c-9205-2200df3f0688 tempest-ProjectReaderTests-1858111303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-70220d1c-2ac9-453c-9205-2200df3f0688 tempest-ProjectReaderTests-1858111303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:25 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-70220d1c-2ac9-453c-9205-2200df3f0688 tempest-ProjectReaderTests-1858111303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:25:25 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-70220d1c-2ac9-453c-9205-2200df3f0688 tempest-ProjectReaderTests-1858111303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:25:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-70220d1c-2ac9-453c-9205-2200df3f0688 tempest-ProjectReaderTests-1858111303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:25 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-70220d1c-2ac9-453c-9205-2200df3f0688 tempest-ProjectReaderTests-1858111303 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:25:25 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-70220d1c-2ac9-453c-9205-2200df3f0688 tempest-ProjectReaderTests-1858111303 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:25:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-70220d1c-2ac9-453c-9205-2200df3f0688 tempest-ProjectReaderTests-1858111303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c1a985e4-770d-44e8-ab5a-5128a911c4e6 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:26 devstack sudo[98400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c1a985e4-770d-44e8-ab5a-5128a911c4e6 1073741824 Jul 07 08:25:26 devstack sudo[98400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:26 devstack sudo[98394]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-02db7a87-fba6-4e51-b6d0-fb10ef86e6bd tempest-VolumesSnapshotTestJSON-1862037507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07fd59c1-109d-4271-bd52-646241ecacea.602c450a-acfd-4716-bc00-a9ab5a3f1ac3" returned: 0 in 1.260s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:26 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-02db7a87-fba6-4e51-b6d0-fb10ef86e6bd tempest-VolumesSnapshotTestJSON-1862037507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07fd59c1-109d-4271-bd52-646241ecacea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:25:26 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e17950d-95aa-43d6-941e-03808e215911]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:25:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-02db7a87-fba6-4e51-b6d0-fb10ef86e6bd tempest-VolumesSnapshotTestJSON-1862037507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07fd59c1-109d-4271-bd52-646241ecacea {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:26 devstack sudo[98404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07fd59c1-109d-4271-bd52-646241ecacea Jul 07 08:25:26 devstack sudo[98404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:26 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-c1ef6954-0bd6-47d9-b08f-57d95a9b65e3 tempest-VolumesTransfersV357Test-480439215 None] Transfer volume completed successfully. Jul 07 08:25:27 devstack sudo[98400]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-70220d1c-2ac9-453c-9205-2200df3f0688 tempest-ProjectReaderTests-1858111303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c1a985e4-770d-44e8-ab5a-5128a911c4e6 1073741824" returned: 0 in 1.078s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-70220d1c-2ac9-453c-9205-2200df3f0688 tempest-ProjectReaderTests-1858111303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c1a985e4-770d-44e8-ab5a-5128a911c4e6 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:27 devstack sudo[98412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c1a985e4-770d-44e8-ab5a-5128a911c4e6 Jul 07 08:25:27 devstack sudo[98412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:27 devstack sudo[98404]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-02db7a87-fba6-4e51-b6d0-fb10ef86e6bd tempest-VolumesSnapshotTestJSON-1862037507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07fd59c1-109d-4271-bd52-646241ecacea" returned: 0 in 0.998s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-02db7a87-fba6-4e51-b6d0-fb10ef86e6bd tempest-VolumesSnapshotTestJSON-1862037507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07fd59c1-109d-4271-bd52-646241ecacea.602c450a-acfd-4716-bc00-a9ab5a3f1ac3 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:27 devstack sudo[98415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07fd59c1-109d-4271-bd52-646241ecacea.602c450a-acfd-4716-bc00-a9ab5a3f1ac3 Jul 07 08:25:27 devstack sudo[98415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:27 devstack sudo[98412]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-70220d1c-2ac9-453c-9205-2200df3f0688 tempest-ProjectReaderTests-1858111303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c1a985e4-770d-44e8-ab5a-5128a911c4e6" returned: 0 in 0.875s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:27 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-70220d1c-2ac9-453c-9205-2200df3f0688 tempest-ProjectReaderTests-1858111303 None] <== create_volume: return (2006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:25:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-70220d1c-2ac9-453c-9205-2200df3f0688 tempest-ProjectReaderTests-1858111303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-70220d1c-2ac9-453c-9205-2200df3f0688 tempest-ProjectReaderTests-1858111303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (199713f8-1e0c-4e90-abbf-0f35cb821460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1a985e4-770d-44e8-ab5a-5128a911c4e6', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-70220d1c-2ac9-453c-9205-2200df3f0688 tempest-ProjectReaderTests-1858111303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e849810-fd14-460b-abe5-82a4ad682d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:28 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-70220d1c-2ac9-453c-9205-2200df3f0688 tempest-ProjectReaderTests-1858111303 None] Volume volume-c1a985e4-770d-44e8-ab5a-5128a911c4e6 (c1a985e4-770d-44e8-ab5a-5128a911c4e6): created successfully Jul 07 08:25:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-70220d1c-2ac9-453c-9205-2200df3f0688 tempest-ProjectReaderTests-1858111303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e849810-fd14-460b-abe5-82a4ad682d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-70220d1c-2ac9-453c-9205-2200df3f0688 tempest-ProjectReaderTests-1858111303 None] Flow 'volume_create_manager' (38f9721b-2fd0-4b66-a066-3b3b26d964cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:25:28 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-70220d1c-2ac9-453c-9205-2200df3f0688 tempest-ProjectReaderTests-1858111303 None] Created volume successfully. Jul 07 08:25:28 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e120cfbc-56cf-4b26-b03b-a75f38d0b102 tempest-VolumesTransfersV357Test-152967431 None] Acquiring lock "cinder-b6f386ce-d056-4f24-a2c6-90fe7dcdf6db-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:25:28 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e120cfbc-56cf-4b26-b03b-a75f38d0b102 tempest-VolumesTransfersV357Test-152967431 None] Lock "cinder-b6f386ce-d056-4f24-a2c6-90fe7dcdf6db-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:25:28 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e120cfbc-56cf-4b26-b03b-a75f38d0b102 tempest-VolumesTransfersV357Test-152967431 None] Acquiring lock "cinder-quobyte-b6f386ce-d056-4f24-a2c6-90fe7dcdf6db" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:25:28 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e120cfbc-56cf-4b26-b03b-a75f38d0b102 tempest-VolumesTransfersV357Test-152967431 None] Lock "cinder-quobyte-b6f386ce-d056-4f24-a2c6-90fe7dcdf6db" acquired by "delete_volume" :: waited 0.027s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:25:28 devstack sudo[98415]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-02db7a87-fba6-4e51-b6d0-fb10ef86e6bd tempest-VolumesSnapshotTestJSON-1862037507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07fd59c1-109d-4271-bd52-646241ecacea.602c450a-acfd-4716-bc00-a9ab5a3f1ac3" returned: 0 in 1.115s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-02db7a87-fba6-4e51-b6d0-fb10ef86e6bd tempest-VolumesSnapshotTestJSON-1862037507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07fd59c1-109d-4271-bd52-646241ecacea.602c450a-acfd-4716-bc00-a9ab5a3f1ac3 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:28 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[f385e582-0fb7-464f-9ba8-7138e26ea076]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:25:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e120cfbc-56cf-4b26-b03b-a75f38d0b102 tempest-VolumesTransfersV357Test-152967431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b6f386ce-d056-4f24-a2c6-90fe7dcdf6db {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:28 devstack sudo[98449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07fd59c1-109d-4271-bd52-646241ecacea.602c450a-acfd-4716-bc00-a9ab5a3f1ac3 Jul 07 08:25:28 devstack sudo[98449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:28 devstack sudo[98450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b6f386ce-d056-4f24-a2c6-90fe7dcdf6db Jul 07 08:25:28 devstack sudo[98450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:29 devstack sudo[98449]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-02db7a87-fba6-4e51-b6d0-fb10ef86e6bd tempest-VolumesSnapshotTestJSON-1862037507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07fd59c1-109d-4271-bd52-646241ecacea.602c450a-acfd-4716-bc00-a9ab5a3f1ac3" returned: 0 in 0.708s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:29 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-02db7a87-fba6-4e51-b6d0-fb10ef86e6bd tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "cinder-quobyte-602c450a-acfd-4716-bc00-a9ab5a3f1ac3" released by "_delete_snapshot" :: held 4.215s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:25:29 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-02db7a87-fba6-4e51-b6d0-fb10ef86e6bd tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "cinder-quobyte-07fd59c1-109d-4271-bd52-646241ecacea" released by "delete_snapshot" :: held 4.273s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:25:29 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-02db7a87-fba6-4e51-b6d0-fb10ef86e6bd tempest-VolumesSnapshotTestJSON-1862037507 None] Created reservations ['8ffd192f-e910-4f1e-b37d-b5d5381c5518', 'cdae361f-a9d7-492d-a767-85fbd5867ade', '424d2396-926e-4f2a-8d98-17a805311e0a', '54d6b622-23a8-4ae6-9388-15f68cebecd4'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:25:29 devstack sudo[98450]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e120cfbc-56cf-4b26-b03b-a75f38d0b102 tempest-VolumesTransfersV357Test-152967431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b6f386ce-d056-4f24-a2c6-90fe7dcdf6db" returned: 0 in 0.837s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e120cfbc-56cf-4b26-b03b-a75f38d0b102 tempest-VolumesTransfersV357Test-152967431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b6f386ce-d056-4f24-a2c6-90fe7dcdf6db {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:29 devstack sudo[98457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b6f386ce-d056-4f24-a2c6-90fe7dcdf6db Jul 07 08:25:29 devstack sudo[98457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:29 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-374c5785-90dc-4bdc-a518-216cb6777e82 tempest-ProjectReaderTests-1858111303 None] Acquiring lock "cinder-c1a985e4-770d-44e8-ab5a-5128a911c4e6-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:25:29 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-02db7a87-fba6-4e51-b6d0-fb10ef86e6bd tempest-VolumesSnapshotTestJSON-1862037507 None] Delete snapshot completed successfully. Jul 07 08:25:29 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-374c5785-90dc-4bdc-a518-216cb6777e82 tempest-ProjectReaderTests-1858111303 None] Lock "cinder-c1a985e4-770d-44e8-ab5a-5128a911c4e6-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:25:29 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-02db7a87-fba6-4e51-b6d0-fb10ef86e6bd tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "cinder-602c450a-acfd-4716-bc00-a9ab5a3f1ac3-delete_snapshot" released by "delete_snapshot" :: held 4.522s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:25:29 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-374c5785-90dc-4bdc-a518-216cb6777e82 tempest-ProjectReaderTests-1858111303 None] Acquiring lock "cinder-quobyte-c1a985e4-770d-44e8-ab5a-5128a911c4e6" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:25:29 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-374c5785-90dc-4bdc-a518-216cb6777e82 tempest-ProjectReaderTests-1858111303 None] Lock "cinder-quobyte-c1a985e4-770d-44e8-ab5a-5128a911c4e6" acquired by "delete_volume" :: waited 0.016s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:25:29 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e22605e-39ab-4e45-8b4a-0c5a3d5436f2]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:25:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-374c5785-90dc-4bdc-a518-216cb6777e82 tempest-ProjectReaderTests-1858111303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c1a985e4-770d-44e8-ab5a-5128a911c4e6 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:29 devstack sudo[98459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c1a985e4-770d-44e8-ab5a-5128a911c4e6 Jul 07 08:25:29 devstack sudo[98459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:29 devstack sudo[98457]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e120cfbc-56cf-4b26-b03b-a75f38d0b102 tempest-VolumesTransfersV357Test-152967431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b6f386ce-d056-4f24-a2c6-90fe7dcdf6db" returned: 0 in 0.674s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:29 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e120cfbc-56cf-4b26-b03b-a75f38d0b102 tempest-VolumesTransfersV357Test-152967431 None] Lock "cinder-quobyte-b6f386ce-d056-4f24-a2c6-90fe7dcdf6db" released by "delete_volume" :: held 1.571s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:25:29 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-e120cfbc-56cf-4b26-b03b-a75f38d0b102 tempest-VolumesTransfersV357Test-152967431 None] Created reservations ['b2013670-5f29-4ab8-9a1d-42b96ca62c50', '309fa8d3-a9bb-43b1-a74a-be622af33b1b', '7464531d-ba35-4115-8fbf-728f6f087221', '9a13896f-7e37-4332-803b-57a021026047'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:25:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e120cfbc-56cf-4b26-b03b-a75f38d0b102 tempest-VolumesTransfersV357Test-152967431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e120cfbc-56cf-4b26-b03b-a75f38d0b102 tempest-VolumesTransfersV357Test-152967431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:30 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e120cfbc-56cf-4b26-b03b-a75f38d0b102 tempest-VolumesTransfersV357Test-152967431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:25:30 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e120cfbc-56cf-4b26-b03b-a75f38d0b102 tempest-VolumesTransfersV357Test-152967431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:25:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e120cfbc-56cf-4b26-b03b-a75f38d0b102 tempest-VolumesTransfersV357Test-152967431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e120cfbc-56cf-4b26-b03b-a75f38d0b102 tempest-VolumesTransfersV357Test-152967431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:30 devstack sudo[98462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:25:30 devstack sudo[98462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:30 devstack sudo[98459]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-374c5785-90dc-4bdc-a518-216cb6777e82 tempest-ProjectReaderTests-1858111303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c1a985e4-770d-44e8-ab5a-5128a911c4e6" returned: 0 in 0.846s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-374c5785-90dc-4bdc-a518-216cb6777e82 tempest-ProjectReaderTests-1858111303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c1a985e4-770d-44e8-ab5a-5128a911c4e6 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:30 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4c4b5ac3-5270-4978-9da9-7acbc3df90d9 tempest-VolumesSnapshotTestJSON-1862037507 None] Acquiring lock "cinder-07fd59c1-109d-4271-bd52-646241ecacea-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:25:30 devstack sudo[98467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c1a985e4-770d-44e8-ab5a-5128a911c4e6 Jul 07 08:25:30 devstack sudo[98467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:30 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4c4b5ac3-5270-4978-9da9-7acbc3df90d9 tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "cinder-07fd59c1-109d-4271-bd52-646241ecacea-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:25:30 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4c4b5ac3-5270-4978-9da9-7acbc3df90d9 tempest-VolumesSnapshotTestJSON-1862037507 None] Acquiring lock "cinder-quobyte-07fd59c1-109d-4271-bd52-646241ecacea" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:25:30 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4c4b5ac3-5270-4978-9da9-7acbc3df90d9 tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "cinder-quobyte-07fd59c1-109d-4271-bd52-646241ecacea" acquired by "delete_volume" :: waited 0.019s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:25:30 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd177938-6eaa-4798-abda-376c2ce576c7]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:25:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4c4b5ac3-5270-4978-9da9-7acbc3df90d9 tempest-VolumesSnapshotTestJSON-1862037507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07fd59c1-109d-4271-bd52-646241ecacea {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:30 devstack sudo[98469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07fd59c1-109d-4271-bd52-646241ecacea Jul 07 08:25:30 devstack sudo[98469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:30 devstack sudo[98462]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e120cfbc-56cf-4b26-b03b-a75f38d0b102 tempest-VolumesTransfersV357Test-152967431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.705s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:30 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-e120cfbc-56cf-4b26-b03b-a75f38d0b102 tempest-VolumesTransfersV357Test-152967431 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:25:30 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-e120cfbc-56cf-4b26-b03b-a75f38d0b102 tempest-VolumesTransfersV357Test-152967431 None] Deleted volume successfully. Jul 07 08:25:30 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e120cfbc-56cf-4b26-b03b-a75f38d0b102 tempest-VolumesTransfersV357Test-152967431 None] Lock "cinder-b6f386ce-d056-4f24-a2c6-90fe7dcdf6db-delete_volume" released by "delete_volume" :: held 2.541s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:25:31 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4f6c302-ff04-46d4-a142-c8241d72cc72 tempest-VolumesTransfersV357Test-1961313587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:25:31 devstack sudo[98467]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:31 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a4f6c302-ff04-46d4-a142-c8241d72cc72 tempest-VolumesTransfersV357Test-1961313587 None] Flow 'volume_create_manager' (d803a1f1-815b-400a-aed7-87e40276de96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:25:31 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a4f6c302-ff04-46d4-a142-c8241d72cc72 tempest-VolumesTransfersV357Test-1961313587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7bb6930-7ecf-4eb9-978f-5f36b559ad73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-374c5785-90dc-4bdc-a518-216cb6777e82 tempest-ProjectReaderTests-1858111303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c1a985e4-770d-44e8-ab5a-5128a911c4e6" returned: 0 in 0.895s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:31 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a4f6c302-ff04-46d4-a142-c8241d72cc72 tempest-VolumesTransfersV357Test-1961313587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7bb6930-7ecf-4eb9-978f-5f36b559ad73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1794814132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=869d905b-9c4b-41e9-bb37-1d9d7bb49b13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abf2cee743644b7f8db506f7b456edbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:25:31Z,use_quota=True,user_id='3490c28eb6714694b343d2fd83e53f0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:31 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a4f6c302-ff04-46d4-a142-c8241d72cc72 tempest-VolumesTransfersV357Test-1961313587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c69ae4de-83d5-42a0-b3f8-dff0d9c33b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:31 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a4f6c302-ff04-46d4-a142-c8241d72cc72 tempest-VolumesTransfersV357Test-1961313587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c69ae4de-83d5-42a0-b3f8-dff0d9c33b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:31 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a4f6c302-ff04-46d4-a142-c8241d72cc72 tempest-VolumesTransfersV357Test-1961313587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a3ced97-eebf-48ab-8d23-2db7e6ddc8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:31 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a4f6c302-ff04-46d4-a142-c8241d72cc72 tempest-VolumesTransfersV357Test-1961313587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a3ced97-eebf-48ab-8d23-2db7e6ddc8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '869d905b-9c4b-41e9-bb37-1d9d7bb49b13', 'volume_name': 'volume-869d905b-9c4b-41e9-bb37-1d9d7bb49b13', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:31 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a4f6c302-ff04-46d4-a142-c8241d72cc72 tempest-VolumesTransfersV357Test-1961313587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdfbaba0-8419-4596-b9a9-3f284a9093c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:31 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a4f6c302-ff04-46d4-a142-c8241d72cc72 tempest-VolumesTransfersV357Test-1961313587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdfbaba0-8419-4596-b9a9-3f284a9093c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:31 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a4f6c302-ff04-46d4-a142-c8241d72cc72 tempest-VolumesTransfersV357Test-1961313587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e36a341-ccda-4c48-a795-0cac5608cec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:31 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-a4f6c302-ff04-46d4-a142-c8241d72cc72 tempest-VolumesTransfersV357Test-1961313587 None] Volume 869d905b-9c4b-41e9-bb37-1d9d7bb49b13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-869d905b-9c4b-41e9-bb37-1d9d7bb49b13', 'volume_size': 1} Jul 07 08:25:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a4f6c302-ff04-46d4-a142-c8241d72cc72 tempest-VolumesTransfersV357Test-1961313587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a4f6c302-ff04-46d4-a142-c8241d72cc72 tempest-VolumesTransfersV357Test-1961313587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:31 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a4f6c302-ff04-46d4-a142-c8241d72cc72 tempest-VolumesTransfersV357Test-1961313587 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1794814132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=869d905b-9c4b-41e9-bb37-1d9d7bb49b13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abf2cee743644b7f8db506f7b456edbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:25:31Z,use_quota=True,user_id='3490c28eb6714694b343d2fd83e53f0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:25:31 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-a4f6c302-ff04-46d4-a142-c8241d72cc72 tempest-VolumesTransfersV357Test-1961313587 None] Creating volume 869d905b-9c4b-41e9-bb37-1d9d7bb49b13 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:25:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a4f6c302-ff04-46d4-a142-c8241d72cc72 tempest-VolumesTransfersV357Test-1961313587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a4f6c302-ff04-46d4-a142-c8241d72cc72 tempest-VolumesTransfersV357Test-1961313587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:31 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a4f6c302-ff04-46d4-a142-c8241d72cc72 tempest-VolumesTransfersV357Test-1961313587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:25:31 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a4f6c302-ff04-46d4-a142-c8241d72cc72 tempest-VolumesTransfersV357Test-1961313587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:25:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a4f6c302-ff04-46d4-a142-c8241d72cc72 tempest-VolumesTransfersV357Test-1961313587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:31 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a4f6c302-ff04-46d4-a142-c8241d72cc72 tempest-VolumesTransfersV357Test-1961313587 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:25:31 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-a4f6c302-ff04-46d4-a142-c8241d72cc72 tempest-VolumesTransfersV357Test-1961313587 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:25:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a4f6c302-ff04-46d4-a142-c8241d72cc72 tempest-VolumesTransfersV357Test-1961313587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-869d905b-9c4b-41e9-bb37-1d9d7bb49b13 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:31 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-374c5785-90dc-4bdc-a518-216cb6777e82 tempest-ProjectReaderTests-1858111303 None] Lock "cinder-quobyte-c1a985e4-770d-44e8-ab5a-5128a911c4e6" released by "delete_volume" :: held 1.869s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:25:31 devstack sudo[98478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-869d905b-9c4b-41e9-bb37-1d9d7bb49b13 1073741824 Jul 07 08:25:31 devstack sudo[98478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:31 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-374c5785-90dc-4bdc-a518-216cb6777e82 tempest-ProjectReaderTests-1858111303 None] Created reservations ['1bd9443b-7658-4690-bb8e-24f82dd73548', '557d9dd7-f51d-45d3-8958-dfdb226029ea', '3474e7dc-03c5-4d6d-8248-d9c180c80683', '90a34c53-720b-40f7-97a9-9d064ea1e9d2'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:25:31 devstack sudo[98469]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4c4b5ac3-5270-4978-9da9-7acbc3df90d9 tempest-VolumesSnapshotTestJSON-1862037507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07fd59c1-109d-4271-bd52-646241ecacea" returned: 0 in 0.934s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4c4b5ac3-5270-4978-9da9-7acbc3df90d9 tempest-VolumesSnapshotTestJSON-1862037507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07fd59c1-109d-4271-bd52-646241ecacea {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:31 devstack sudo[98494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07fd59c1-109d-4271-bd52-646241ecacea Jul 07 08:25:31 devstack sudo[98494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-374c5785-90dc-4bdc-a518-216cb6777e82 tempest-ProjectReaderTests-1858111303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-374c5785-90dc-4bdc-a518-216cb6777e82 tempest-ProjectReaderTests-1858111303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:31 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-374c5785-90dc-4bdc-a518-216cb6777e82 tempest-ProjectReaderTests-1858111303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:25:31 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-374c5785-90dc-4bdc-a518-216cb6777e82 tempest-ProjectReaderTests-1858111303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:25:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-374c5785-90dc-4bdc-a518-216cb6777e82 tempest-ProjectReaderTests-1858111303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-374c5785-90dc-4bdc-a518-216cb6777e82 tempest-ProjectReaderTests-1858111303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:31 devstack sudo[98516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:25:31 devstack sudo[98516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:32 devstack sudo[98494]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4c4b5ac3-5270-4978-9da9-7acbc3df90d9 tempest-VolumesSnapshotTestJSON-1862037507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07fd59c1-109d-4271-bd52-646241ecacea" returned: 0 in 0.898s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:32 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4c4b5ac3-5270-4978-9da9-7acbc3df90d9 tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "cinder-quobyte-07fd59c1-109d-4271-bd52-646241ecacea" released by "delete_volume" :: held 1.933s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:25:32 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-1567ada0-07f9-42e2-b90e-601925151e49 tempest-ProjectReaderTests-1858111303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:25:32 devstack sudo[98516]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1567ada0-07f9-42e2-b90e-601925151e49 tempest-ProjectReaderTests-1858111303 None] Flow 'volume_create_manager' (b8cf4e21-2073-492a-aeac-896bd6314697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:25:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1567ada0-07f9-42e2-b90e-601925151e49 tempest-ProjectReaderTests-1858111303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8714fdfd-f0b7-4ef7-bd91-ff4e0c68f7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-374c5785-90dc-4bdc-a518-216cb6777e82 tempest-ProjectReaderTests-1858111303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.836s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:32 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-374c5785-90dc-4bdc-a518-216cb6777e82 tempest-ProjectReaderTests-1858111303 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:25:32 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-374c5785-90dc-4bdc-a518-216cb6777e82 tempest-ProjectReaderTests-1858111303 None] Deleted volume successfully. Jul 07 08:25:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1567ada0-07f9-42e2-b90e-601925151e49 tempest-ProjectReaderTests-1858111303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8714fdfd-f0b7-4ef7-bd91-ff4e0c68f7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:25:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1474335793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79045ebe-2140-4595-ba68-fbf59f7b84a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68e07939fad647ceb6e76c7e8c1929fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:25:32Z,use_quota=True,user_id='04b13a36a2f74922acee87db9997965c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1567ada0-07f9-42e2-b90e-601925151e49 tempest-ProjectReaderTests-1858111303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52878a9e-5bb4-46be-9edb-2ed2ccfbd4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1567ada0-07f9-42e2-b90e-601925151e49 tempest-ProjectReaderTests-1858111303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52878a9e-5bb4-46be-9edb-2ed2ccfbd4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1567ada0-07f9-42e2-b90e-601925151e49 tempest-ProjectReaderTests-1858111303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d7e3e64-8aca-47ea-bf45-d3e7361bc2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1567ada0-07f9-42e2-b90e-601925151e49 tempest-ProjectReaderTests-1858111303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d7e3e64-8aca-47ea-bf45-d3e7361bc2a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79045ebe-2140-4595-ba68-fbf59f7b84a0', 'volume_name': 'volume-79045ebe-2140-4595-ba68-fbf59f7b84a0', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1567ada0-07f9-42e2-b90e-601925151e49 tempest-ProjectReaderTests-1858111303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5229e85-0e97-41bf-8d7c-38a56e2b250c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1567ada0-07f9-42e2-b90e-601925151e49 tempest-ProjectReaderTests-1858111303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5229e85-0e97-41bf-8d7c-38a56e2b250c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1567ada0-07f9-42e2-b90e-601925151e49 tempest-ProjectReaderTests-1858111303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f61b1d10-45e9-414d-97c1-fca290538c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:32 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-1567ada0-07f9-42e2-b90e-601925151e49 tempest-ProjectReaderTests-1858111303 None] Volume 79045ebe-2140-4595-ba68-fbf59f7b84a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79045ebe-2140-4595-ba68-fbf59f7b84a0', 'volume_size': 1} Jul 07 08:25:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1567ada0-07f9-42e2-b90e-601925151e49 tempest-ProjectReaderTests-1858111303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:32 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-4c4b5ac3-5270-4978-9da9-7acbc3df90d9 tempest-VolumesSnapshotTestJSON-1862037507 None] Created reservations ['a1a16b3d-b8bc-4dfe-a87c-9c23ac823827', '9c0c3e6e-6cee-4050-bc41-d6f494120823', '8921d2d8-2331-43d4-ba67-0c6032e866da', '82b9d216-8c4d-46f0-bc25-756a9a8ad90b'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:25:32 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-374c5785-90dc-4bdc-a518-216cb6777e82 tempest-ProjectReaderTests-1858111303 None] Lock "cinder-c1a985e4-770d-44e8-ab5a-5128a911c4e6-delete_volume" released by "delete_volume" :: held 3.187s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:25:32 devstack sudo[98478]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a4f6c302-ff04-46d4-a142-c8241d72cc72 tempest-VolumesTransfersV357Test-1961313587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-869d905b-9c4b-41e9-bb37-1d9d7bb49b13 1073741824" returned: 0 in 1.278s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a4f6c302-ff04-46d4-a142-c8241d72cc72 tempest-VolumesTransfersV357Test-1961313587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-869d905b-9c4b-41e9-bb37-1d9d7bb49b13 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4c4b5ac3-5270-4978-9da9-7acbc3df90d9 tempest-VolumesSnapshotTestJSON-1862037507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4c4b5ac3-5270-4978-9da9-7acbc3df90d9 tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:32 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4c4b5ac3-5270-4978-9da9-7acbc3df90d9 tempest-VolumesSnapshotTestJSON-1862037507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:25:32 devstack sudo[98526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-869d905b-9c4b-41e9-bb37-1d9d7bb49b13 Jul 07 08:25:32 devstack sudo[98526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:32 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4c4b5ac3-5270-4978-9da9-7acbc3df90d9 tempest-VolumesSnapshotTestJSON-1862037507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:25:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4c4b5ac3-5270-4978-9da9-7acbc3df90d9 tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4c4b5ac3-5270-4978-9da9-7acbc3df90d9 tempest-VolumesSnapshotTestJSON-1862037507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:32 devstack sudo[98528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:25:32 devstack sudo[98528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:33 devstack sudo[98528]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4c4b5ac3-5270-4978-9da9-7acbc3df90d9 tempest-VolumesSnapshotTestJSON-1862037507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.681s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:33 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-4c4b5ac3-5270-4978-9da9-7acbc3df90d9 tempest-VolumesSnapshotTestJSON-1862037507 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:25:33 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-4c4b5ac3-5270-4978-9da9-7acbc3df90d9 tempest-VolumesSnapshotTestJSON-1862037507 None] Deleted volume successfully. Jul 07 08:25:33 devstack sudo[98526]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a4f6c302-ff04-46d4-a142-c8241d72cc72 tempest-VolumesTransfersV357Test-1961313587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-869d905b-9c4b-41e9-bb37-1d9d7bb49b13" returned: 0 in 0.725s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:33 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a4f6c302-ff04-46d4-a142-c8241d72cc72 tempest-VolumesTransfersV357Test-1961313587 None] <== create_volume: return (2052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:25:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a4f6c302-ff04-46d4-a142-c8241d72cc72 tempest-VolumesTransfersV357Test-1961313587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.056s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1567ada0-07f9-42e2-b90e-601925151e49 tempest-ProjectReaderTests-1858111303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.829s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:33 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1567ada0-07f9-42e2-b90e-601925151e49 tempest-ProjectReaderTests-1858111303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:25:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1474335793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79045ebe-2140-4595-ba68-fbf59f7b84a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68e07939fad647ceb6e76c7e8c1929fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:25:32Z,use_quota=True,user_id='04b13a36a2f74922acee87db9997965c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:25:33 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-1567ada0-07f9-42e2-b90e-601925151e49 tempest-ProjectReaderTests-1858111303 None] Creating volume 79045ebe-2140-4595-ba68-fbf59f7b84a0 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:25:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1567ada0-07f9-42e2-b90e-601925151e49 tempest-ProjectReaderTests-1858111303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1567ada0-07f9-42e2-b90e-601925151e49 tempest-ProjectReaderTests-1858111303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:33 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1567ada0-07f9-42e2-b90e-601925151e49 tempest-ProjectReaderTests-1858111303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:25:33 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1567ada0-07f9-42e2-b90e-601925151e49 tempest-ProjectReaderTests-1858111303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:25:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1567ada0-07f9-42e2-b90e-601925151e49 tempest-ProjectReaderTests-1858111303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:33 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1567ada0-07f9-42e2-b90e-601925151e49 tempest-ProjectReaderTests-1858111303 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:25:33 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-1567ada0-07f9-42e2-b90e-601925151e49 tempest-ProjectReaderTests-1858111303 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:25:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1567ada0-07f9-42e2-b90e-601925151e49 tempest-ProjectReaderTests-1858111303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-79045ebe-2140-4595-ba68-fbf59f7b84a0 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a4f6c302-ff04-46d4-a142-c8241d72cc72 tempest-VolumesTransfersV357Test-1961313587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e36a341-ccda-4c48-a795-0cac5608cec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-869d905b-9c4b-41e9-bb37-1d9d7bb49b13', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:33 devstack sudo[98533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-79045ebe-2140-4595-ba68-fbf59f7b84a0 1073741824 Jul 07 08:25:33 devstack sudo[98533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a4f6c302-ff04-46d4-a142-c8241d72cc72 tempest-VolumesTransfersV357Test-1961313587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e91449c-8dd1-49f5-8d2e-69ed34dbb554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:33 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4c4b5ac3-5270-4978-9da9-7acbc3df90d9 tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "cinder-07fd59c1-109d-4271-bd52-646241ecacea-delete_volume" released by "delete_volume" :: held 3.024s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:25:33 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-a4f6c302-ff04-46d4-a142-c8241d72cc72 tempest-VolumesTransfersV357Test-1961313587 None] Volume volume-869d905b-9c4b-41e9-bb37-1d9d7bb49b13 (869d905b-9c4b-41e9-bb37-1d9d7bb49b13): created successfully Jul 07 08:25:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a4f6c302-ff04-46d4-a142-c8241d72cc72 tempest-VolumesTransfersV357Test-1961313587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e91449c-8dd1-49f5-8d2e-69ed34dbb554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a4f6c302-ff04-46d4-a142-c8241d72cc72 tempest-VolumesTransfersV357Test-1961313587 None] Flow 'volume_create_manager' (d803a1f1-815b-400a-aed7-87e40276de96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:25:33 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-a4f6c302-ff04-46d4-a142-c8241d72cc72 tempest-VolumesTransfersV357Test-1961313587 None] Created volume successfully. Jul 07 08:25:33 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3c64f58b-b7ef-4104-aafa-e96e94428f27 tempest-VolumesSnapshotTestJSON-1862037507 None] Acquiring lock "cinder-3feee3cf-f80c-4b87-ad0b-2df93c769b97-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:25:33 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3c64f58b-b7ef-4104-aafa-e96e94428f27 tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "cinder-3feee3cf-f80c-4b87-ad0b-2df93c769b97-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:25:33 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3c64f58b-b7ef-4104-aafa-e96e94428f27 tempest-VolumesSnapshotTestJSON-1862037507 None] Acquiring lock "cinder-quobyte-3feee3cf-f80c-4b87-ad0b-2df93c769b97" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:25:33 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3c64f58b-b7ef-4104-aafa-e96e94428f27 tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "cinder-quobyte-3feee3cf-f80c-4b87-ad0b-2df93c769b97" acquired by "delete_volume" :: waited 0.018s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:25:33 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c841815-c0a1-4fc6-8866-cdd5ae9707dc]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:25:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3c64f58b-b7ef-4104-aafa-e96e94428f27 tempest-VolumesSnapshotTestJSON-1862037507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3feee3cf-f80c-4b87-ad0b-2df93c769b97 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:33 devstack sudo[98535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3feee3cf-f80c-4b87-ad0b-2df93c769b97 Jul 07 08:25:33 devstack sudo[98535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:34 devstack sudo[98533]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1567ada0-07f9-42e2-b90e-601925151e49 tempest-ProjectReaderTests-1858111303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-79045ebe-2140-4595-ba68-fbf59f7b84a0 1073741824" returned: 0 in 0.892s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1567ada0-07f9-42e2-b90e-601925151e49 tempest-ProjectReaderTests-1858111303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-79045ebe-2140-4595-ba68-fbf59f7b84a0 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:34 devstack sudo[98541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-79045ebe-2140-4595-ba68-fbf59f7b84a0 Jul 07 08:25:34 devstack sudo[98541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:34 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-1667e6cc-3098-42be-9794-902824edb806 tempest-VolumesTransfersV357Test-152967431 None] Acquiring lock "cinder-869d905b-9c4b-41e9-bb37-1d9d7bb49b13-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:25:34 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-1667e6cc-3098-42be-9794-902824edb806 tempest-VolumesTransfersV357Test-152967431 None] Lock "cinder-869d905b-9c4b-41e9-bb37-1d9d7bb49b13-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:25:34 devstack sudo[98535]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3c64f58b-b7ef-4104-aafa-e96e94428f27 tempest-VolumesSnapshotTestJSON-1862037507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3feee3cf-f80c-4b87-ad0b-2df93c769b97" returned: 0 in 0.848s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3c64f58b-b7ef-4104-aafa-e96e94428f27 tempest-VolumesSnapshotTestJSON-1862037507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3feee3cf-f80c-4b87-ad0b-2df93c769b97 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:34 devstack sudo[98546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3feee3cf-f80c-4b87-ad0b-2df93c769b97 Jul 07 08:25:34 devstack sudo[98546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:34 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-1667e6cc-3098-42be-9794-902824edb806 tempest-VolumesTransfersV357Test-152967431 None] Acquiring lock "cinder-quobyte-869d905b-9c4b-41e9-bb37-1d9d7bb49b13" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:25:34 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-1667e6cc-3098-42be-9794-902824edb806 tempest-VolumesTransfersV357Test-152967431 None] Lock "cinder-quobyte-869d905b-9c4b-41e9-bb37-1d9d7bb49b13" acquired by "delete_volume" :: waited 0.020s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:25:34 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4887095-5030-4ef1-96cd-579b5f0da399]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:25:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1667e6cc-3098-42be-9794-902824edb806 tempest-VolumesTransfersV357Test-152967431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-869d905b-9c4b-41e9-bb37-1d9d7bb49b13 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:34 devstack sudo[98548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-869d905b-9c4b-41e9-bb37-1d9d7bb49b13 Jul 07 08:25:34 devstack sudo[98548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:34 devstack sudo[98541]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1567ada0-07f9-42e2-b90e-601925151e49 tempest-ProjectReaderTests-1858111303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-79045ebe-2140-4595-ba68-fbf59f7b84a0" returned: 0 in 0.741s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:34 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1567ada0-07f9-42e2-b90e-601925151e49 tempest-ProjectReaderTests-1858111303 None] <== create_volume: return (1678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:25:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1567ada0-07f9-42e2-b90e-601925151e49 tempest-ProjectReaderTests-1858111303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.683s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1567ada0-07f9-42e2-b90e-601925151e49 tempest-ProjectReaderTests-1858111303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f61b1d10-45e9-414d-97c1-fca290538c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79045ebe-2140-4595-ba68-fbf59f7b84a0', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1567ada0-07f9-42e2-b90e-601925151e49 tempest-ProjectReaderTests-1858111303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ff2ad56-0b85-4555-92da-2523f5205d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:34 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-1567ada0-07f9-42e2-b90e-601925151e49 tempest-ProjectReaderTests-1858111303 None] Volume volume-79045ebe-2140-4595-ba68-fbf59f7b84a0 (79045ebe-2140-4595-ba68-fbf59f7b84a0): created successfully Jul 07 08:25:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1567ada0-07f9-42e2-b90e-601925151e49 tempest-ProjectReaderTests-1858111303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ff2ad56-0b85-4555-92da-2523f5205d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1567ada0-07f9-42e2-b90e-601925151e49 tempest-ProjectReaderTests-1858111303 None] Flow 'volume_create_manager' (b8cf4e21-2073-492a-aeac-896bd6314697) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:25:35 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-1567ada0-07f9-42e2-b90e-601925151e49 tempest-ProjectReaderTests-1858111303 None] Created volume successfully. Jul 07 08:25:35 devstack sudo[98546]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3c64f58b-b7ef-4104-aafa-e96e94428f27 tempest-VolumesSnapshotTestJSON-1862037507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3feee3cf-f80c-4b87-ad0b-2df93c769b97" returned: 0 in 0.687s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:35 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3c64f58b-b7ef-4104-aafa-e96e94428f27 tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "cinder-quobyte-3feee3cf-f80c-4b87-ad0b-2df93c769b97" released by "delete_volume" :: held 1.599s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:25:35 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-3c64f58b-b7ef-4104-aafa-e96e94428f27 tempest-VolumesSnapshotTestJSON-1862037507 None] Created reservations ['164ef28f-11b7-444e-8ec0-6d94077f4669', 'f7628a65-dd03-4149-916d-9833ea9a794c', '7a5aad6c-26c4-44f5-9794-b1c8f602829f', '1574c239-6b7a-4c3b-be05-1c9376a9de07'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:25:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3c64f58b-b7ef-4104-aafa-e96e94428f27 tempest-VolumesSnapshotTestJSON-1862037507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3c64f58b-b7ef-4104-aafa-e96e94428f27 tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:35 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-3c64f58b-b7ef-4104-aafa-e96e94428f27 tempest-VolumesSnapshotTestJSON-1862037507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:25:35 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-3c64f58b-b7ef-4104-aafa-e96e94428f27 tempest-VolumesSnapshotTestJSON-1862037507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:25:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3c64f58b-b7ef-4104-aafa-e96e94428f27 tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3c64f58b-b7ef-4104-aafa-e96e94428f27 tempest-VolumesSnapshotTestJSON-1862037507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:35 devstack sudo[98555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:25:35 devstack sudo[98555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:35 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4aa2ae29-4715-491d-9e5c-407eaf0870b2 tempest-ProjectReaderTests-1858111303 None] Acquiring lock "cinder-79045ebe-2140-4595-ba68-fbf59f7b84a0-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:25:35 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4aa2ae29-4715-491d-9e5c-407eaf0870b2 tempest-ProjectReaderTests-1858111303 None] Lock "cinder-79045ebe-2140-4595-ba68-fbf59f7b84a0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:25:35 devstack sudo[98548]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:35 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4aa2ae29-4715-491d-9e5c-407eaf0870b2 tempest-ProjectReaderTests-1858111303 None] Acquiring lock "cinder-quobyte-79045ebe-2140-4595-ba68-fbf59f7b84a0" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:25:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1667e6cc-3098-42be-9794-902824edb806 tempest-VolumesTransfersV357Test-152967431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-869d905b-9c4b-41e9-bb37-1d9d7bb49b13" returned: 0 in 0.900s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1667e6cc-3098-42be-9794-902824edb806 tempest-VolumesTransfersV357Test-152967431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-869d905b-9c4b-41e9-bb37-1d9d7bb49b13 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:35 devstack sudo[98557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-869d905b-9c4b-41e9-bb37-1d9d7bb49b13 Jul 07 08:25:35 devstack sudo[98557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:35 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4aa2ae29-4715-491d-9e5c-407eaf0870b2 tempest-ProjectReaderTests-1858111303 None] Lock "cinder-quobyte-79045ebe-2140-4595-ba68-fbf59f7b84a0" acquired by "delete_volume" :: waited 0.043s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:25:35 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[e620f985-319b-40de-90c0-7200646e5825]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:25:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4aa2ae29-4715-491d-9e5c-407eaf0870b2 tempest-ProjectReaderTests-1858111303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-79045ebe-2140-4595-ba68-fbf59f7b84a0 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:35 devstack sudo[98559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-79045ebe-2140-4595-ba68-fbf59f7b84a0 Jul 07 08:25:35 devstack sudo[98559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:36 devstack sudo[98557]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1667e6cc-3098-42be-9794-902824edb806 tempest-VolumesTransfersV357Test-152967431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-869d905b-9c4b-41e9-bb37-1d9d7bb49b13" returned: 0 in 0.774s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:36 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-1667e6cc-3098-42be-9794-902824edb806 tempest-VolumesTransfersV357Test-152967431 None] Lock "cinder-quobyte-869d905b-9c4b-41e9-bb37-1d9d7bb49b13" released by "delete_volume" :: held 1.727s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:25:36 devstack sudo[98555]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3c64f58b-b7ef-4104-aafa-e96e94428f27 tempest-VolumesSnapshotTestJSON-1862037507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.983s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:36 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-3c64f58b-b7ef-4104-aafa-e96e94428f27 tempest-VolumesSnapshotTestJSON-1862037507 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:25:36 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-3c64f58b-b7ef-4104-aafa-e96e94428f27 tempest-VolumesSnapshotTestJSON-1862037507 None] Deleted volume successfully. Jul 07 08:25:36 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3c64f58b-b7ef-4104-aafa-e96e94428f27 tempest-VolumesSnapshotTestJSON-1862037507 None] Lock "cinder-3feee3cf-f80c-4b87-ad0b-2df93c769b97-delete_volume" released by "delete_volume" :: held 2.822s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:25:36 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-1667e6cc-3098-42be-9794-902824edb806 tempest-VolumesTransfersV357Test-152967431 None] Created reservations ['eb2951b3-5200-4f88-bd81-2c8a853631c9', '8c99247c-fa44-43e2-a39d-919a433cd7c3', '376f6d44-a440-47b6-bf31-fb5958b6e31f', 'f092d38e-5dcd-47eb-8ac5-b7a3f77cb72f'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:25:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1667e6cc-3098-42be-9794-902824edb806 tempest-VolumesTransfersV357Test-152967431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1667e6cc-3098-42be-9794-902824edb806 tempest-VolumesTransfersV357Test-152967431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1667e6cc-3098-42be-9794-902824edb806 tempest-VolumesTransfersV357Test-152967431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:25:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1667e6cc-3098-42be-9794-902824edb806 tempest-VolumesTransfersV357Test-152967431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:25:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1667e6cc-3098-42be-9794-902824edb806 tempest-VolumesTransfersV357Test-152967431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1667e6cc-3098-42be-9794-902824edb806 tempest-VolumesTransfersV357Test-152967431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:36 devstack sudo[98566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:25:36 devstack sudo[98566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:36 devstack sudo[98559]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4aa2ae29-4715-491d-9e5c-407eaf0870b2 tempest-ProjectReaderTests-1858111303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-79045ebe-2140-4595-ba68-fbf59f7b84a0" returned: 0 in 1.054s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4aa2ae29-4715-491d-9e5c-407eaf0870b2 tempest-ProjectReaderTests-1858111303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-79045ebe-2140-4595-ba68-fbf59f7b84a0 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:36 devstack sudo[98568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-79045ebe-2140-4595-ba68-fbf59f7b84a0 Jul 07 08:25:36 devstack sudo[98568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:37 devstack sudo[98566]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1667e6cc-3098-42be-9794-902824edb806 tempest-VolumesTransfersV357Test-152967431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 1.059s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:37 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-1667e6cc-3098-42be-9794-902824edb806 tempest-VolumesTransfersV357Test-152967431 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:25:37 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-1667e6cc-3098-42be-9794-902824edb806 tempest-VolumesTransfersV357Test-152967431 None] Deleted volume successfully. Jul 07 08:25:37 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-1667e6cc-3098-42be-9794-902824edb806 tempest-VolumesTransfersV357Test-152967431 None] Lock "cinder-869d905b-9c4b-41e9-bb37-1d9d7bb49b13-delete_volume" released by "delete_volume" :: held 3.148s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:25:37 devstack sudo[98568]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4aa2ae29-4715-491d-9e5c-407eaf0870b2 tempest-ProjectReaderTests-1858111303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-79045ebe-2140-4595-ba68-fbf59f7b84a0" returned: 0 in 1.144s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:37 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4aa2ae29-4715-491d-9e5c-407eaf0870b2 tempest-ProjectReaderTests-1858111303 None] Lock "cinder-quobyte-79045ebe-2140-4595-ba68-fbf59f7b84a0" released by "delete_volume" :: held 2.285s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:25:37 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-4aa2ae29-4715-491d-9e5c-407eaf0870b2 tempest-ProjectReaderTests-1858111303 None] Created reservations ['15e3085e-71a3-40fc-bcd7-d4d0e50779c3', '0327a564-da90-44a6-be0d-d3bb987e82a8', 'e3832ce2-2c3f-4b71-ac70-aac62e210664', '462d89be-f163-4cb3-96c3-6fa0708151e0'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:25:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4aa2ae29-4715-491d-9e5c-407eaf0870b2 tempest-ProjectReaderTests-1858111303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4aa2ae29-4715-491d-9e5c-407eaf0870b2 tempest-ProjectReaderTests-1858111303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:38 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4aa2ae29-4715-491d-9e5c-407eaf0870b2 tempest-ProjectReaderTests-1858111303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:25:38 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4aa2ae29-4715-491d-9e5c-407eaf0870b2 tempest-ProjectReaderTests-1858111303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:25:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4aa2ae29-4715-491d-9e5c-407eaf0870b2 tempest-ProjectReaderTests-1858111303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4aa2ae29-4715-491d-9e5c-407eaf0870b2 tempest-ProjectReaderTests-1858111303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:38 devstack sudo[98572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:25:38 devstack sudo[98572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:39 devstack sudo[98572]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4aa2ae29-4715-491d-9e5c-407eaf0870b2 tempest-ProjectReaderTests-1858111303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.955s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:39 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-4aa2ae29-4715-491d-9e5c-407eaf0870b2 tempest-ProjectReaderTests-1858111303 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:25:39 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-4aa2ae29-4715-491d-9e5c-407eaf0870b2 tempest-ProjectReaderTests-1858111303 None] Deleted volume successfully. Jul 07 08:25:39 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4aa2ae29-4715-491d-9e5c-407eaf0870b2 tempest-ProjectReaderTests-1858111303 None] Lock "cinder-79045ebe-2140-4595-ba68-fbf59f7b84a0-delete_volume" released by "delete_volume" :: held 3.547s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:25:39 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c50c918-2ca3-47a3-a574-0e4d4377365d tempest-ProjectReaderTests-1858111303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:25:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7c50c918-2ca3-47a3-a574-0e4d4377365d tempest-ProjectReaderTests-1858111303 None] Flow 'volume_create_manager' (c2fef478-65b6-449f-970c-cc0265500f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:25:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7c50c918-2ca3-47a3-a574-0e4d4377365d tempest-ProjectReaderTests-1858111303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab0375f7-3bf2-4c1a-99c9-b44c46414eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7c50c918-2ca3-47a3-a574-0e4d4377365d tempest-ProjectReaderTests-1858111303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab0375f7-3bf2-4c1a-99c9-b44c46414eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:25:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1382680349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a016e501-0dd2-4d24-94ad-7945df9bfc25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68e07939fad647ceb6e76c7e8c1929fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:25:40Z,use_quota=True,user_id='04b13a36a2f74922acee87db9997965c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7c50c918-2ca3-47a3-a574-0e4d4377365d tempest-ProjectReaderTests-1858111303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31dc1c36-17cf-4aea-8487-acdd28a87f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7c50c918-2ca3-47a3-a574-0e4d4377365d tempest-ProjectReaderTests-1858111303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31dc1c36-17cf-4aea-8487-acdd28a87f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7c50c918-2ca3-47a3-a574-0e4d4377365d tempest-ProjectReaderTests-1858111303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (704fa984-6382-42e7-a1f7-fd960ca08e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7c50c918-2ca3-47a3-a574-0e4d4377365d tempest-ProjectReaderTests-1858111303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (704fa984-6382-42e7-a1f7-fd960ca08e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a016e501-0dd2-4d24-94ad-7945df9bfc25', 'volume_name': 'volume-a016e501-0dd2-4d24-94ad-7945df9bfc25', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7c50c918-2ca3-47a3-a574-0e4d4377365d tempest-ProjectReaderTests-1858111303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa0115ff-161e-4245-a26d-d340dad4b912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7c50c918-2ca3-47a3-a574-0e4d4377365d tempest-ProjectReaderTests-1858111303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa0115ff-161e-4245-a26d-d340dad4b912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7c50c918-2ca3-47a3-a574-0e4d4377365d tempest-ProjectReaderTests-1858111303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8547ba5-3829-4d90-abd0-af7397a9456a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:39 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-7c50c918-2ca3-47a3-a574-0e4d4377365d tempest-ProjectReaderTests-1858111303 None] Volume a016e501-0dd2-4d24-94ad-7945df9bfc25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a016e501-0dd2-4d24-94ad-7945df9bfc25', 'volume_size': 1} Jul 07 08:25:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7c50c918-2ca3-47a3-a574-0e4d4377365d tempest-ProjectReaderTests-1858111303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7c50c918-2ca3-47a3-a574-0e4d4377365d tempest-ProjectReaderTests-1858111303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:39 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-7c50c918-2ca3-47a3-a574-0e4d4377365d tempest-ProjectReaderTests-1858111303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:25:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1382680349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a016e501-0dd2-4d24-94ad-7945df9bfc25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68e07939fad647ceb6e76c7e8c1929fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:25:40Z,use_quota=True,user_id='04b13a36a2f74922acee87db9997965c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:25:39 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-7c50c918-2ca3-47a3-a574-0e4d4377365d tempest-ProjectReaderTests-1858111303 None] Creating volume a016e501-0dd2-4d24-94ad-7945df9bfc25 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:25:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7c50c918-2ca3-47a3-a574-0e4d4377365d tempest-ProjectReaderTests-1858111303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7c50c918-2ca3-47a3-a574-0e4d4377365d tempest-ProjectReaderTests-1858111303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:39 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-7c50c918-2ca3-47a3-a574-0e4d4377365d tempest-ProjectReaderTests-1858111303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:25:39 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-7c50c918-2ca3-47a3-a574-0e4d4377365d tempest-ProjectReaderTests-1858111303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:25:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7c50c918-2ca3-47a3-a574-0e4d4377365d tempest-ProjectReaderTests-1858111303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:39 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-7c50c918-2ca3-47a3-a574-0e4d4377365d tempest-ProjectReaderTests-1858111303 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:25:39 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-7c50c918-2ca3-47a3-a574-0e4d4377365d tempest-ProjectReaderTests-1858111303 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:25:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7c50c918-2ca3-47a3-a574-0e4d4377365d tempest-ProjectReaderTests-1858111303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-a016e501-0dd2-4d24-94ad-7945df9bfc25 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:39 devstack sudo[98576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-a016e501-0dd2-4d24-94ad-7945df9bfc25 1073741824 Jul 07 08:25:39 devstack sudo[98576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:40 devstack sudo[98576]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7c50c918-2ca3-47a3-a574-0e4d4377365d tempest-ProjectReaderTests-1858111303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-a016e501-0dd2-4d24-94ad-7945df9bfc25 1073741824" returned: 0 in 1.128s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7c50c918-2ca3-47a3-a574-0e4d4377365d tempest-ProjectReaderTests-1858111303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-a016e501-0dd2-4d24-94ad-7945df9bfc25 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:40 devstack sudo[98583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-a016e501-0dd2-4d24-94ad-7945df9bfc25 Jul 07 08:25:40 devstack sudo[98583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:41 devstack sudo[98583]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7c50c918-2ca3-47a3-a574-0e4d4377365d tempest-ProjectReaderTests-1858111303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-a016e501-0dd2-4d24-94ad-7945df9bfc25" returned: 0 in 0.794s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:41 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-7c50c918-2ca3-47a3-a574-0e4d4377365d tempest-ProjectReaderTests-1858111303 None] <== create_volume: return (1981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:25:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7c50c918-2ca3-47a3-a574-0e4d4377365d tempest-ProjectReaderTests-1858111303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.983s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7c50c918-2ca3-47a3-a574-0e4d4377365d tempest-ProjectReaderTests-1858111303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8547ba5-3829-4d90-abd0-af7397a9456a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a016e501-0dd2-4d24-94ad-7945df9bfc25', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7c50c918-2ca3-47a3-a574-0e4d4377365d tempest-ProjectReaderTests-1858111303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd28ec75-ebc9-41b3-82fb-a8421eef5a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:41 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-7c50c918-2ca3-47a3-a574-0e4d4377365d tempest-ProjectReaderTests-1858111303 None] Volume volume-a016e501-0dd2-4d24-94ad-7945df9bfc25 (a016e501-0dd2-4d24-94ad-7945df9bfc25): created successfully Jul 07 08:25:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7c50c918-2ca3-47a3-a574-0e4d4377365d tempest-ProjectReaderTests-1858111303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd28ec75-ebc9-41b3-82fb-a8421eef5a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7c50c918-2ca3-47a3-a574-0e4d4377365d tempest-ProjectReaderTests-1858111303 None] Flow 'volume_create_manager' (c2fef478-65b6-449f-970c-cc0265500f43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:25:41 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-7c50c918-2ca3-47a3-a574-0e4d4377365d tempest-ProjectReaderTests-1858111303 None] Created volume successfully. Jul 07 08:25:42 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-53250d85-bd1d-4b54-9271-97d11b921f15 tempest-ProjectReaderTests-1858111303 None] Acquiring lock "cinder-a016e501-0dd2-4d24-94ad-7945df9bfc25-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:25:42 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-53250d85-bd1d-4b54-9271-97d11b921f15 tempest-ProjectReaderTests-1858111303 None] Lock "cinder-a016e501-0dd2-4d24-94ad-7945df9bfc25-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:25:42 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-53250d85-bd1d-4b54-9271-97d11b921f15 tempest-ProjectReaderTests-1858111303 None] Acquiring lock "cinder-quobyte-a016e501-0dd2-4d24-94ad-7945df9bfc25" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:25:42 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-53250d85-bd1d-4b54-9271-97d11b921f15 tempest-ProjectReaderTests-1858111303 None] Lock "cinder-quobyte-a016e501-0dd2-4d24-94ad-7945df9bfc25" acquired by "delete_volume" :: waited 0.017s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:25:42 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac47e8e-f503-4803-b282-34edb64fa055]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:25:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-53250d85-bd1d-4b54-9271-97d11b921f15 tempest-ProjectReaderTests-1858111303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-a016e501-0dd2-4d24-94ad-7945df9bfc25 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:43 devstack sudo[98587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-a016e501-0dd2-4d24-94ad-7945df9bfc25 Jul 07 08:25:43 devstack sudo[98587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:43 devstack sudo[98587]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-53250d85-bd1d-4b54-9271-97d11b921f15 tempest-ProjectReaderTests-1858111303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-a016e501-0dd2-4d24-94ad-7945df9bfc25" returned: 0 in 0.811s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-53250d85-bd1d-4b54-9271-97d11b921f15 tempest-ProjectReaderTests-1858111303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-a016e501-0dd2-4d24-94ad-7945df9bfc25 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:43 devstack sudo[98593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-a016e501-0dd2-4d24-94ad-7945df9bfc25 Jul 07 08:25:43 devstack sudo[98593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:44 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-148be808-e429-4093-81e2-98b79020ff2d tempest-VolumesSnapshotListTestJSON-1422414471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:25:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-148be808-e429-4093-81e2-98b79020ff2d tempest-VolumesSnapshotListTestJSON-1422414471 None] Flow 'volume_create_manager' (2447b979-41b6-498d-ab6d-d0a2e53ec531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:25:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-148be808-e429-4093-81e2-98b79020ff2d tempest-VolumesSnapshotListTestJSON-1422414471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46ff00b1-dc0d-4336-bde4-523a6b346f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-148be808-e429-4093-81e2-98b79020ff2d tempest-VolumesSnapshotListTestJSON-1422414471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46ff00b1-dc0d-4336-bde4-523a6b346f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:25:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-318254283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33ef38c7-4ece-4694-9dc5-474425466da6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18ec103a37734463b9ded41ac58e9616',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:25:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:25:44Z,use_quota=True,user_id='80de508b1116497d97907373f9d4e563',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-148be808-e429-4093-81e2-98b79020ff2d tempest-VolumesSnapshotListTestJSON-1422414471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38e1fe0c-e207-4294-abed-429f66f042a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-148be808-e429-4093-81e2-98b79020ff2d tempest-VolumesSnapshotListTestJSON-1422414471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38e1fe0c-e207-4294-abed-429f66f042a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-148be808-e429-4093-81e2-98b79020ff2d tempest-VolumesSnapshotListTestJSON-1422414471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76dc9784-470b-4cbf-b93f-5d469eb1ef60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-148be808-e429-4093-81e2-98b79020ff2d tempest-VolumesSnapshotListTestJSON-1422414471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76dc9784-470b-4cbf-b93f-5d469eb1ef60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33ef38c7-4ece-4694-9dc5-474425466da6', 'volume_name': 'volume-33ef38c7-4ece-4694-9dc5-474425466da6', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-148be808-e429-4093-81e2-98b79020ff2d tempest-VolumesSnapshotListTestJSON-1422414471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78e91a3d-177f-43b3-b124-01cc1b572fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-148be808-e429-4093-81e2-98b79020ff2d tempest-VolumesSnapshotListTestJSON-1422414471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78e91a3d-177f-43b3-b124-01cc1b572fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-148be808-e429-4093-81e2-98b79020ff2d tempest-VolumesSnapshotListTestJSON-1422414471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f3cb66f-3d66-4cb8-8caf-28a5e64f63c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:44 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-148be808-e429-4093-81e2-98b79020ff2d tempest-VolumesSnapshotListTestJSON-1422414471 None] Volume 33ef38c7-4ece-4694-9dc5-474425466da6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33ef38c7-4ece-4694-9dc5-474425466da6', 'volume_size': 1} Jul 07 08:25:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-148be808-e429-4093-81e2-98b79020ff2d tempest-VolumesSnapshotListTestJSON-1422414471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-148be808-e429-4093-81e2-98b79020ff2d tempest-VolumesSnapshotListTestJSON-1422414471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-148be808-e429-4093-81e2-98b79020ff2d tempest-VolumesSnapshotListTestJSON-1422414471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:25:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-318254283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33ef38c7-4ece-4694-9dc5-474425466da6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18ec103a37734463b9ded41ac58e9616',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:25:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:25:44Z,use_quota=True,user_id='80de508b1116497d97907373f9d4e563',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:25:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-148be808-e429-4093-81e2-98b79020ff2d tempest-VolumesSnapshotListTestJSON-1422414471 None] Creating volume 33ef38c7-4ece-4694-9dc5-474425466da6 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:25:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-148be808-e429-4093-81e2-98b79020ff2d tempest-VolumesSnapshotListTestJSON-1422414471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-148be808-e429-4093-81e2-98b79020ff2d tempest-VolumesSnapshotListTestJSON-1422414471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-148be808-e429-4093-81e2-98b79020ff2d tempest-VolumesSnapshotListTestJSON-1422414471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:25:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-148be808-e429-4093-81e2-98b79020ff2d tempest-VolumesSnapshotListTestJSON-1422414471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:25:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-148be808-e429-4093-81e2-98b79020ff2d tempest-VolumesSnapshotListTestJSON-1422414471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-148be808-e429-4093-81e2-98b79020ff2d tempest-VolumesSnapshotListTestJSON-1422414471 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:25:44 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-148be808-e429-4093-81e2-98b79020ff2d tempest-VolumesSnapshotListTestJSON-1422414471 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:25:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-148be808-e429-4093-81e2-98b79020ff2d tempest-VolumesSnapshotListTestJSON-1422414471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:44 devstack sudo[98601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6 1073741824 Jul 07 08:25:44 devstack sudo[98601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:44 devstack sudo[98593]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-53250d85-bd1d-4b54-9271-97d11b921f15 tempest-ProjectReaderTests-1858111303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-a016e501-0dd2-4d24-94ad-7945df9bfc25" returned: 0 in 0.902s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:44 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-53250d85-bd1d-4b54-9271-97d11b921f15 tempest-ProjectReaderTests-1858111303 None] Lock "cinder-quobyte-a016e501-0dd2-4d24-94ad-7945df9bfc25" released by "delete_volume" :: held 1.760s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:25:44 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-53250d85-bd1d-4b54-9271-97d11b921f15 tempest-ProjectReaderTests-1858111303 None] Created reservations ['f881f871-dc48-427b-a809-58af39965518', 'c2898e85-e257-4d5f-8ce6-f0daa3808f19', '6095f2c3-e617-4eaf-8af4-fdf0a9e11e1c', '6a86294b-937a-4815-a510-69c86190ce25'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:25:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-53250d85-bd1d-4b54-9271-97d11b921f15 tempest-ProjectReaderTests-1858111303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-53250d85-bd1d-4b54-9271-97d11b921f15 tempest-ProjectReaderTests-1858111303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-53250d85-bd1d-4b54-9271-97d11b921f15 tempest-ProjectReaderTests-1858111303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:25:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-53250d85-bd1d-4b54-9271-97d11b921f15 tempest-ProjectReaderTests-1858111303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:25:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-53250d85-bd1d-4b54-9271-97d11b921f15 tempest-ProjectReaderTests-1858111303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-53250d85-bd1d-4b54-9271-97d11b921f15 tempest-ProjectReaderTests-1858111303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:44 devstack sudo[98605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:25:44 devstack sudo[98605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:45 devstack sudo[98601]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-148be808-e429-4093-81e2-98b79020ff2d tempest-VolumesSnapshotListTestJSON-1422414471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6 1073741824" returned: 0 in 1.102s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-148be808-e429-4093-81e2-98b79020ff2d tempest-VolumesSnapshotListTestJSON-1422414471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:45 devstack sudo[98611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6 Jul 07 08:25:45 devstack sudo[98611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:45 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-12e0da9c-6b03-4df3-a7fc-88b402fd69b4 tempest-ProjectReaderTests-1858111303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:25:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-12e0da9c-6b03-4df3-a7fc-88b402fd69b4 tempest-ProjectReaderTests-1858111303 None] Flow 'volume_create_manager' (21625648-c17b-48fc-937a-08f547dd37ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:25:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-12e0da9c-6b03-4df3-a7fc-88b402fd69b4 tempest-ProjectReaderTests-1858111303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddd910a7-ef0a-4e39-a9c6-daf14c7a3cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-12e0da9c-6b03-4df3-a7fc-88b402fd69b4 tempest-ProjectReaderTests-1858111303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddd910a7-ef0a-4e39-a9c6-daf14c7a3cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:25:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2110662130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f26527e-4c1f-473a-b6e6-f7685376aac5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68e07939fad647ceb6e76c7e8c1929fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:25:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:25:46Z,use_quota=True,user_id='04b13a36a2f74922acee87db9997965c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-12e0da9c-6b03-4df3-a7fc-88b402fd69b4 tempest-ProjectReaderTests-1858111303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07d50e8e-1fbf-43f9-b9e0-12e6da2bab76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-12e0da9c-6b03-4df3-a7fc-88b402fd69b4 tempest-ProjectReaderTests-1858111303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07d50e8e-1fbf-43f9-b9e0-12e6da2bab76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-12e0da9c-6b03-4df3-a7fc-88b402fd69b4 tempest-ProjectReaderTests-1858111303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5d676b3-7f80-4dae-80cc-8fb35fd907ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:45 devstack sudo[98605]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-12e0da9c-6b03-4df3-a7fc-88b402fd69b4 tempest-ProjectReaderTests-1858111303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5d676b3-7f80-4dae-80cc-8fb35fd907ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f26527e-4c1f-473a-b6e6-f7685376aac5', 'volume_name': 'volume-3f26527e-4c1f-473a-b6e6-f7685376aac5', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-12e0da9c-6b03-4df3-a7fc-88b402fd69b4 tempest-ProjectReaderTests-1858111303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76342220-5474-4d14-96fb-0316ace7d89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-12e0da9c-6b03-4df3-a7fc-88b402fd69b4 tempest-ProjectReaderTests-1858111303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76342220-5474-4d14-96fb-0316ace7d89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-12e0da9c-6b03-4df3-a7fc-88b402fd69b4 tempest-ProjectReaderTests-1858111303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52dffb60-df29-4ec5-8cbc-aaad50030d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:45 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-12e0da9c-6b03-4df3-a7fc-88b402fd69b4 tempest-ProjectReaderTests-1858111303 None] Volume 3f26527e-4c1f-473a-b6e6-f7685376aac5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f26527e-4c1f-473a-b6e6-f7685376aac5', 'volume_size': 1} Jul 07 08:25:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-12e0da9c-6b03-4df3-a7fc-88b402fd69b4 tempest-ProjectReaderTests-1858111303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-53250d85-bd1d-4b54-9271-97d11b921f15 tempest-ProjectReaderTests-1858111303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 1.014s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:45 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-53250d85-bd1d-4b54-9271-97d11b921f15 tempest-ProjectReaderTests-1858111303 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:25:45 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-53250d85-bd1d-4b54-9271-97d11b921f15 tempest-ProjectReaderTests-1858111303 None] Deleted volume successfully. Jul 07 08:25:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-53250d85-bd1d-4b54-9271-97d11b921f15 tempest-ProjectReaderTests-1858111303 None] Lock "cinder-a016e501-0dd2-4d24-94ad-7945df9bfc25-delete_volume" released by "delete_volume" :: held 3.061s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:25:46 devstack sudo[98611]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-148be808-e429-4093-81e2-98b79020ff2d tempest-VolumesSnapshotListTestJSON-1422414471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6" returned: 0 in 0.724s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:46 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-148be808-e429-4093-81e2-98b79020ff2d tempest-VolumesSnapshotListTestJSON-1422414471 None] <== create_volume: return (1881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:25:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-148be808-e429-4093-81e2-98b79020ff2d tempest-VolumesSnapshotListTestJSON-1422414471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.885s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-12e0da9c-6b03-4df3-a7fc-88b402fd69b4 tempest-ProjectReaderTests-1858111303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.383s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:46 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-12e0da9c-6b03-4df3-a7fc-88b402fd69b4 tempest-ProjectReaderTests-1858111303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:25:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2110662130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f26527e-4c1f-473a-b6e6-f7685376aac5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68e07939fad647ceb6e76c7e8c1929fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:25:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:25:46Z,use_quota=True,user_id='04b13a36a2f74922acee87db9997965c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:25:46 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-12e0da9c-6b03-4df3-a7fc-88b402fd69b4 tempest-ProjectReaderTests-1858111303 None] Creating volume 3f26527e-4c1f-473a-b6e6-f7685376aac5 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:25:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-12e0da9c-6b03-4df3-a7fc-88b402fd69b4 tempest-ProjectReaderTests-1858111303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-12e0da9c-6b03-4df3-a7fc-88b402fd69b4 tempest-ProjectReaderTests-1858111303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:46 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-12e0da9c-6b03-4df3-a7fc-88b402fd69b4 tempest-ProjectReaderTests-1858111303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:25:46 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-12e0da9c-6b03-4df3-a7fc-88b402fd69b4 tempest-ProjectReaderTests-1858111303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:25:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-12e0da9c-6b03-4df3-a7fc-88b402fd69b4 tempest-ProjectReaderTests-1858111303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:46 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-12e0da9c-6b03-4df3-a7fc-88b402fd69b4 tempest-ProjectReaderTests-1858111303 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:25:46 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-12e0da9c-6b03-4df3-a7fc-88b402fd69b4 tempest-ProjectReaderTests-1858111303 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:25:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-12e0da9c-6b03-4df3-a7fc-88b402fd69b4 tempest-ProjectReaderTests-1858111303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3f26527e-4c1f-473a-b6e6-f7685376aac5 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-148be808-e429-4093-81e2-98b79020ff2d tempest-VolumesSnapshotListTestJSON-1422414471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f3cb66f-3d66-4cb8-8caf-28a5e64f63c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33ef38c7-4ece-4694-9dc5-474425466da6', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:46 devstack sudo[98615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3f26527e-4c1f-473a-b6e6-f7685376aac5 1073741824 Jul 07 08:25:46 devstack sudo[98615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-148be808-e429-4093-81e2-98b79020ff2d tempest-VolumesSnapshotListTestJSON-1422414471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9862e3a1-afdc-4f71-b35e-73813952f038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:46 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-148be808-e429-4093-81e2-98b79020ff2d tempest-VolumesSnapshotListTestJSON-1422414471 None] Volume volume-33ef38c7-4ece-4694-9dc5-474425466da6 (33ef38c7-4ece-4694-9dc5-474425466da6): created successfully Jul 07 08:25:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-148be808-e429-4093-81e2-98b79020ff2d tempest-VolumesSnapshotListTestJSON-1422414471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9862e3a1-afdc-4f71-b35e-73813952f038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-148be808-e429-4093-81e2-98b79020ff2d tempest-VolumesSnapshotListTestJSON-1422414471 None] Flow 'volume_create_manager' (2447b979-41b6-498d-ab6d-d0a2e53ec531) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:25:46 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-148be808-e429-4093-81e2-98b79020ff2d tempest-VolumesSnapshotListTestJSON-1422414471 None] Created volume successfully. Jul 07 08:25:47 devstack sudo[98615]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-12e0da9c-6b03-4df3-a7fc-88b402fd69b4 tempest-ProjectReaderTests-1858111303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3f26527e-4c1f-473a-b6e6-f7685376aac5 1073741824" returned: 0 in 0.910s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-12e0da9c-6b03-4df3-a7fc-88b402fd69b4 tempest-ProjectReaderTests-1858111303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3f26527e-4c1f-473a-b6e6-f7685376aac5 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:47 devstack sudo[98627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3f26527e-4c1f-473a-b6e6-f7685376aac5 Jul 07 08:25:47 devstack sudo[98627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-18d4814f-bbcb-43da-8880-19009cd97f06 req-1e391ddf-4e13-43d9-bb24-188ccd41dc6f tempest-TestStampPattern-2031995845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a2e092b1-895d-4db9-b4a6-69239d0e5175 tempest-VolumesSnapshotListTestJSON-1422414471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:47 devstack sudo[98627]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-12e0da9c-6b03-4df3-a7fc-88b402fd69b4 tempest-ProjectReaderTests-1858111303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3f26527e-4c1f-473a-b6e6-f7685376aac5" returned: 0 in 0.757s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-12e0da9c-6b03-4df3-a7fc-88b402fd69b4 tempest-ProjectReaderTests-1858111303 None] <== create_volume: return (1735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:25:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-12e0da9c-6b03-4df3-a7fc-88b402fd69b4 tempest-ProjectReaderTests-1858111303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.740s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-18d4814f-bbcb-43da-8880-19009cd97f06 req-1e391ddf-4e13-43d9-bb24-188ccd41dc6f tempest-TestStampPattern-2031995845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.394s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-12e0da9c-6b03-4df3-a7fc-88b402fd69b4 tempest-ProjectReaderTests-1858111303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52dffb60-df29-4ec5-8cbc-aaad50030d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f26527e-4c1f-473a-b6e6-f7685376aac5', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-12e0da9c-6b03-4df3-a7fc-88b402fd69b4 tempest-ProjectReaderTests-1858111303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dfa8bd2-8b78-48df-b19d-3a89a34a519f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:47 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c4bc6c-58d0-4912-b0c7-ba62e57f2aa6]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:25:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-18d4814f-bbcb-43da-8880-19009cd97f06 req-1e391ddf-4e13-43d9-bb24-188ccd41dc6f tempest-TestStampPattern-2031995845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:48 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-12e0da9c-6b03-4df3-a7fc-88b402fd69b4 tempest-ProjectReaderTests-1858111303 None] Volume volume-3f26527e-4c1f-473a-b6e6-f7685376aac5 (3f26527e-4c1f-473a-b6e6-f7685376aac5): created successfully Jul 07 08:25:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-12e0da9c-6b03-4df3-a7fc-88b402fd69b4 tempest-ProjectReaderTests-1858111303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dfa8bd2-8b78-48df-b19d-3a89a34a519f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-12e0da9c-6b03-4df3-a7fc-88b402fd69b4 tempest-ProjectReaderTests-1858111303 None] Flow 'volume_create_manager' (21625648-c17b-48fc-937a-08f547dd37ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:25:48 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-12e0da9c-6b03-4df3-a7fc-88b402fd69b4 tempest-ProjectReaderTests-1858111303 None] Created volume successfully. Jul 07 08:25:48 devstack sudo[98638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788 Jul 07 08:25:48 devstack sudo[98638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:48 devstack sudo[98638]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-18d4814f-bbcb-43da-8880-19009cd97f06 req-1e391ddf-4e13-43d9-bb24-188ccd41dc6f tempest-TestStampPattern-2031995845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788" returned: 0 in 0.912s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-18d4814f-bbcb-43da-8880-19009cd97f06 req-1e391ddf-4e13-43d9-bb24-188ccd41dc6f tempest-TestStampPattern-2031995845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.944s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a2e092b1-895d-4db9-b4a6-69239d0e5175 tempest-VolumesSnapshotListTestJSON-1422414471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.330s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-a2e092b1-895d-4db9-b4a6-69239d0e5175 tempest-VolumesSnapshotListTestJSON-1422414471 None] Creating offline snapshot dbd57223-8345-4c6e-be7b-972203b7d13f of volume 33ef38c7-4ece-4694-9dc5-474425466da6 {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:25:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6993f25f-deb3-43f6-8df7-eeead733de97 tempest-ProjectReaderTests-1858111303 None] Acquiring lock "cinder-3f26527e-4c1f-473a-b6e6-f7685376aac5-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:25:48 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c4a47f-73fa-4291-9575-b59c3433b557]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:25:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a2e092b1-895d-4db9-b4a6-69239d0e5175 tempest-VolumesSnapshotListTestJSON-1422414471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-18d4814f-bbcb-43da-8880-19009cd97f06 req-1e391ddf-4e13-43d9-bb24-188ccd41dc6f tempest-TestStampPattern-2031995845 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b', 'name': 'volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a595a811-4011-4fc6-9049-3bed342c6562', 'enforce_multipath': True} {{(pid=87199) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 08:25:49 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6993f25f-deb3-43f6-8df7-eeead733de97 tempest-ProjectReaderTests-1858111303 None] Lock "cinder-3f26527e-4c1f-473a-b6e6-f7685376aac5-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:25:49 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6993f25f-deb3-43f6-8df7-eeead733de97 tempest-ProjectReaderTests-1858111303 None] Acquiring lock "cinder-quobyte-3f26527e-4c1f-473a-b6e6-f7685376aac5" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:25:49 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6993f25f-deb3-43f6-8df7-eeead733de97 tempest-ProjectReaderTests-1858111303 None] Lock "cinder-quobyte-3f26527e-4c1f-473a-b6e6-f7685376aac5" acquired by "delete_volume" :: waited 0.024s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:25:49 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-18d4814f-bbcb-43da-8880-19009cd97f06 req-1e391ddf-4e13-43d9-bb24-188ccd41dc6f tempest-TestStampPattern-2031995845 None] attachment_update completed successfully. Jul 07 08:25:49 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e4bd88-f1e8-4e0d-92cb-a91750b0a944]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:25:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6993f25f-deb3-43f6-8df7-eeead733de97 tempest-ProjectReaderTests-1858111303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3f26527e-4c1f-473a-b6e6-f7685376aac5 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:49 devstack sudo[98643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6 Jul 07 08:25:49 devstack sudo[98643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:49 devstack sudo[98644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3f26527e-4c1f-473a-b6e6-f7685376aac5 Jul 07 08:25:49 devstack sudo[98644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:49 devstack sudo[98643]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a2e092b1-895d-4db9-b4a6-69239d0e5175 tempest-VolumesSnapshotListTestJSON-1422414471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6" returned: 0 in 0.998s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a2e092b1-895d-4db9-b4a6-69239d0e5175 tempest-VolumesSnapshotListTestJSON-1422414471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.dbd57223-8345-4c6e-be7b-972203b7d13f 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:49 devstack sudo[98721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.dbd57223-8345-4c6e-be7b-972203b7d13f 1G Jul 07 08:25:49 devstack sudo[98721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:50 devstack sudo[98644]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6993f25f-deb3-43f6-8df7-eeead733de97 tempest-ProjectReaderTests-1858111303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3f26527e-4c1f-473a-b6e6-f7685376aac5" returned: 0 in 0.964s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6993f25f-deb3-43f6-8df7-eeead733de97 tempest-ProjectReaderTests-1858111303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3f26527e-4c1f-473a-b6e6-f7685376aac5 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:50 devstack sudo[98723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3f26527e-4c1f-473a-b6e6-f7685376aac5 Jul 07 08:25:50 devstack sudo[98723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:51 devstack sudo[98723]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6993f25f-deb3-43f6-8df7-eeead733de97 tempest-ProjectReaderTests-1858111303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3f26527e-4c1f-473a-b6e6-f7685376aac5" returned: 0 in 1.028s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:51 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6993f25f-deb3-43f6-8df7-eeead733de97 tempest-ProjectReaderTests-1858111303 None] Lock "cinder-quobyte-3f26527e-4c1f-473a-b6e6-f7685376aac5" released by "delete_volume" :: held 2.057s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:25:51 devstack sudo[98721]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a2e092b1-895d-4db9-b4a6-69239d0e5175 tempest-VolumesSnapshotListTestJSON-1422414471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.dbd57223-8345-4c6e-be7b-972203b7d13f 1G" returned: 0 in 1.225s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a2e092b1-895d-4db9-b4a6-69239d0e5175 tempest-VolumesSnapshotListTestJSON-1422414471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33ef38c7-4ece-4694-9dc5-474425466da6 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.dbd57223-8345-4c6e-be7b-972203b7d13f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:51 devstack sudo[99047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33ef38c7-4ece-4694-9dc5-474425466da6 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.dbd57223-8345-4c6e-be7b-972203b7d13f Jul 07 08:25:51 devstack sudo[99047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:51 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-6993f25f-deb3-43f6-8df7-eeead733de97 tempest-ProjectReaderTests-1858111303 None] Created reservations ['b813a1df-dab1-49fc-9fe7-77bf347a0bc0', '1bdae376-8a8c-4da3-9b0b-50730174bc60', 'eca452ca-77d2-4a72-bb20-11028d36ac38', 'e6c71c7b-653e-4fde-ae99-51f41be8e4e3'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:25:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6993f25f-deb3-43f6-8df7-eeead733de97 tempest-ProjectReaderTests-1858111303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6993f25f-deb3-43f6-8df7-eeead733de97 tempest-ProjectReaderTests-1858111303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:51 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6993f25f-deb3-43f6-8df7-eeead733de97 tempest-ProjectReaderTests-1858111303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:25:51 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6993f25f-deb3-43f6-8df7-eeead733de97 tempest-ProjectReaderTests-1858111303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:25:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6993f25f-deb3-43f6-8df7-eeead733de97 tempest-ProjectReaderTests-1858111303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6993f25f-deb3-43f6-8df7-eeead733de97 tempest-ProjectReaderTests-1858111303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:51 devstack sudo[99049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:25:51 devstack sudo[99049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:52 devstack sudo[99047]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a2e092b1-895d-4db9-b4a6-69239d0e5175 tempest-VolumesSnapshotListTestJSON-1422414471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33ef38c7-4ece-4694-9dc5-474425466da6 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.dbd57223-8345-4c6e-be7b-972203b7d13f" returned: 0 in 0.839s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:52 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-a2e092b1-895d-4db9-b4a6-69239d0e5175 tempest-VolumesSnapshotListTestJSON-1422414471 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.dbd57223-8345-4c6e-be7b-972203b7d13f is being set with open permissions: ugo+rw Jul 07 08:25:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a2e092b1-895d-4db9-b4a6-69239d0e5175 tempest-VolumesSnapshotListTestJSON-1422414471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.dbd57223-8345-4c6e-be7b-972203b7d13f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:52 devstack sudo[99055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.dbd57223-8345-4c6e-be7b-972203b7d13f Jul 07 08:25:52 devstack sudo[99055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:52 devstack sudo[99049]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6993f25f-deb3-43f6-8df7-eeead733de97 tempest-ProjectReaderTests-1858111303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.735s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:52 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-6993f25f-deb3-43f6-8df7-eeead733de97 tempest-ProjectReaderTests-1858111303 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:25:52 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-6993f25f-deb3-43f6-8df7-eeead733de97 tempest-ProjectReaderTests-1858111303 None] Deleted volume successfully. Jul 07 08:25:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6993f25f-deb3-43f6-8df7-eeead733de97 tempest-ProjectReaderTests-1858111303 None] Lock "cinder-3f26527e-4c1f-473a-b6e6-f7685376aac5-delete_volume" released by "delete_volume" :: held 3.140s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:25:52 devstack sudo[99055]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a2e092b1-895d-4db9-b4a6-69239d0e5175 tempest-VolumesSnapshotListTestJSON-1422414471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.dbd57223-8345-4c6e-be7b-972203b7d13f" returned: 0 in 0.782s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a2e092b1-895d-4db9-b4a6-69239d0e5175 tempest-VolumesSnapshotListTestJSON-1422414471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:52 devstack sudo[99058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.info Jul 07 08:25:52 devstack sudo[99058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:53 devstack sudo[99058]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a2e092b1-895d-4db9-b4a6-69239d0e5175 tempest-VolumesSnapshotListTestJSON-1422414471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.info" returned: 0 in 0.866s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:53 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-a2e092b1-895d-4db9-b4a6-69239d0e5175 tempest-VolumesSnapshotListTestJSON-1422414471 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.info is being set with open permissions: ugo+rw Jul 07 08:25:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a2e092b1-895d-4db9-b4a6-69239d0e5175 tempest-VolumesSnapshotListTestJSON-1422414471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:53 devstack sudo[99065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.info Jul 07 08:25:53 devstack sudo[99065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:54 devstack sudo[99065]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a2e092b1-895d-4db9-b4a6-69239d0e5175 tempest-VolumesSnapshotListTestJSON-1422414471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.info" returned: 0 in 0.943s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a2e092b1-895d-4db9-b4a6-69239d0e5175 tempest-VolumesSnapshotListTestJSON-1422414471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.798s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:54 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-a2e092b1-895d-4db9-b4a6-69239d0e5175 tempest-VolumesSnapshotListTestJSON-1422414471 None] Create snapshot completed successfully Jul 07 08:25:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-38fd8efb-0dba-4daa-8fbf-26e8245b3832 tempest-VolumesSnapshotListTestJSON-1422414471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-38fd8efb-0dba-4daa-8fbf-26e8245b3832 tempest-VolumesSnapshotListTestJSON-1422414471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:55 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-38fd8efb-0dba-4daa-8fbf-26e8245b3832 tempest-VolumesSnapshotListTestJSON-1422414471 None] Creating offline snapshot fd0c07a9-5cfa-450c-b8ca-48ab6e3bf438 of volume 33ef38c7-4ece-4694-9dc5-474425466da6 {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:25:55 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8b01af-e7ba-4345-b42f-01fb1b87d308]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:25:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-38fd8efb-0dba-4daa-8fbf-26e8245b3832 tempest-VolumesSnapshotListTestJSON-1422414471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.dbd57223-8345-4c6e-be7b-972203b7d13f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:55 devstack sudo[99074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.dbd57223-8345-4c6e-be7b-972203b7d13f Jul 07 08:25:55 devstack sudo[99074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:55 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-90516205-d73a-4619-91a9-7fbfdb6d9d39 tempest-VolumesActionsTest-762406275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:25:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-90516205-d73a-4619-91a9-7fbfdb6d9d39 tempest-VolumesActionsTest-762406275 None] Flow 'volume_create_manager' (c31d447e-7850-40da-8de7-1f08a8eee5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:25:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-90516205-d73a-4619-91a9-7fbfdb6d9d39 tempest-VolumesActionsTest-762406275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4c0b48d-3b0b-465a-8cdf-5d6f0b2d5558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-90516205-d73a-4619-91a9-7fbfdb6d9d39 tempest-VolumesActionsTest-762406275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4c0b48d-3b0b-465a-8cdf-5d6f0b2d5558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:25:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2001393668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdde83c0-d3b1-406d-b93e-ef59ca7e7b04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47c2e220d28745eb8dd30321b3934ed4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:25:56Z,use_quota=True,user_id='967748bc2dfe435d9b19022733506244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-90516205-d73a-4619-91a9-7fbfdb6d9d39 tempest-VolumesActionsTest-762406275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38cfb670-22b4-45c1-bd9b-af047c7f8af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-90516205-d73a-4619-91a9-7fbfdb6d9d39 tempest-VolumesActionsTest-762406275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38cfb670-22b4-45c1-bd9b-af047c7f8af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-90516205-d73a-4619-91a9-7fbfdb6d9d39 tempest-VolumesActionsTest-762406275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b11082a-ca6e-4477-aca8-865e8c4df93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-90516205-d73a-4619-91a9-7fbfdb6d9d39 tempest-VolumesActionsTest-762406275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b11082a-ca6e-4477-aca8-865e8c4df93c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdde83c0-d3b1-406d-b93e-ef59ca7e7b04', 'volume_name': 'volume-bdde83c0-d3b1-406d-b93e-ef59ca7e7b04', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-90516205-d73a-4619-91a9-7fbfdb6d9d39 tempest-VolumesActionsTest-762406275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec55894f-1026-43a7-b68e-093adb74e64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-90516205-d73a-4619-91a9-7fbfdb6d9d39 tempest-VolumesActionsTest-762406275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec55894f-1026-43a7-b68e-093adb74e64a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-90516205-d73a-4619-91a9-7fbfdb6d9d39 tempest-VolumesActionsTest-762406275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d26cd5d-203e-46b5-830c-689d0df2e107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:55 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-90516205-d73a-4619-91a9-7fbfdb6d9d39 tempest-VolumesActionsTest-762406275 None] Volume bdde83c0-d3b1-406d-b93e-ef59ca7e7b04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdde83c0-d3b1-406d-b93e-ef59ca7e7b04', 'volume_size': 1} Jul 07 08:25:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-90516205-d73a-4619-91a9-7fbfdb6d9d39 tempest-VolumesActionsTest-762406275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:56 devstack sudo[99074]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-38fd8efb-0dba-4daa-8fbf-26e8245b3832 tempest-VolumesSnapshotListTestJSON-1422414471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.dbd57223-8345-4c6e-be7b-972203b7d13f" returned: 0 in 0.821s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-38fd8efb-0dba-4daa-8fbf-26e8245b3832 tempest-VolumesSnapshotListTestJSON-1422414471 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33ef38c7-4ece-4694-9dc5-474425466da6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:25:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-38fd8efb-0dba-4daa-8fbf-26e8245b3832 tempest-VolumesSnapshotListTestJSON-1422414471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.dbd57223-8345-4c6e-be7b-972203b7d13f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.fd0c07a9-5cfa-450c-b8ca-48ab6e3bf438 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:56 devstack sudo[99081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.dbd57223-8345-4c6e-be7b-972203b7d13f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.fd0c07a9-5cfa-450c-b8ca-48ab6e3bf438 1G Jul 07 08:25:56 devstack sudo[99081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:57 devstack sudo[99081]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-38fd8efb-0dba-4daa-8fbf-26e8245b3832 tempest-VolumesSnapshotListTestJSON-1422414471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.dbd57223-8345-4c6e-be7b-972203b7d13f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.fd0c07a9-5cfa-450c-b8ca-48ab6e3bf438 1G" returned: 0 in 0.971s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-38fd8efb-0dba-4daa-8fbf-26e8245b3832 tempest-VolumesSnapshotListTestJSON-1422414471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33ef38c7-4ece-4694-9dc5-474425466da6.dbd57223-8345-4c6e-be7b-972203b7d13f -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.fd0c07a9-5cfa-450c-b8ca-48ab6e3bf438 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:57 devstack sudo[99095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33ef38c7-4ece-4694-9dc5-474425466da6.dbd57223-8345-4c6e-be7b-972203b7d13f -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.fd0c07a9-5cfa-450c-b8ca-48ab6e3bf438 Jul 07 08:25:57 devstack sudo[99095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:57 devstack sudo[99095]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-38fd8efb-0dba-4daa-8fbf-26e8245b3832 tempest-VolumesSnapshotListTestJSON-1422414471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33ef38c7-4ece-4694-9dc5-474425466da6.dbd57223-8345-4c6e-be7b-972203b7d13f -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.fd0c07a9-5cfa-450c-b8ca-48ab6e3bf438" returned: 0 in 0.730s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:57 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-38fd8efb-0dba-4daa-8fbf-26e8245b3832 tempest-VolumesSnapshotListTestJSON-1422414471 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.fd0c07a9-5cfa-450c-b8ca-48ab6e3bf438 is being set with open permissions: ugo+rw Jul 07 08:25:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-38fd8efb-0dba-4daa-8fbf-26e8245b3832 tempest-VolumesSnapshotListTestJSON-1422414471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.fd0c07a9-5cfa-450c-b8ca-48ab6e3bf438 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:57 devstack sudo[99100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.fd0c07a9-5cfa-450c-b8ca-48ab6e3bf438 Jul 07 08:25:57 devstack sudo[99100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:58 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-970bfdde-fce1-4197-b1f1-7c112d4aaee7 req-c004ff2b-4994-40cc-b87a-3b77abf71c20 tempest-TestStampPattern-2031995845 None] Terminate volume connection completed successfully. Jul 07 08:25:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-970bfdde-fce1-4197-b1f1-7c112d4aaee7 req-c004ff2b-4994-40cc-b87a-3b77abf71c20 tempest-TestStampPattern-2031995845 None] Deleting attachment a595a811-4011-4fc6-9049-3bed342c6562. {{(pid=87199) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 08:25:58 devstack sudo[99100]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-38fd8efb-0dba-4daa-8fbf-26e8245b3832 tempest-VolumesSnapshotListTestJSON-1422414471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.fd0c07a9-5cfa-450c-b8ca-48ab6e3bf438" returned: 0 in 0.704s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-38fd8efb-0dba-4daa-8fbf-26e8245b3832 tempest-VolumesSnapshotListTestJSON-1422414471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.368s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-90516205-d73a-4619-91a9-7fbfdb6d9d39 tempest-VolumesActionsTest-762406275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.729s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-90516205-d73a-4619-91a9-7fbfdb6d9d39 tempest-VolumesActionsTest-762406275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:25:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2001393668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdde83c0-d3b1-406d-b93e-ef59ca7e7b04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47c2e220d28745eb8dd30321b3934ed4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:25:56Z,use_quota=True,user_id='967748bc2dfe435d9b19022733506244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:25:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-90516205-d73a-4619-91a9-7fbfdb6d9d39 tempest-VolumesActionsTest-762406275 None] Creating volume bdde83c0-d3b1-406d-b93e-ef59ca7e7b04 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:25:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-90516205-d73a-4619-91a9-7fbfdb6d9d39 tempest-VolumesActionsTest-762406275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-90516205-d73a-4619-91a9-7fbfdb6d9d39 tempest-VolumesActionsTest-762406275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-90516205-d73a-4619-91a9-7fbfdb6d9d39 tempest-VolumesActionsTest-762406275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:25:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-90516205-d73a-4619-91a9-7fbfdb6d9d39 tempest-VolumesActionsTest-762406275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:25:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-90516205-d73a-4619-91a9-7fbfdb6d9d39 tempest-VolumesActionsTest-762406275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-90516205-d73a-4619-91a9-7fbfdb6d9d39 tempest-VolumesActionsTest-762406275 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:25:58 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-90516205-d73a-4619-91a9-7fbfdb6d9d39 tempest-VolumesActionsTest-762406275 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:25:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-90516205-d73a-4619-91a9-7fbfdb6d9d39 tempest-VolumesActionsTest-762406275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-bdde83c0-d3b1-406d-b93e-ef59ca7e7b04 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:58 devstack sudo[99130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-bdde83c0-d3b1-406d-b93e-ef59ca7e7b04 1073741824 Jul 07 08:25:58 devstack sudo[99130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:58 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-38fd8efb-0dba-4daa-8fbf-26e8245b3832 tempest-VolumesSnapshotListTestJSON-1422414471 None] Create snapshot completed successfully Jul 07 08:25:59 devstack sudo[99130]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-90516205-d73a-4619-91a9-7fbfdb6d9d39 tempest-VolumesActionsTest-762406275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-bdde83c0-d3b1-406d-b93e-ef59ca7e7b04 1073741824" returned: 0 in 0.885s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-90516205-d73a-4619-91a9-7fbfdb6d9d39 tempest-VolumesActionsTest-762406275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-bdde83c0-d3b1-406d-b93e-ef59ca7e7b04 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:59 devstack sudo[99136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-bdde83c0-d3b1-406d-b93e-ef59ca7e7b04 Jul 07 08:25:59 devstack sudo[99136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c8db47b8-bc10-4579-8ff8-1b088be1d885 tempest-VolumesSnapshotListTestJSON-1422414471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:26:00 devstack sudo[99136]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-90516205-d73a-4619-91a9-7fbfdb6d9d39 tempest-VolumesActionsTest-762406275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-bdde83c0-d3b1-406d-b93e-ef59ca7e7b04" returned: 0 in 0.720s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:00 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-90516205-d73a-4619-91a9-7fbfdb6d9d39 tempest-VolumesActionsTest-762406275 None] <== create_volume: return (1651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:26:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-90516205-d73a-4619-91a9-7fbfdb6d9d39 tempest-VolumesActionsTest-762406275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.654s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:26:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c8db47b8-bc10-4579-8ff8-1b088be1d885 tempest-VolumesSnapshotListTestJSON-1422414471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.679s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:26:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-90516205-d73a-4619-91a9-7fbfdb6d9d39 tempest-VolumesActionsTest-762406275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d26cd5d-203e-46b5-830c-689d0df2e107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdde83c0-d3b1-406d-b93e-ef59ca7e7b04', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:26:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-90516205-d73a-4619-91a9-7fbfdb6d9d39 tempest-VolumesActionsTest-762406275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56c5ec1e-7b71-4143-ad44-e07f60dad572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:26:00 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-c8db47b8-bc10-4579-8ff8-1b088be1d885 tempest-VolumesSnapshotListTestJSON-1422414471 None] Creating offline snapshot 9ec8c6b2-4cbb-4cfc-ad21-fca5772bccc8 of volume 33ef38c7-4ece-4694-9dc5-474425466da6 {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:26:00 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-90516205-d73a-4619-91a9-7fbfdb6d9d39 tempest-VolumesActionsTest-762406275 None] Volume volume-bdde83c0-d3b1-406d-b93e-ef59ca7e7b04 (bdde83c0-d3b1-406d-b93e-ef59ca7e7b04): created successfully Jul 07 08:26:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-90516205-d73a-4619-91a9-7fbfdb6d9d39 tempest-VolumesActionsTest-762406275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56c5ec1e-7b71-4143-ad44-e07f60dad572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:26:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-90516205-d73a-4619-91a9-7fbfdb6d9d39 tempest-VolumesActionsTest-762406275 None] Flow 'volume_create_manager' (c31d447e-7850-40da-8de7-1f08a8eee5a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:26:00 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda439ee-192d-4130-9e50-ab7ea24f93d7]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:26:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c8db47b8-bc10-4579-8ff8-1b088be1d885 tempest-VolumesSnapshotListTestJSON-1422414471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.fd0c07a9-5cfa-450c-b8ca-48ab6e3bf438 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:00 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-90516205-d73a-4619-91a9-7fbfdb6d9d39 tempest-VolumesActionsTest-762406275 None] Created volume successfully. Jul 07 08:26:00 devstack sudo[99139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.fd0c07a9-5cfa-450c-b8ca-48ab6e3bf438 Jul 07 08:26:00 devstack sudo[99139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-545ba15d-39c1-4f39-b9d7-7f01f68562ae tempest-TestStampPattern-2031995845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:26:01 devstack sudo[99139]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c8db47b8-bc10-4579-8ff8-1b088be1d885 tempest-VolumesSnapshotListTestJSON-1422414471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.fd0c07a9-5cfa-450c-b8ca-48ab6e3bf438" returned: 0 in 0.841s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:01 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-c8db47b8-bc10-4579-8ff8-1b088be1d885 tempest-VolumesSnapshotListTestJSON-1422414471 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33ef38c7-4ece-4694-9dc5-474425466da6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:26:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c8db47b8-bc10-4579-8ff8-1b088be1d885 tempest-VolumesSnapshotListTestJSON-1422414471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.fd0c07a9-5cfa-450c-b8ca-48ab6e3bf438,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.9ec8c6b2-4cbb-4cfc-ad21-fca5772bccc8 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:01 devstack sudo[99145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.fd0c07a9-5cfa-450c-b8ca-48ab6e3bf438,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.9ec8c6b2-4cbb-4cfc-ad21-fca5772bccc8 1G Jul 07 08:26:01 devstack sudo[99145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:02 devstack sudo[99145]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c8db47b8-bc10-4579-8ff8-1b088be1d885 tempest-VolumesSnapshotListTestJSON-1422414471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.fd0c07a9-5cfa-450c-b8ca-48ab6e3bf438,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.9ec8c6b2-4cbb-4cfc-ad21-fca5772bccc8 1G" returned: 0 in 0.954s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c8db47b8-bc10-4579-8ff8-1b088be1d885 tempest-VolumesSnapshotListTestJSON-1422414471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33ef38c7-4ece-4694-9dc5-474425466da6.fd0c07a9-5cfa-450c-b8ca-48ab6e3bf438 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.9ec8c6b2-4cbb-4cfc-ad21-fca5772bccc8 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:02 devstack sudo[99156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33ef38c7-4ece-4694-9dc5-474425466da6.fd0c07a9-5cfa-450c-b8ca-48ab6e3bf438 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.9ec8c6b2-4cbb-4cfc-ad21-fca5772bccc8 Jul 07 08:26:02 devstack sudo[99156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:02 devstack sudo[99156]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c8db47b8-bc10-4579-8ff8-1b088be1d885 tempest-VolumesSnapshotListTestJSON-1422414471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33ef38c7-4ece-4694-9dc5-474425466da6.fd0c07a9-5cfa-450c-b8ca-48ab6e3bf438 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.9ec8c6b2-4cbb-4cfc-ad21-fca5772bccc8" returned: 0 in 0.733s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:02 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-c8db47b8-bc10-4579-8ff8-1b088be1d885 tempest-VolumesSnapshotListTestJSON-1422414471 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.9ec8c6b2-4cbb-4cfc-ad21-fca5772bccc8 is being set with open permissions: ugo+rw Jul 07 08:26:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c8db47b8-bc10-4579-8ff8-1b088be1d885 tempest-VolumesSnapshotListTestJSON-1422414471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.9ec8c6b2-4cbb-4cfc-ad21-fca5772bccc8 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:02 devstack sudo[99161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.9ec8c6b2-4cbb-4cfc-ad21-fca5772bccc8 Jul 07 08:26:02 devstack sudo[99161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:03 devstack sudo[99161]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c8db47b8-bc10-4579-8ff8-1b088be1d885 tempest-VolumesSnapshotListTestJSON-1422414471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.9ec8c6b2-4cbb-4cfc-ad21-fca5772bccc8" returned: 0 in 0.706s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c8db47b8-bc10-4579-8ff8-1b088be1d885 tempest-VolumesSnapshotListTestJSON-1422414471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.365s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:26:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-545ba15d-39c1-4f39-b9d7-7f01f68562ae tempest-TestStampPattern-2031995845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.051s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:26:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-545ba15d-39c1-4f39-b9d7-7f01f68562ae tempest-TestStampPattern-2031995845 None] Creating offline snapshot d7dad97d-1709-4fad-9190-49f7de185111 of volume 5ab52e0c-f1b1-4225-b8bd-7bc07317f788 {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:26:03 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-c8db47b8-bc10-4579-8ff8-1b088be1d885 tempest-VolumesSnapshotListTestJSON-1422414471 None] Create snapshot completed successfully Jul 07 08:26:03 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b14360-c740-44c7-af79-d773699d79fe]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:26:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-545ba15d-39c1-4f39-b9d7-7f01f68562ae tempest-TestStampPattern-2031995845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:03 devstack sudo[99164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788 Jul 07 08:26:03 devstack sudo[99164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:04 devstack sudo[99164]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-545ba15d-39c1-4f39-b9d7-7f01f68562ae tempest-TestStampPattern-2031995845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788" returned: 0 in 0.782s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-545ba15d-39c1-4f39-b9d7-7f01f68562ae tempest-TestStampPattern-2031995845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788.d7dad97d-1709-4fad-9190-49f7de185111 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:04 devstack sudo[99169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788.d7dad97d-1709-4fad-9190-49f7de185111 1G Jul 07 08:26:04 devstack sudo[99169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:05 devstack sudo[99169]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-545ba15d-39c1-4f39-b9d7-7f01f68562ae tempest-TestStampPattern-2031995845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788.d7dad97d-1709-4fad-9190-49f7de185111 1G" returned: 0 in 0.960s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-545ba15d-39c1-4f39-b9d7-7f01f68562ae tempest-TestStampPattern-2031995845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788.d7dad97d-1709-4fad-9190-49f7de185111 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:05 devstack sudo[99175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788.d7dad97d-1709-4fad-9190-49f7de185111 Jul 07 08:26:05 devstack sudo[99175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-26776be7-374b-41af-9668-3beac49ad37a tempest-VolumesSnapshotListTestJSON-1422414471 None] Acquiring lock "cinder-9ec8c6b2-4cbb-4cfc-ad21-fca5772bccc8-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:26:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-26776be7-374b-41af-9668-3beac49ad37a tempest-VolumesSnapshotListTestJSON-1422414471 None] Lock "cinder-9ec8c6b2-4cbb-4cfc-ad21-fca5772bccc8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:26:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-26776be7-374b-41af-9668-3beac49ad37a tempest-VolumesSnapshotListTestJSON-1422414471 None] Acquiring lock "cinder-quobyte-33ef38c7-4ece-4694-9dc5-474425466da6" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:26:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-26776be7-374b-41af-9668-3beac49ad37a tempest-VolumesSnapshotListTestJSON-1422414471 None] Lock "cinder-quobyte-33ef38c7-4ece-4694-9dc5-474425466da6" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:26:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-26776be7-374b-41af-9668-3beac49ad37a tempest-VolumesSnapshotListTestJSON-1422414471 None] Acquiring lock "cinder-quobyte-9ec8c6b2-4cbb-4cfc-ad21-fca5772bccc8" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:26:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-26776be7-374b-41af-9668-3beac49ad37a tempest-VolumesSnapshotListTestJSON-1422414471 None] Lock "cinder-quobyte-9ec8c6b2-4cbb-4cfc-ad21-fca5772bccc8" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:26:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-26776be7-374b-41af-9668-3beac49ad37a tempest-VolumesSnapshotListTestJSON-1422414471 None] Deleting offline snapshot 9ec8c6b2-4cbb-4cfc-ad21-fca5772bccc8 of volume 33ef38c7-4ece-4694-9dc5-474425466da6 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:26:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-26776be7-374b-41af-9668-3beac49ad37a tempest-VolumesSnapshotListTestJSON-1422414471 None] snapshot_file for this snap is: volume-33ef38c7-4ece-4694-9dc5-474425466da6.9ec8c6b2-4cbb-4cfc-ad21-fca5772bccc8 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:26:05 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[70da9599-faed-43d1-8590-a1e5746676c7]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:26:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-26776be7-374b-41af-9668-3beac49ad37a tempest-VolumesSnapshotListTestJSON-1422414471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.9ec8c6b2-4cbb-4cfc-ad21-fca5772bccc8 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:05 devstack sudo[99177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.9ec8c6b2-4cbb-4cfc-ad21-fca5772bccc8 Jul 07 08:26:05 devstack sudo[99177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:05 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:26:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:26:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:26:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:26:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:26:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:26:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:05 devstack sudo[99179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:26:05 devstack sudo[99179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:06 devstack sudo[99175]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-545ba15d-39c1-4f39-b9d7-7f01f68562ae tempest-TestStampPattern-2031995845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788.d7dad97d-1709-4fad-9190-49f7de185111" returned: 0 in 0.757s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:06 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-545ba15d-39c1-4f39-b9d7-7f01f68562ae tempest-TestStampPattern-2031995845 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788.d7dad97d-1709-4fad-9190-49f7de185111 is being set with open permissions: ugo+rw Jul 07 08:26:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-545ba15d-39c1-4f39-b9d7-7f01f68562ae tempest-TestStampPattern-2031995845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788.d7dad97d-1709-4fad-9190-49f7de185111 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:06 devstack sudo[99184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788.d7dad97d-1709-4fad-9190-49f7de185111 Jul 07 08:26:06 devstack sudo[99184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:06 devstack sudo[99179]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.741s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:06 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:26:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running periodic task VolumeManager._thread_info {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:26:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] thread count: 29 {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 08:26:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] thread info: [<_MainThread(MainThread, started 133056092332160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 08:26:06 devstack sudo[99177]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-26776be7-374b-41af-9668-3beac49ad37a tempest-VolumesSnapshotListTestJSON-1422414471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.9ec8c6b2-4cbb-4cfc-ad21-fca5772bccc8" returned: 0 in 0.929s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-26776be7-374b-41af-9668-3beac49ad37a tempest-VolumesSnapshotListTestJSON-1422414471 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33ef38c7-4ece-4694-9dc5-474425466da6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:26:06 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6069859-db9b-4064-b8fa-929a5b6dcaf4]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:26:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-26776be7-374b-41af-9668-3beac49ad37a tempest-VolumesSnapshotListTestJSON-1422414471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.fd0c07a9-5cfa-450c-b8ca-48ab6e3bf438 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:06 devstack sudo[99191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.fd0c07a9-5cfa-450c-b8ca-48ab6e3bf438 Jul 07 08:26:06 devstack sudo[99191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:06 devstack sudo[99184]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-545ba15d-39c1-4f39-b9d7-7f01f68562ae tempest-TestStampPattern-2031995845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788.d7dad97d-1709-4fad-9190-49f7de185111" returned: 0 in 0.793s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-545ba15d-39c1-4f39-b9d7-7f01f68562ae tempest-TestStampPattern-2031995845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:07 devstack sudo[99194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788.info Jul 07 08:26:07 devstack sudo[99194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:07 devstack sudo[99191]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-26776be7-374b-41af-9668-3beac49ad37a tempest-VolumesSnapshotListTestJSON-1422414471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.fd0c07a9-5cfa-450c-b8ca-48ab6e3bf438" returned: 0 in 1.018s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:07 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-26776be7-374b-41af-9668-3beac49ad37a tempest-VolumesSnapshotListTestJSON-1422414471 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33ef38c7-4ece-4694-9dc5-474425466da6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:26:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-26776be7-374b-41af-9668-3beac49ad37a tempest-VolumesSnapshotListTestJSON-1422414471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.9ec8c6b2-4cbb-4cfc-ad21-fca5772bccc8 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:07 devstack sudo[99194]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-545ba15d-39c1-4f39-b9d7-7f01f68562ae tempest-TestStampPattern-2031995845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788.info" returned: 0 in 0.794s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:07 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-545ba15d-39c1-4f39-b9d7-7f01f68562ae tempest-TestStampPattern-2031995845 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788.info is being set with open permissions: ugo+rw Jul 07 08:26:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-545ba15d-39c1-4f39-b9d7-7f01f68562ae tempest-TestStampPattern-2031995845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:07 devstack sudo[99201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.9ec8c6b2-4cbb-4cfc-ad21-fca5772bccc8 Jul 07 08:26:07 devstack sudo[99201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:07 devstack sudo[99202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788.info Jul 07 08:26:07 devstack sudo[99202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:08 devstack sudo[99202]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-545ba15d-39c1-4f39-b9d7-7f01f68562ae tempest-TestStampPattern-2031995845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788.info" returned: 0 in 0.716s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-545ba15d-39c1-4f39-b9d7-7f01f68562ae tempest-TestStampPattern-2031995845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.923s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:26:08 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-545ba15d-39c1-4f39-b9d7-7f01f68562ae tempest-TestStampPattern-2031995845 None] Create snapshot completed successfully Jul 07 08:26:08 devstack sudo[99201]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-26776be7-374b-41af-9668-3beac49ad37a tempest-VolumesSnapshotListTestJSON-1422414471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.9ec8c6b2-4cbb-4cfc-ad21-fca5772bccc8" returned: 0 in 1.017s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-26776be7-374b-41af-9668-3beac49ad37a tempest-VolumesSnapshotListTestJSON-1422414471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.9ec8c6b2-4cbb-4cfc-ad21-fca5772bccc8 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:08 devstack sudo[99220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.9ec8c6b2-4cbb-4cfc-ad21-fca5772bccc8 Jul 07 08:26:08 devstack sudo[99220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:09 devstack sudo[99220]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-26776be7-374b-41af-9668-3beac49ad37a tempest-VolumesSnapshotListTestJSON-1422414471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.9ec8c6b2-4cbb-4cfc-ad21-fca5772bccc8" returned: 0 in 0.684s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:09 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-26776be7-374b-41af-9668-3beac49ad37a tempest-VolumesSnapshotListTestJSON-1422414471 None] Lock "cinder-quobyte-9ec8c6b2-4cbb-4cfc-ad21-fca5772bccc8" released by "_delete_snapshot" :: held 3.805s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:26:09 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-26776be7-374b-41af-9668-3beac49ad37a tempest-VolumesSnapshotListTestJSON-1422414471 None] Lock "cinder-quobyte-33ef38c7-4ece-4694-9dc5-474425466da6" released by "delete_snapshot" :: held 3.843s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:26:09 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-26776be7-374b-41af-9668-3beac49ad37a tempest-VolumesSnapshotListTestJSON-1422414471 None] Created reservations ['9d7180e4-1f22-4c04-8056-16b8d806b2ed', '80cd8b64-4ba2-4ae9-801a-9c043ec282bd', '37a2bdf4-42b0-404a-a8d6-ca97485029ea', 'f379a9ca-bc7c-4f52-96d2-188050894cda'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:26:09 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-26776be7-374b-41af-9668-3beac49ad37a tempest-VolumesSnapshotListTestJSON-1422414471 None] Delete snapshot completed successfully. Jul 07 08:26:09 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-26776be7-374b-41af-9668-3beac49ad37a tempest-VolumesSnapshotListTestJSON-1422414471 None] Lock "cinder-9ec8c6b2-4cbb-4cfc-ad21-fca5772bccc8-delete_snapshot" released by "delete_snapshot" :: held 3.991s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:26:09 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-99303c8f-3cbd-4acb-9e2b-60f93ecaba34 tempest-VolumesSnapshotListTestJSON-1422414471 None] Acquiring lock "cinder-fd0c07a9-5cfa-450c-b8ca-48ab6e3bf438-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:26:09 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-99303c8f-3cbd-4acb-9e2b-60f93ecaba34 tempest-VolumesSnapshotListTestJSON-1422414471 None] Lock "cinder-fd0c07a9-5cfa-450c-b8ca-48ab6e3bf438-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:26:09 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-99303c8f-3cbd-4acb-9e2b-60f93ecaba34 tempest-VolumesSnapshotListTestJSON-1422414471 None] Acquiring lock "cinder-quobyte-33ef38c7-4ece-4694-9dc5-474425466da6" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:26:09 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-99303c8f-3cbd-4acb-9e2b-60f93ecaba34 tempest-VolumesSnapshotListTestJSON-1422414471 None] Lock "cinder-quobyte-33ef38c7-4ece-4694-9dc5-474425466da6" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:26:09 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-99303c8f-3cbd-4acb-9e2b-60f93ecaba34 tempest-VolumesSnapshotListTestJSON-1422414471 None] Acquiring lock "cinder-quobyte-fd0c07a9-5cfa-450c-b8ca-48ab6e3bf438" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:26:09 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-99303c8f-3cbd-4acb-9e2b-60f93ecaba34 tempest-VolumesSnapshotListTestJSON-1422414471 None] Lock "cinder-quobyte-fd0c07a9-5cfa-450c-b8ca-48ab6e3bf438" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:26:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-99303c8f-3cbd-4acb-9e2b-60f93ecaba34 tempest-VolumesSnapshotListTestJSON-1422414471 None] Deleting offline snapshot fd0c07a9-5cfa-450c-b8ca-48ab6e3bf438 of volume 33ef38c7-4ece-4694-9dc5-474425466da6 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:26:10 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-99303c8f-3cbd-4acb-9e2b-60f93ecaba34 tempest-VolumesSnapshotListTestJSON-1422414471 None] snapshot_file for this snap is: volume-33ef38c7-4ece-4694-9dc5-474425466da6.fd0c07a9-5cfa-450c-b8ca-48ab6e3bf438 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:26:10 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[9053be3c-18fa-4f7c-a69f-09c148da5c25]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:26:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-99303c8f-3cbd-4acb-9e2b-60f93ecaba34 tempest-VolumesSnapshotListTestJSON-1422414471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.fd0c07a9-5cfa-450c-b8ca-48ab6e3bf438 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:10 devstack sudo[99228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.fd0c07a9-5cfa-450c-b8ca-48ab6e3bf438 Jul 07 08:26:10 devstack sudo[99228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:10 devstack sudo[99228]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-99303c8f-3cbd-4acb-9e2b-60f93ecaba34 tempest-VolumesSnapshotListTestJSON-1422414471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.fd0c07a9-5cfa-450c-b8ca-48ab6e3bf438" returned: 0 in 0.828s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:10 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-99303c8f-3cbd-4acb-9e2b-60f93ecaba34 tempest-VolumesSnapshotListTestJSON-1422414471 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33ef38c7-4ece-4694-9dc5-474425466da6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:26:10 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99db4d3-4974-4245-b76c-efe4c3a3bcb4]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:26:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-99303c8f-3cbd-4acb-9e2b-60f93ecaba34 tempest-VolumesSnapshotListTestJSON-1422414471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.dbd57223-8345-4c6e-be7b-972203b7d13f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:10 devstack sudo[99234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.dbd57223-8345-4c6e-be7b-972203b7d13f Jul 07 08:26:10 devstack sudo[99234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-99303c8f-3cbd-4acb-9e2b-60f93ecaba34 tempest-VolumesSnapshotListTestJSON-1422414471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.dbd57223-8345-4c6e-be7b-972203b7d13f" returned: 0 in 0.791s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:11 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-99303c8f-3cbd-4acb-9e2b-60f93ecaba34 tempest-VolumesSnapshotListTestJSON-1422414471 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33ef38c7-4ece-4694-9dc5-474425466da6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:26:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-99303c8f-3cbd-4acb-9e2b-60f93ecaba34 tempest-VolumesSnapshotListTestJSON-1422414471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.fd0c07a9-5cfa-450c-b8ca-48ab6e3bf438 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:11 devstack sudo[99234]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:11 devstack sudo[99239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.fd0c07a9-5cfa-450c-b8ca-48ab6e3bf438 Jul 07 08:26:11 devstack sudo[99239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:12 devstack sudo[99239]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-99303c8f-3cbd-4acb-9e2b-60f93ecaba34 tempest-VolumesSnapshotListTestJSON-1422414471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.fd0c07a9-5cfa-450c-b8ca-48ab6e3bf438" returned: 0 in 1.081s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-99303c8f-3cbd-4acb-9e2b-60f93ecaba34 tempest-VolumesSnapshotListTestJSON-1422414471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.fd0c07a9-5cfa-450c-b8ca-48ab6e3bf438 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:12 devstack sudo[99292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.fd0c07a9-5cfa-450c-b8ca-48ab6e3bf438 Jul 07 08:26:12 devstack sudo[99292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:13 devstack sudo[99292]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-99303c8f-3cbd-4acb-9e2b-60f93ecaba34 tempest-VolumesSnapshotListTestJSON-1422414471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.fd0c07a9-5cfa-450c-b8ca-48ab6e3bf438" returned: 0 in 0.657s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:13 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-99303c8f-3cbd-4acb-9e2b-60f93ecaba34 tempest-VolumesSnapshotListTestJSON-1422414471 None] Lock "cinder-quobyte-fd0c07a9-5cfa-450c-b8ca-48ab6e3bf438" released by "_delete_snapshot" :: held 3.455s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:26:13 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-99303c8f-3cbd-4acb-9e2b-60f93ecaba34 tempest-VolumesSnapshotListTestJSON-1422414471 None] Lock "cinder-quobyte-33ef38c7-4ece-4694-9dc5-474425466da6" released by "delete_snapshot" :: held 3.480s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:26:13 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-99303c8f-3cbd-4acb-9e2b-60f93ecaba34 tempest-VolumesSnapshotListTestJSON-1422414471 None] Created reservations ['12095118-dcb0-4183-83b2-d482c8889b65', '56555fca-f973-48fb-8b44-4f2986e3adf4', '097b7554-6384-4b4e-a268-b8a4bba5a0e2', '52c8adcf-fc14-4482-b927-cf7b28c46003'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:26:13 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-99303c8f-3cbd-4acb-9e2b-60f93ecaba34 tempest-VolumesSnapshotListTestJSON-1422414471 None] Delete snapshot completed successfully. Jul 07 08:26:13 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-99303c8f-3cbd-4acb-9e2b-60f93ecaba34 tempest-VolumesSnapshotListTestJSON-1422414471 None] Lock "cinder-fd0c07a9-5cfa-450c-b8ca-48ab6e3bf438-delete_snapshot" released by "delete_snapshot" :: held 3.664s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:26:14 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-951d4705-5c3f-462d-a1c6-c2cf28ca2572 tempest-VolumesSnapshotListTestJSON-1422414471 None] Acquiring lock "cinder-dbd57223-8345-4c6e-be7b-972203b7d13f-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:26:14 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-951d4705-5c3f-462d-a1c6-c2cf28ca2572 tempest-VolumesSnapshotListTestJSON-1422414471 None] Lock "cinder-dbd57223-8345-4c6e-be7b-972203b7d13f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:26:14 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-951d4705-5c3f-462d-a1c6-c2cf28ca2572 tempest-VolumesSnapshotListTestJSON-1422414471 None] Acquiring lock "cinder-quobyte-33ef38c7-4ece-4694-9dc5-474425466da6" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:26:14 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-951d4705-5c3f-462d-a1c6-c2cf28ca2572 tempest-VolumesSnapshotListTestJSON-1422414471 None] Lock "cinder-quobyte-33ef38c7-4ece-4694-9dc5-474425466da6" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:26:14 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-951d4705-5c3f-462d-a1c6-c2cf28ca2572 tempest-VolumesSnapshotListTestJSON-1422414471 None] Acquiring lock "cinder-quobyte-dbd57223-8345-4c6e-be7b-972203b7d13f" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:26:14 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-951d4705-5c3f-462d-a1c6-c2cf28ca2572 tempest-VolumesSnapshotListTestJSON-1422414471 None] Lock "cinder-quobyte-dbd57223-8345-4c6e-be7b-972203b7d13f" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:26:14 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-951d4705-5c3f-462d-a1c6-c2cf28ca2572 tempest-VolumesSnapshotListTestJSON-1422414471 None] Deleting offline snapshot dbd57223-8345-4c6e-be7b-972203b7d13f of volume 33ef38c7-4ece-4694-9dc5-474425466da6 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:26:14 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-951d4705-5c3f-462d-a1c6-c2cf28ca2572 tempest-VolumesSnapshotListTestJSON-1422414471 None] snapshot_file for this snap is: volume-33ef38c7-4ece-4694-9dc5-474425466da6.dbd57223-8345-4c6e-be7b-972203b7d13f {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:26:14 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0055fc1-c210-43df-84c3-66a3ddb613b5]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:26:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-951d4705-5c3f-462d-a1c6-c2cf28ca2572 tempest-VolumesSnapshotListTestJSON-1422414471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.dbd57223-8345-4c6e-be7b-972203b7d13f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:14 devstack sudo[99353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.dbd57223-8345-4c6e-be7b-972203b7d13f Jul 07 08:26:14 devstack sudo[99353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:15 devstack sudo[99353]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-951d4705-5c3f-462d-a1c6-c2cf28ca2572 tempest-VolumesSnapshotListTestJSON-1422414471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.dbd57223-8345-4c6e-be7b-972203b7d13f" returned: 0 in 0.910s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-951d4705-5c3f-462d-a1c6-c2cf28ca2572 tempest-VolumesSnapshotListTestJSON-1422414471 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33ef38c7-4ece-4694-9dc5-474425466da6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:26:15 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[7730f654-5b13-4427-9bdc-035d1d61498b]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:26:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-951d4705-5c3f-462d-a1c6-c2cf28ca2572 tempest-VolumesSnapshotListTestJSON-1422414471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:15 devstack sudo[99361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6 Jul 07 08:26:15 devstack sudo[99361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:16 devstack sudo[99361]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-951d4705-5c3f-462d-a1c6-c2cf28ca2572 tempest-VolumesSnapshotListTestJSON-1422414471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6" returned: 0 in 0.931s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-951d4705-5c3f-462d-a1c6-c2cf28ca2572 tempest-VolumesSnapshotListTestJSON-1422414471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.dbd57223-8345-4c6e-be7b-972203b7d13f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:16 devstack sudo[99366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.dbd57223-8345-4c6e-be7b-972203b7d13f Jul 07 08:26:16 devstack sudo[99366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:16 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ca6a20c2-d08e-42d8-92fe-fb81fff7b2b4 tempest-VolumesActionsTest-762406275 None] Acquiring lock "cinder-bdde83c0-d3b1-406d-b93e-ef59ca7e7b04" by "attach_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:26:16 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ca6a20c2-d08e-42d8-92fe-fb81fff7b2b4 tempest-VolumesActionsTest-762406275 None] Lock "cinder-bdde83c0-d3b1-406d-b93e-ef59ca7e7b04" acquired by "attach_volume" :: waited 0.028s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:26:16 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-ca6a20c2-d08e-42d8-92fe-fb81fff7b2b4 tempest-VolumesActionsTest-762406275 None] Attaching volume bdde83c0-d3b1-406d-b93e-ef59ca7e7b04 to instance 60548963-1395-4ffd-bb4d-f0e91e35b7c5 at mountpoint /dev/vdb on host None. Jul 07 08:26:16 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-ca6a20c2-d08e-42d8-92fe-fb81fff7b2b4 tempest-VolumesActionsTest-762406275 None] Attach volume completed successfully. Jul 07 08:26:16 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ca6a20c2-d08e-42d8-92fe-fb81fff7b2b4 tempest-VolumesActionsTest-762406275 None] Lock "cinder-bdde83c0-d3b1-406d-b93e-ef59ca7e7b04" released by "attach_volume" :: held 0.134s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:26:17 devstack sudo[99366]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-951d4705-5c3f-462d-a1c6-c2cf28ca2572 tempest-VolumesSnapshotListTestJSON-1422414471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.dbd57223-8345-4c6e-be7b-972203b7d13f" returned: 0 in 1.078s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-951d4705-5c3f-462d-a1c6-c2cf28ca2572 tempest-VolumesSnapshotListTestJSON-1422414471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.dbd57223-8345-4c6e-be7b-972203b7d13f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:17 devstack sudo[99371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.dbd57223-8345-4c6e-be7b-972203b7d13f Jul 07 08:26:17 devstack sudo[99371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:17 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-014642f3-e3d1-4504-9ae0-750e970f605a tempest-VolumesActionsTest-762406275 None] Acquiring lock "cinder-bdde83c0-d3b1-406d-b93e-ef59ca7e7b04-detach_volume" by "detach_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:26:17 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-014642f3-e3d1-4504-9ae0-750e970f605a tempest-VolumesActionsTest-762406275 None] Lock "cinder-bdde83c0-d3b1-406d-b93e-ef59ca7e7b04-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:26:17 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-014642f3-e3d1-4504-9ae0-750e970f605a tempest-VolumesActionsTest-762406275 None] Detaching volume bdde83c0-d3b1-406d-b93e-ef59ca7e7b04 from instance 60548963-1395-4ffd-bb4d-f0e91e35b7c5. Jul 07 08:26:17 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-014642f3-e3d1-4504-9ae0-750e970f605a tempest-VolumesActionsTest-762406275 None] Detach volume completed successfully. Jul 07 08:26:17 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-014642f3-e3d1-4504-9ae0-750e970f605a tempest-VolumesActionsTest-762406275 None] Lock "cinder-bdde83c0-d3b1-406d-b93e-ef59ca7e7b04-detach_volume" released by "detach_volume" :: held 0.090s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:26:18 devstack sudo[99371]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-951d4705-5c3f-462d-a1c6-c2cf28ca2572 tempest-VolumesSnapshotListTestJSON-1422414471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6.dbd57223-8345-4c6e-be7b-972203b7d13f" returned: 0 in 1.002s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:18 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-951d4705-5c3f-462d-a1c6-c2cf28ca2572 tempest-VolumesSnapshotListTestJSON-1422414471 None] Lock "cinder-quobyte-dbd57223-8345-4c6e-be7b-972203b7d13f" released by "_delete_snapshot" :: held 4.076s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:26:18 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-951d4705-5c3f-462d-a1c6-c2cf28ca2572 tempest-VolumesSnapshotListTestJSON-1422414471 None] Lock "cinder-quobyte-33ef38c7-4ece-4694-9dc5-474425466da6" released by "delete_snapshot" :: held 4.114s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:26:18 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-951d4705-5c3f-462d-a1c6-c2cf28ca2572 tempest-VolumesSnapshotListTestJSON-1422414471 None] Created reservations ['c76b0ff3-11a1-4033-bc48-7cd1f3c5d111', '6c8d0944-4cd9-4378-95eb-3356a58c8467', '56994424-1da9-4a1c-9e29-2a756a446824', '27de00da-15d6-4498-8e76-87edd04707dc'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:26:18 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-951d4705-5c3f-462d-a1c6-c2cf28ca2572 tempest-VolumesSnapshotListTestJSON-1422414471 None] Delete snapshot completed successfully. Jul 07 08:26:18 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-951d4705-5c3f-462d-a1c6-c2cf28ca2572 tempest-VolumesSnapshotListTestJSON-1422414471 None] Lock "cinder-dbd57223-8345-4c6e-be7b-972203b7d13f-delete_snapshot" released by "delete_snapshot" :: held 4.325s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:26:19 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3f660899-46be-488a-9173-d2af3a33526d tempest-VolumesSnapshotListTestJSON-1422414471 None] Acquiring lock "cinder-33ef38c7-4ece-4694-9dc5-474425466da6-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:26:19 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3f660899-46be-488a-9173-d2af3a33526d tempest-VolumesSnapshotListTestJSON-1422414471 None] Lock "cinder-33ef38c7-4ece-4694-9dc5-474425466da6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:26:19 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:UPDATE=131,cinder:SELECT=109,cinder:INSERT=28,cinder:DELETE=11 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:26:19 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=107,cinder:UPDATE=129,cinder:DELETE=11,cinder:INSERT=36 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:26:19 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3f660899-46be-488a-9173-d2af3a33526d tempest-VolumesSnapshotListTestJSON-1422414471 None] Acquiring lock "cinder-quobyte-33ef38c7-4ece-4694-9dc5-474425466da6" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:26:19 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3f660899-46be-488a-9173-d2af3a33526d tempest-VolumesSnapshotListTestJSON-1422414471 None] Lock "cinder-quobyte-33ef38c7-4ece-4694-9dc5-474425466da6" acquired by "delete_volume" :: waited 0.031s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:26:19 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd2ce23-8df1-4131-b8b3-a99f61b41719]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:26:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3f660899-46be-488a-9173-d2af3a33526d tempest-VolumesSnapshotListTestJSON-1422414471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:19 devstack sudo[99379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6 Jul 07 08:26:19 devstack sudo[99379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:20 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5743959-bedf-4ba9-a318-fe574be838a4 tempest-TestStampPattern-2031995845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:26:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f5743959-bedf-4ba9-a318-fe574be838a4 tempest-TestStampPattern-2031995845 None] Flow 'volume_create_manager' (152e8509-570a-4152-84af-53e3d0a087bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:26:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f5743959-bedf-4ba9-a318-fe574be838a4 tempest-TestStampPattern-2031995845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bf8f4ac-d043-45dc-a760-cb30e3e28c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:26:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f5743959-bedf-4ba9-a318-fe574be838a4 tempest-TestStampPattern-2031995845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bf8f4ac-d043-45dc-a760-cb30e3e28c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:26:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1491387966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41132466-ee52-4e9d-a449-1c486576cee9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='323a038e8c0d4dfea8968d1a5f7f5544',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d7dad97d-1709-4fad-9190-49f7de185111,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:26:20Z,use_quota=True,user_id='3f17c7d5b59d4a2d90921d3d9db63175',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:26:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f5743959-bedf-4ba9-a318-fe574be838a4 tempest-TestStampPattern-2031995845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03d416e8-14f9-49ba-ac17-8ab2206a301e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:26:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f5743959-bedf-4ba9-a318-fe574be838a4 tempest-TestStampPattern-2031995845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03d416e8-14f9-49ba-ac17-8ab2206a301e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:26:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f5743959-bedf-4ba9-a318-fe574be838a4 tempest-TestStampPattern-2031995845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ed778e6-e813-454b-ac1c-71ae8fe373f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:26:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f5743959-bedf-4ba9-a318-fe574be838a4 tempest-TestStampPattern-2031995845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ed778e6-e813-454b-ac1c-71ae8fe373f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '41132466-ee52-4e9d-a449-1c486576cee9', 'volume_name': 'volume-41132466-ee52-4e9d-a449-1c486576cee9', 'volume_size': 1, 'snapshot_id': 'd7dad97d-1709-4fad-9190-49f7de185111'}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:26:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f5743959-bedf-4ba9-a318-fe574be838a4 tempest-TestStampPattern-2031995845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (289da5f9-9898-4342-ae47-e9d96674950d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:26:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f5743959-bedf-4ba9-a318-fe574be838a4 tempest-TestStampPattern-2031995845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (289da5f9-9898-4342-ae47-e9d96674950d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:26:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f5743959-bedf-4ba9-a318-fe574be838a4 tempest-TestStampPattern-2031995845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afd7a309-eb02-4f8b-ab75-6bfa187a0c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:26:20 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-f5743959-bedf-4ba9-a318-fe574be838a4 tempest-TestStampPattern-2031995845 None] Volume 41132466-ee52-4e9d-a449-1c486576cee9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-41132466-ee52-4e9d-a449-1c486576cee9', 'volume_size': 1, 'snapshot_id': 'd7dad97d-1709-4fad-9190-49f7de185111'} Jul 07 08:26:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f5743959-bedf-4ba9-a318-fe574be838a4 tempest-TestStampPattern-2031995845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:26:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f5743959-bedf-4ba9-a318-fe574be838a4 tempest-TestStampPattern-2031995845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:26:20 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f5743959-bedf-4ba9-a318-fe574be838a4 tempest-TestStampPattern-2031995845 None] Acquiring lock "cinder-quobyte-d7dad97d-1709-4fad-9190-49f7de185111-41132466-ee52-4e9d-a449-1c486576cee9" by "_create_volume_from_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:26:20 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f5743959-bedf-4ba9-a318-fe574be838a4 tempest-TestStampPattern-2031995845 None] Lock "cinder-quobyte-d7dad97d-1709-4fad-9190-49f7de185111-41132466-ee52-4e9d-a449-1c486576cee9" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:26:20 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f5743959-bedf-4ba9-a318-fe574be838a4 tempest-TestStampPattern-2031995845 None] Creating volume 41132466-ee52-4e9d-a449-1c486576cee9 from snapshot d7dad97d-1709-4fad-9190-49f7de185111 {{(pid=87199) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 08:26:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f5743959-bedf-4ba9-a318-fe574be838a4 tempest-TestStampPattern-2031995845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:26:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f5743959-bedf-4ba9-a318-fe574be838a4 tempest-TestStampPattern-2031995845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:26:20 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f5743959-bedf-4ba9-a318-fe574be838a4 tempest-TestStampPattern-2031995845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:26:20 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f5743959-bedf-4ba9-a318-fe574be838a4 tempest-TestStampPattern-2031995845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:26:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f5743959-bedf-4ba9-a318-fe574be838a4 tempest-TestStampPattern-2031995845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:26:20 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f5743959-bedf-4ba9-a318-fe574be838a4 tempest-TestStampPattern-2031995845 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:26:20 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f5743959-bedf-4ba9-a318-fe574be838a4 tempest-TestStampPattern-2031995845 None] Acquiring lock "cinder-quobyte-41132466-ee52-4e9d-a449-1c486576cee9" by "_copy_volume_from_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:26:20 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f5743959-bedf-4ba9-a318-fe574be838a4 tempest-TestStampPattern-2031995845 None] Lock "cinder-quobyte-41132466-ee52-4e9d-a449-1c486576cee9" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:26:20 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f5743959-bedf-4ba9-a318-fe574be838a4 tempest-TestStampPattern-2031995845 None] snapshot: d7dad97d-1709-4fad-9190-49f7de185111, volume: 41132466-ee52-4e9d-a449-1c486576cee9, {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 08:26:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f5743959-bedf-4ba9-a318-fe574be838a4 tempest-TestStampPattern-2031995845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:26:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f5743959-bedf-4ba9-a318-fe574be838a4 tempest-TestStampPattern-2031995845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:26:20 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f5743959-bedf-4ba9-a318-fe574be838a4 tempest-TestStampPattern-2031995845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:26:20 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f5743959-bedf-4ba9-a318-fe574be838a4 tempest-TestStampPattern-2031995845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:26:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f5743959-bedf-4ba9-a318-fe574be838a4 tempest-TestStampPattern-2031995845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:26:20 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4ddf60-6211-43d1-bc15-5ae302a67642]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:26:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f5743959-bedf-4ba9-a318-fe574be838a4 tempest-TestStampPattern-2031995845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788.d7dad97d-1709-4fad-9190-49f7de185111 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:20 devstack sudo[99396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788.d7dad97d-1709-4fad-9190-49f7de185111 Jul 07 08:26:20 devstack sudo[99396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:20 devstack sudo[99379]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3f660899-46be-488a-9173-d2af3a33526d tempest-VolumesSnapshotListTestJSON-1422414471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6" returned: 0 in 1.121s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3f660899-46be-488a-9173-d2af3a33526d tempest-VolumesSnapshotListTestJSON-1422414471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:20 devstack sudo[99404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6 Jul 07 08:26:20 devstack sudo[99404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:21 devstack sudo[99396]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f5743959-bedf-4ba9-a318-fe574be838a4 tempest-TestStampPattern-2031995845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788.d7dad97d-1709-4fad-9190-49f7de185111" returned: 0 in 1.230s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:21 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-f5743959-bedf-4ba9-a318-fe574be838a4 tempest-TestStampPattern-2031995845 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:26:21 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f5743959-bedf-4ba9-a318-fe574be838a4 tempest-TestStampPattern-2031995845 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788 {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 08:26:21 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f5743959-bedf-4ba9-a318-fe574be838a4 tempest-TestStampPattern-2031995845 None] Creating direct copy from snapshot {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 08:26:21 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f4f824-bd4f-48ce-8295-3e2fcd10910a]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:26:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f5743959-bedf-4ba9-a318-fe574be838a4 tempest-TestStampPattern-2031995845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:21 devstack sudo[99413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788 Jul 07 08:26:21 devstack sudo[99413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:21 devstack sudo[99404]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3f660899-46be-488a-9173-d2af3a33526d tempest-VolumesSnapshotListTestJSON-1422414471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-33ef38c7-4ece-4694-9dc5-474425466da6" returned: 0 in 0.948s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:21 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3f660899-46be-488a-9173-d2af3a33526d tempest-VolumesSnapshotListTestJSON-1422414471 None] Lock "cinder-quobyte-33ef38c7-4ece-4694-9dc5-474425466da6" released by "delete_volume" :: held 2.150s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:26:21 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-3f660899-46be-488a-9173-d2af3a33526d tempest-VolumesSnapshotListTestJSON-1422414471 None] Created reservations ['1034aabc-246c-4ec4-9407-85c890ed1b57', '145b03eb-01ff-4e68-b80e-9313c14d9d11', '4a3ee821-830a-4657-9653-d78c81b6b125', '3dd051e2-de8e-4c94-9ff8-743cb17defd6'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:26:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3f660899-46be-488a-9173-d2af3a33526d tempest-VolumesSnapshotListTestJSON-1422414471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:26:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3f660899-46be-488a-9173-d2af3a33526d tempest-VolumesSnapshotListTestJSON-1422414471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:26:22 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-3f660899-46be-488a-9173-d2af3a33526d tempest-VolumesSnapshotListTestJSON-1422414471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:26:22 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-3f660899-46be-488a-9173-d2af3a33526d tempest-VolumesSnapshotListTestJSON-1422414471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:26:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3f660899-46be-488a-9173-d2af3a33526d tempest-VolumesSnapshotListTestJSON-1422414471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:26:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3f660899-46be-488a-9173-d2af3a33526d tempest-VolumesSnapshotListTestJSON-1422414471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:22 devstack sudo[99416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:26:22 devstack sudo[99416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:22 devstack sudo[99413]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f5743959-bedf-4ba9-a318-fe574be838a4 tempest-TestStampPattern-2031995845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788" returned: 0 in 0.907s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:22 devstack cinder-volume[87199]: DEBUG cinder.utils [None req-f5743959-bedf-4ba9-a318-fe574be838a4 tempest-TestStampPattern-2031995845 None] Path /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41132466-ee52-4e9d-a449-1c486576cee9 not found in is_blk_device check {{(pid=87199) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 08:26:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f5743959-bedf-4ba9-a318-fe574be838a4 tempest-TestStampPattern-2031995845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41132466-ee52-4e9d-a449-1c486576cee9 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:22 devstack sudo[99421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41132466-ee52-4e9d-a449-1c486576cee9 Jul 07 08:26:22 devstack sudo[99421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:22 devstack sudo[99416]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3f660899-46be-488a-9173-d2af3a33526d tempest-VolumesSnapshotListTestJSON-1422414471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.719s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:22 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-3f660899-46be-488a-9173-d2af3a33526d tempest-VolumesSnapshotListTestJSON-1422414471 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:26:22 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-3f660899-46be-488a-9173-d2af3a33526d tempest-VolumesSnapshotListTestJSON-1422414471 None] Deleted volume successfully. Jul 07 08:26:22 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3f660899-46be-488a-9173-d2af3a33526d tempest-VolumesSnapshotListTestJSON-1422414471 None] Lock "cinder-33ef38c7-4ece-4694-9dc5-474425466da6-delete_volume" released by "delete_volume" :: held 3.137s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:26:28 devstack sudo[99421]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f5743959-bedf-4ba9-a318-fe574be838a4 tempest-TestStampPattern-2031995845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41132466-ee52-4e9d-a449-1c486576cee9" returned: 0 in 6.354s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:28 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7ed7c1-6834-44ea-9a01-11b755895d37]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:26:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f5743959-bedf-4ba9-a318-fe574be838a4 tempest-TestStampPattern-2031995845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:29 devstack sudo[99438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788 Jul 07 08:26:29 devstack sudo[99438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:30 devstack sudo[99438]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f5743959-bedf-4ba9-a318-fe574be838a4 tempest-TestStampPattern-2031995845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788" returned: 0 in 1.501s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:30 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-f5743959-bedf-4ba9-a318-fe574be838a4 tempest-TestStampPattern-2031995845 None] Image conversion details: src /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788, size 1024.00 MB, duration 6.36 sec, destination /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41132466-ee52-4e9d-a449-1c486576cee9 {{(pid=87199) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 08:26:30 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-f5743959-bedf-4ba9-a318-fe574be838a4 tempest-TestStampPattern-2031995845 None] Converted 1024.00 MB image at 161.03 MB/s Jul 07 08:26:30 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-f5743959-bedf-4ba9-a318-fe574be838a4 tempest-TestStampPattern-2031995845 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41132466-ee52-4e9d-a449-1c486576cee9 is being set with open permissions: ugo+rw Jul 07 08:26:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f5743959-bedf-4ba9-a318-fe574be838a4 tempest-TestStampPattern-2031995845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41132466-ee52-4e9d-a449-1c486576cee9 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:30 devstack sudo[99451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41132466-ee52-4e9d-a449-1c486576cee9 Jul 07 08:26:30 devstack sudo[99451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:31 devstack sudo[99451]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f5743959-bedf-4ba9-a318-fe574be838a4 tempest-TestStampPattern-2031995845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41132466-ee52-4e9d-a449-1c486576cee9" returned: 0 in 0.945s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:31 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f5743959-bedf-4ba9-a318-fe574be838a4 tempest-TestStampPattern-2031995845 None] Lock "cinder-quobyte-41132466-ee52-4e9d-a449-1c486576cee9" released by "_copy_volume_from_snapshot" :: held 11.096s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:26:31 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f5743959-bedf-4ba9-a318-fe574be838a4 tempest-TestStampPattern-2031995845 None] Lock "cinder-quobyte-d7dad97d-1709-4fad-9190-49f7de185111-41132466-ee52-4e9d-a449-1c486576cee9" released by "_create_volume_from_snapshot" :: held 11.145s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:26:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f5743959-bedf-4ba9-a318-fe574be838a4 tempest-TestStampPattern-2031995845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.175s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:26:31 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f5743959-bedf-4ba9-a318-fe574be838a4 tempest-TestStampPattern-2031995845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afd7a309-eb02-4f8b-ab75-6bfa187a0c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41132466-ee52-4e9d-a449-1c486576cee9', 'volume_size': 1, 'snapshot_id': 'd7dad97d-1709-4fad-9190-49f7de185111'}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:26:31 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f5743959-bedf-4ba9-a318-fe574be838a4 tempest-TestStampPattern-2031995845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06cbb22d-ed05-4a21-847d-eb378bd7fcbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:26:31 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-f5743959-bedf-4ba9-a318-fe574be838a4 tempest-TestStampPattern-2031995845 None] Volume volume-41132466-ee52-4e9d-a449-1c486576cee9 (41132466-ee52-4e9d-a449-1c486576cee9): created successfully Jul 07 08:26:31 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f5743959-bedf-4ba9-a318-fe574be838a4 tempest-TestStampPattern-2031995845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06cbb22d-ed05-4a21-847d-eb378bd7fcbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:26:31 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f5743959-bedf-4ba9-a318-fe574be838a4 tempest-TestStampPattern-2031995845 None] Flow 'volume_create_manager' (152e8509-570a-4152-84af-53e3d0a087bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:26:31 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-f5743959-bedf-4ba9-a318-fe574be838a4 tempest-TestStampPattern-2031995845 None] Created volume successfully. Jul 07 08:26:41 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=6,cinder:UPDATE=12,cinder:INSERT=3 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:26:41 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=7,cinder:DELETE=2 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:26:51 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-66ec4bf0-28e7-484e-ad22-ff8446ffefda tempest-VolumesActionsTest-762406275 None] Acquiring lock "cinder-bdde83c0-d3b1-406d-b93e-ef59ca7e7b04" by "attach_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:26:51 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-66ec4bf0-28e7-484e-ad22-ff8446ffefda tempest-VolumesActionsTest-762406275 None] Lock "cinder-bdde83c0-d3b1-406d-b93e-ef59ca7e7b04" acquired by "attach_volume" :: waited 0.024s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:26:51 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-66ec4bf0-28e7-484e-ad22-ff8446ffefda tempest-VolumesActionsTest-762406275 None] Attaching volume bdde83c0-d3b1-406d-b93e-ef59ca7e7b04 to instance 5b9bf910-07bf-422b-ab01-79fa68fc0b73 at mountpoint /dev/vdb on host None. Jul 07 08:26:51 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-66ec4bf0-28e7-484e-ad22-ff8446ffefda tempest-VolumesActionsTest-762406275 None] Attach volume completed successfully. Jul 07 08:26:51 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-66ec4bf0-28e7-484e-ad22-ff8446ffefda tempest-VolumesActionsTest-762406275 None] Lock "cinder-bdde83c0-d3b1-406d-b93e-ef59ca7e7b04" released by "attach_volume" :: held 0.110s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:26:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-417aca58-8963-435a-a84d-b17fe33817ff tempest-VolumesActionsTest-762406275 None] Acquiring lock "cinder-bdde83c0-d3b1-406d-b93e-ef59ca7e7b04-detach_volume" by "detach_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:26:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-417aca58-8963-435a-a84d-b17fe33817ff tempest-VolumesActionsTest-762406275 None] Lock "cinder-bdde83c0-d3b1-406d-b93e-ef59ca7e7b04-detach_volume" acquired by "detach_volume" :: waited 0.025s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:26:52 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-417aca58-8963-435a-a84d-b17fe33817ff tempest-VolumesActionsTest-762406275 None] Detaching volume bdde83c0-d3b1-406d-b93e-ef59ca7e7b04 from instance 5b9bf910-07bf-422b-ab01-79fa68fc0b73. Jul 07 08:26:52 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-417aca58-8963-435a-a84d-b17fe33817ff tempest-VolumesActionsTest-762406275 None] Detach volume completed successfully. Jul 07 08:26:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-417aca58-8963-435a-a84d-b17fe33817ff tempest-VolumesActionsTest-762406275 None] Lock "cinder-bdde83c0-d3b1-406d-b93e-ef59ca7e7b04-detach_volume" released by "detach_volume" :: held 0.066s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:27:02 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:INSERT=2,cinder:SELECT=7,cinder:UPDATE=2 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:27:02 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=6,cinder:UPDATE=4 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:27:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-801e8c11-d404-4189-9fe0-7c64fb244ccc tempest-VolumesActionsTest-762406275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:27:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-801e8c11-d404-4189-9fe0-7c64fb244ccc tempest-VolumesActionsTest-762406275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:27:02 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f60b21-bada-4400-b17f-5f5dea07e0b1]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:27:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-801e8c11-d404-4189-9fe0-7c64fb244ccc tempest-VolumesActionsTest-762406275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-bdde83c0-d3b1-406d-b93e-ef59ca7e7b04 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:02 devstack sudo[99696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-bdde83c0-d3b1-406d-b93e-ef59ca7e7b04 Jul 07 08:27:02 devstack sudo[99696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:03 devstack sudo[99696]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-801e8c11-d404-4189-9fe0-7c64fb244ccc tempest-VolumesActionsTest-762406275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-bdde83c0-d3b1-406d-b93e-ef59ca7e7b04" returned: 0 in 0.795s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:03 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aca12d7-e503-4456-89a9-03fb88e0d385]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:27:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-801e8c11-d404-4189-9fe0-7c64fb244ccc tempest-VolumesActionsTest-762406275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-bdde83c0-d3b1-406d-b93e-ef59ca7e7b04 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:03 devstack sudo[99701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-bdde83c0-d3b1-406d-b93e-ef59ca7e7b04 Jul 07 08:27:03 devstack sudo[99701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:04 devstack sudo[99701]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-801e8c11-d404-4189-9fe0-7c64fb244ccc tempest-VolumesActionsTest-762406275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-bdde83c0-d3b1-406d-b93e-ef59ca7e7b04" returned: 0 in 0.920s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-801e8c11-d404-4189-9fe0-7c64fb244ccc tempest-VolumesActionsTest-762406275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-bdde83c0-d3b1-406d-b93e-ef59ca7e7b04 /opt/stack/data/cinder/conversion/bdde83c0-d3b1-406d-b93e-ef59ca7e7b04.temp_image.dca1187c-0055-4f37-822e-a4be9bbc91b06tp2bnpw.img {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:04 devstack sudo[99706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-bdde83c0-d3b1-406d-b93e-ef59ca7e7b04 /opt/stack/data/cinder/conversion/bdde83c0-d3b1-406d-b93e-ef59ca7e7b04.temp_image.dca1187c-0055-4f37-822e-a4be9bbc91b06tp2bnpw.img Jul 07 08:27:04 devstack sudo[99706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:05 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:27:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:27:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:27:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:27:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:27:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:27:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:06 devstack sudo[99718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:27:06 devstack sudo[99718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:08 devstack sudo[99718]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 2.180s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:08 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:27:08 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running periodic task VolumeManager._thread_info {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:27:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] thread count: 29 {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 08:27:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] thread info: [<_MainThread(MainThread, started 133056092332160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 08:27:10 devstack sudo[99706]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-801e8c11-d404-4189-9fe0-7c64fb244ccc tempest-VolumesActionsTest-762406275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-bdde83c0-d3b1-406d-b93e-ef59ca7e7b04 /opt/stack/data/cinder/conversion/bdde83c0-d3b1-406d-b93e-ef59ca7e7b04.temp_image.dca1187c-0055-4f37-822e-a4be9bbc91b06tp2bnpw.img" returned: 0 in 5.876s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:10 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eea79ef-6c6d-4ba7-aba3-0447c99b6b4e]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:27:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-801e8c11-d404-4189-9fe0-7c64fb244ccc tempest-VolumesActionsTest-762406275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-bdde83c0-d3b1-406d-b93e-ef59ca7e7b04 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:10 devstack sudo[99750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-bdde83c0-d3b1-406d-b93e-ef59ca7e7b04 Jul 07 08:27:10 devstack sudo[99750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:10 devstack sudo[99750]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-801e8c11-d404-4189-9fe0-7c64fb244ccc tempest-VolumesActionsTest-762406275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-bdde83c0-d3b1-406d-b93e-ef59ca7e7b04" returned: 0 in 0.930s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:11 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-801e8c11-d404-4189-9fe0-7c64fb244ccc tempest-VolumesActionsTest-762406275 None] Image conversion details: src /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-bdde83c0-d3b1-406d-b93e-ef59ca7e7b04, size 1024.00 MB, duration 5.88 sec, destination /opt/stack/data/cinder/conversion/bdde83c0-d3b1-406d-b93e-ef59ca7e7b04.temp_image.dca1187c-0055-4f37-822e-a4be9bbc91b06tp2bnpw.img {{(pid=87199) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 08:27:11 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-801e8c11-d404-4189-9fe0-7c64fb244ccc tempest-VolumesActionsTest-762406275 None] Converted 1024.00 MB image at 174.23 MB/s Jul 07 08:27:11 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-801e8c11-d404-4189-9fe0-7c64fb244ccc tempest-VolumesActionsTest-762406275 None] dca1187c-0055-4f37-822e-a4be9bbc91b0 was raw, no need to convert to raw {{(pid=87199) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 07 08:27:12 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=1 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:27:18 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-e18d38cc-82d7-4e2e-bacd-86c893cc3c41 tempest-TestMinimumBasicScenario-1903662404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:27:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e18d38cc-82d7-4e2e-bacd-86c893cc3c41 tempest-TestMinimumBasicScenario-1903662404 None] Flow 'volume_create_manager' (cd2f7dd5-45c2-4148-a4e0-450af37e0658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:27:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e18d38cc-82d7-4e2e-bacd-86c893cc3c41 tempest-TestMinimumBasicScenario-1903662404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc3b7d80-313e-4fa6-9fef-52cf3bbef6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:27:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e18d38cc-82d7-4e2e-bacd-86c893cc3c41 tempest-TestMinimumBasicScenario-1903662404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc3b7d80-313e-4fa6-9fef-52cf3bbef6ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-798571531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e47cd42-8ea1-4176-98fd-07717a63f2d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a94cce19bda4195bd739b35fc1b5625',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:27:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:27:18Z,use_quota=True,user_id='133d03c830244f959b8fd62ee729d943',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:27:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e18d38cc-82d7-4e2e-bacd-86c893cc3c41 tempest-TestMinimumBasicScenario-1903662404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (052da1de-c6d9-4ade-8bb4-b85bfa231a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:27:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e18d38cc-82d7-4e2e-bacd-86c893cc3c41 tempest-TestMinimumBasicScenario-1903662404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (052da1de-c6d9-4ade-8bb4-b85bfa231a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:27:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e18d38cc-82d7-4e2e-bacd-86c893cc3c41 tempest-TestMinimumBasicScenario-1903662404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (827facc9-0bd6-4f8b-96df-139eac8d991f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:27:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e18d38cc-82d7-4e2e-bacd-86c893cc3c41 tempest-TestMinimumBasicScenario-1903662404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (827facc9-0bd6-4f8b-96df-139eac8d991f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e47cd42-8ea1-4176-98fd-07717a63f2d2', 'volume_name': 'volume-6e47cd42-8ea1-4176-98fd-07717a63f2d2', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:27:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e18d38cc-82d7-4e2e-bacd-86c893cc3c41 tempest-TestMinimumBasicScenario-1903662404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a476959-c8ef-440f-a87f-4081a2057b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:27:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e18d38cc-82d7-4e2e-bacd-86c893cc3c41 tempest-TestMinimumBasicScenario-1903662404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a476959-c8ef-440f-a87f-4081a2057b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:27:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e18d38cc-82d7-4e2e-bacd-86c893cc3c41 tempest-TestMinimumBasicScenario-1903662404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3c8af84-aa32-46f9-8569-8ed7ebcf0ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:27:18 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-e18d38cc-82d7-4e2e-bacd-86c893cc3c41 tempest-TestMinimumBasicScenario-1903662404 None] Volume 6e47cd42-8ea1-4176-98fd-07717a63f2d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e47cd42-8ea1-4176-98fd-07717a63f2d2', 'volume_size': 1} Jul 07 08:27:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e18d38cc-82d7-4e2e-bacd-86c893cc3c41 tempest-TestMinimumBasicScenario-1903662404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:27:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-2c2b9d76-5b2d-4e55-b194-7c99dd57dce4 req-ce261591-6b08-4749-b597-a89306e009cd tempest-TestStampPattern-2031995845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:27:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-801e8c11-d404-4189-9fe0-7c64fb244ccc tempest-VolumesActionsTest-762406275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.433s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:27:31 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-801e8c11-d404-4189-9fe0-7c64fb244ccc tempest-VolumesActionsTest-762406275 None] Uploaded volume to glance image-id: dca1187c-0055-4f37-822e-a4be9bbc91b0. {{(pid=87199) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 07 08:27:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e18d38cc-82d7-4e2e-bacd-86c893cc3c41 tempest-TestMinimumBasicScenario-1903662404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.425s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:27:31 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e18d38cc-82d7-4e2e-bacd-86c893cc3c41 tempest-TestMinimumBasicScenario-1903662404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-798571531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e47cd42-8ea1-4176-98fd-07717a63f2d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a94cce19bda4195bd739b35fc1b5625',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:27:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:27:18Z,use_quota=True,user_id='133d03c830244f959b8fd62ee729d943',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:27:31 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-e18d38cc-82d7-4e2e-bacd-86c893cc3c41 tempest-TestMinimumBasicScenario-1903662404 None] Creating volume 6e47cd42-8ea1-4176-98fd-07717a63f2d2 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:27:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e18d38cc-82d7-4e2e-bacd-86c893cc3c41 tempest-TestMinimumBasicScenario-1903662404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:27:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e18d38cc-82d7-4e2e-bacd-86c893cc3c41 tempest-TestMinimumBasicScenario-1903662404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:27:31 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e18d38cc-82d7-4e2e-bacd-86c893cc3c41 tempest-TestMinimumBasicScenario-1903662404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:27:31 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e18d38cc-82d7-4e2e-bacd-86c893cc3c41 tempest-TestMinimumBasicScenario-1903662404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:27:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e18d38cc-82d7-4e2e-bacd-86c893cc3c41 tempest-TestMinimumBasicScenario-1903662404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:27:31 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e18d38cc-82d7-4e2e-bacd-86c893cc3c41 tempest-TestMinimumBasicScenario-1903662404 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:27:31 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-e18d38cc-82d7-4e2e-bacd-86c893cc3c41 tempest-TestMinimumBasicScenario-1903662404 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:27:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e18d38cc-82d7-4e2e-bacd-86c893cc3c41 tempest-TestMinimumBasicScenario-1903662404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e47cd42-8ea1-4176-98fd-07717a63f2d2 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:31 devstack sudo[99893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e47cd42-8ea1-4176-98fd-07717a63f2d2 1073741824 Jul 07 08:27:31 devstack sudo[99893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:31 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-801e8c11-d404-4189-9fe0-7c64fb244ccc tempest-VolumesActionsTest-762406275 None] Copy volume to image completed successfully. Jul 07 08:27:32 devstack sudo[99893]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e18d38cc-82d7-4e2e-bacd-86c893cc3c41 tempest-TestMinimumBasicScenario-1903662404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e47cd42-8ea1-4176-98fd-07717a63f2d2 1073741824" returned: 0 in 1.073s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e18d38cc-82d7-4e2e-bacd-86c893cc3c41 tempest-TestMinimumBasicScenario-1903662404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e47cd42-8ea1-4176-98fd-07717a63f2d2 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:33 devstack sudo[99935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e47cd42-8ea1-4176-98fd-07717a63f2d2 Jul 07 08:27:33 devstack sudo[99935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:33 devstack sudo[99935]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e18d38cc-82d7-4e2e-bacd-86c893cc3c41 tempest-TestMinimumBasicScenario-1903662404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e47cd42-8ea1-4176-98fd-07717a63f2d2" returned: 0 in 0.747s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:33 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e18d38cc-82d7-4e2e-bacd-86c893cc3c41 tempest-TestMinimumBasicScenario-1903662404 None] <== create_volume: return (1917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:27:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e18d38cc-82d7-4e2e-bacd-86c893cc3c41 tempest-TestMinimumBasicScenario-1903662404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.920s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:27:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-2c2b9d76-5b2d-4e55-b194-7c99dd57dce4 req-ce261591-6b08-4749-b597-a89306e009cd tempest-TestStampPattern-2031995845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.665s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:27:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e18d38cc-82d7-4e2e-bacd-86c893cc3c41 tempest-TestMinimumBasicScenario-1903662404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3c8af84-aa32-46f9-8569-8ed7ebcf0ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e47cd42-8ea1-4176-98fd-07717a63f2d2', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:27:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e18d38cc-82d7-4e2e-bacd-86c893cc3c41 tempest-TestMinimumBasicScenario-1903662404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6daf2d1f-a553-476a-8e9a-31a7f61a10ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:27:33 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[902fcb42-1844-46f2-a078-67611670bbe1]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:27:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-2c2b9d76-5b2d-4e55-b194-7c99dd57dce4 req-ce261591-6b08-4749-b597-a89306e009cd tempest-TestStampPattern-2031995845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41132466-ee52-4e9d-a449-1c486576cee9 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:33 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-e18d38cc-82d7-4e2e-bacd-86c893cc3c41 tempest-TestMinimumBasicScenario-1903662404 None] Volume volume-6e47cd42-8ea1-4176-98fd-07717a63f2d2 (6e47cd42-8ea1-4176-98fd-07717a63f2d2): created successfully Jul 07 08:27:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e18d38cc-82d7-4e2e-bacd-86c893cc3c41 tempest-TestMinimumBasicScenario-1903662404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6daf2d1f-a553-476a-8e9a-31a7f61a10ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:27:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e18d38cc-82d7-4e2e-bacd-86c893cc3c41 tempest-TestMinimumBasicScenario-1903662404 None] Flow 'volume_create_manager' (cd2f7dd5-45c2-4148-a4e0-450af37e0658) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:27:33 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-e18d38cc-82d7-4e2e-bacd-86c893cc3c41 tempest-TestMinimumBasicScenario-1903662404 None] Created volume successfully. Jul 07 08:27:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c680ece6-4611-4c1b-bfda-5c8595614a77 tempest-VolumesActionsTest-762406275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:27:33 devstack sudo[99938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41132466-ee52-4e9d-a449-1c486576cee9 Jul 07 08:27:34 devstack sudo[99938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:34 devstack sudo[99938]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-2c2b9d76-5b2d-4e55-b194-7c99dd57dce4 req-ce261591-6b08-4749-b597-a89306e009cd tempest-TestStampPattern-2031995845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41132466-ee52-4e9d-a449-1c486576cee9" returned: 0 in 0.859s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-2c2b9d76-5b2d-4e55-b194-7c99dd57dce4 req-ce261591-6b08-4749-b597-a89306e009cd tempest-TestStampPattern-2031995845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.892s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:27:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c680ece6-4611-4c1b-bfda-5c8595614a77 tempest-VolumesActionsTest-762406275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.700s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:27:34 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[51474aee-0602-4db1-80f8-e1b4c24ebafb]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:27:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c680ece6-4611-4c1b-bfda-5c8595614a77 tempest-VolumesActionsTest-762406275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-bdde83c0-d3b1-406d-b93e-ef59ca7e7b04 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-2c2b9d76-5b2d-4e55-b194-7c99dd57dce4 req-ce261591-6b08-4749-b597-a89306e009cd tempest-TestStampPattern-2031995845 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b', 'name': 'volume-41132466-ee52-4e9d-a449-1c486576cee9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '57e9826d-fb91-4b1d-b4d6-93365c9d9a4f', 'enforce_multipath': True} {{(pid=87199) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 08:27:34 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-2c2b9d76-5b2d-4e55-b194-7c99dd57dce4 req-ce261591-6b08-4749-b597-a89306e009cd tempest-TestStampPattern-2031995845 None] attachment_update completed successfully. Jul 07 08:27:34 devstack sudo[99946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-bdde83c0-d3b1-406d-b93e-ef59ca7e7b04 Jul 07 08:27:34 devstack sudo[99946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:35 devstack sudo[99946]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c680ece6-4611-4c1b-bfda-5c8595614a77 tempest-VolumesActionsTest-762406275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-bdde83c0-d3b1-406d-b93e-ef59ca7e7b04" returned: 0 in 0.811s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:35 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f5d877-286e-4482-b8cd-4a6c583cbf2d]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:27:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c680ece6-4611-4c1b-bfda-5c8595614a77 tempest-VolumesActionsTest-762406275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-bdde83c0-d3b1-406d-b93e-ef59ca7e7b04 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:35 devstack sudo[100018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-bdde83c0-d3b1-406d-b93e-ef59ca7e7b04 Jul 07 08:27:35 devstack sudo[100018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:36 devstack sudo[100018]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c680ece6-4611-4c1b-bfda-5c8595614a77 tempest-VolumesActionsTest-762406275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-bdde83c0-d3b1-406d-b93e-ef59ca7e7b04" returned: 0 in 0.799s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c680ece6-4611-4c1b-bfda-5c8595614a77 tempest-VolumesActionsTest-762406275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-bdde83c0-d3b1-406d-b93e-ef59ca7e7b04 /opt/stack/data/cinder/conversion/bdde83c0-d3b1-406d-b93e-ef59ca7e7b04.temp_image.16146ea7-1a88-41a7-94b3-55c8fc61bd9f50cahbhb.img {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:36 devstack sudo[100338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-bdde83c0-d3b1-406d-b93e-ef59ca7e7b04 /opt/stack/data/cinder/conversion/bdde83c0-d3b1-406d-b93e-ef59ca7e7b04.temp_image.16146ea7-1a88-41a7-94b3-55c8fc61bd9f50cahbhb.img Jul 07 08:27:36 devstack sudo[100338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-04553733-06da-4992-bd1a-e01df9855f74 req-0d919a44-71d0-49ce-9db5-2b00e4895ba9 tempest-TestMinimumBasicScenario-1903662404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:27:41 devstack sudo[100338]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c680ece6-4611-4c1b-bfda-5c8595614a77 tempest-VolumesActionsTest-762406275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-bdde83c0-d3b1-406d-b93e-ef59ca7e7b04 /opt/stack/data/cinder/conversion/bdde83c0-d3b1-406d-b93e-ef59ca7e7b04.temp_image.16146ea7-1a88-41a7-94b3-55c8fc61bd9f50cahbhb.img" returned: 0 in 5.051s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:41 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9f77c2-7ce5-49ce-a5be-78e129e5d926]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:27:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c680ece6-4611-4c1b-bfda-5c8595614a77 tempest-VolumesActionsTest-762406275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-bdde83c0-d3b1-406d-b93e-ef59ca7e7b04 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:41 devstack sudo[100376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-bdde83c0-d3b1-406d-b93e-ef59ca7e7b04 Jul 07 08:27:41 devstack sudo[100376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:42 devstack sudo[100376]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c680ece6-4611-4c1b-bfda-5c8595614a77 tempest-VolumesActionsTest-762406275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-bdde83c0-d3b1-406d-b93e-ef59ca7e7b04" returned: 0 in 0.873s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:42 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-c680ece6-4611-4c1b-bfda-5c8595614a77 tempest-VolumesActionsTest-762406275 None] Image conversion details: src /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-bdde83c0-d3b1-406d-b93e-ef59ca7e7b04, size 1024.00 MB, duration 5.05 sec, destination /opt/stack/data/cinder/conversion/bdde83c0-d3b1-406d-b93e-ef59ca7e7b04.temp_image.16146ea7-1a88-41a7-94b3-55c8fc61bd9f50cahbhb.img {{(pid=87199) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 08:27:42 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-c680ece6-4611-4c1b-bfda-5c8595614a77 tempest-VolumesActionsTest-762406275 None] Converted 1024.00 MB image at 202.68 MB/s Jul 07 08:27:42 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-c680ece6-4611-4c1b-bfda-5c8595614a77 tempest-VolumesActionsTest-762406275 None] 16146ea7-1a88-41a7-94b3-55c8fc61bd9f was raw, converting to qcow2 {{(pid=87199) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 07 08:27:42 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee8d460-e9bc-4ef1-840b-183fd56d6df3]: (4, 'raw') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:27:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c680ece6-4611-4c1b-bfda-5c8595614a77 tempest-VolumesActionsTest-762406275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/bdde83c0-d3b1-406d-b93e-ef59ca7e7b04.temp_image.16146ea7-1a88-41a7-94b3-55c8fc61bd9f50cahbhb.img {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:42 devstack sudo[100381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/bdde83c0-d3b1-406d-b93e-ef59ca7e7b04.temp_image.16146ea7-1a88-41a7-94b3-55c8fc61bd9f50cahbhb.img Jul 07 08:27:42 devstack sudo[100381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:42 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-c46cf440-0107-4b72-9e32-57090e5a6f6c req-5500d2de-2746-41fb-b652-1388eb25a815 tempest-TestStampPattern-2031995845 None] Terminate volume connection completed successfully. Jul 07 08:27:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-c46cf440-0107-4b72-9e32-57090e5a6f6c req-5500d2de-2746-41fb-b652-1388eb25a815 tempest-TestStampPattern-2031995845 None] Deleting attachment 57e9826d-fb91-4b1d-b4d6-93365c9d9a4f. {{(pid=87199) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 08:27:43 devstack sudo[100381]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c680ece6-4611-4c1b-bfda-5c8595614a77 tempest-VolumesActionsTest-762406275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/bdde83c0-d3b1-406d-b93e-ef59ca7e7b04.temp_image.16146ea7-1a88-41a7-94b3-55c8fc61bd9f50cahbhb.img" returned: 0 in 0.775s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c680ece6-4611-4c1b-bfda-5c8595614a77 tempest-VolumesActionsTest-762406275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/bdde83c0-d3b1-406d-b93e-ef59ca7e7b04.temp_image.16146ea7-1a88-41a7-94b3-55c8fc61bd9f50cahbhb.img {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:43 devstack sudo[100413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/bdde83c0-d3b1-406d-b93e-ef59ca7e7b04.temp_image.16146ea7-1a88-41a7-94b3-55c8fc61bd9f50cahbhb.img Jul 07 08:27:43 devstack sudo[100413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:43 devstack sudo[100413]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c680ece6-4611-4c1b-bfda-5c8595614a77 tempest-VolumesActionsTest-762406275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/bdde83c0-d3b1-406d-b93e-ef59ca7e7b04.temp_image.16146ea7-1a88-41a7-94b3-55c8fc61bd9f50cahbhb.img" returned: 1 in 0.749s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c680ece6-4611-4c1b-bfda-5c8595614a77 tempest-VolumesActionsTest-762406275 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/bdde83c0-d3b1-406d-b93e-ef59ca7e7b04.temp_image.16146ea7-1a88-41a7-94b3-55c8fc61bd9f50cahbhb.img' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:27:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c680ece6-4611-4c1b-bfda-5c8595614a77 tempest-VolumesActionsTest-762406275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/bdde83c0-d3b1-406d-b93e-ef59ca7e7b04.temp_image.16146ea7-1a88-41a7-94b3-55c8fc61bd9f50cahbhb.img /opt/stack/data/cinder/conversion/vol_upload_qqoz_y63 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:43 devstack sudo[100418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/bdde83c0-d3b1-406d-b93e-ef59ca7e7b04.temp_image.16146ea7-1a88-41a7-94b3-55c8fc61bd9f50cahbhb.img /opt/stack/data/cinder/conversion/vol_upload_qqoz_y63 Jul 07 08:27:43 devstack sudo[100418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:44 devstack sudo[100418]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c680ece6-4611-4c1b-bfda-5c8595614a77 tempest-VolumesActionsTest-762406275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/bdde83c0-d3b1-406d-b93e-ef59ca7e7b04.temp_image.16146ea7-1a88-41a7-94b3-55c8fc61bd9f50cahbhb.img /opt/stack/data/cinder/conversion/vol_upload_qqoz_y63" returned: 0 in 0.653s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:44 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-c680ece6-4611-4c1b-bfda-5c8595614a77 tempest-VolumesActionsTest-762406275 None] Image conversion details: src /opt/stack/data/cinder/conversion/bdde83c0-d3b1-406d-b93e-ef59ca7e7b04.temp_image.16146ea7-1a88-41a7-94b3-55c8fc61bd9f50cahbhb.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_qqoz_y63 {{(pid=87199) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 08:27:44 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-c680ece6-4611-4c1b-bfda-5c8595614a77 tempest-VolumesActionsTest-762406275 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 07 08:27:44 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c75653-2171-4f3e-858f-39c0caca8bca]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:27:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c680ece6-4611-4c1b-bfda-5c8595614a77 tempest-VolumesActionsTest-762406275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_qqoz_y63 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:44 devstack sudo[100424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_qqoz_y63 Jul 07 08:27:44 devstack sudo[100424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:45 devstack sudo[100424]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c680ece6-4611-4c1b-bfda-5c8595614a77 tempest-VolumesActionsTest-762406275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_qqoz_y63" returned: 0 in 0.843s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c680ece6-4611-4c1b-bfda-5c8595614a77 tempest-VolumesActionsTest-762406275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.116s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:27:46 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c680ece6-4611-4c1b-bfda-5c8595614a77 tempest-VolumesActionsTest-762406275 None] Uploaded volume to glance image-id: 16146ea7-1a88-41a7-94b3-55c8fc61bd9f. {{(pid=87199) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 07 08:27:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-04553733-06da-4992-bd1a-e01df9855f74 req-0d919a44-71d0-49ce-9db5-2b00e4895ba9 tempest-TestMinimumBasicScenario-1903662404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.599s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:27:46 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e294e6d-f773-45fb-b471-da84cc94ebb9]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:27:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-04553733-06da-4992-bd1a-e01df9855f74 req-0d919a44-71d0-49ce-9db5-2b00e4895ba9 tempest-TestMinimumBasicScenario-1903662404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e47cd42-8ea1-4176-98fd-07717a63f2d2 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:46 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-c680ece6-4611-4c1b-bfda-5c8595614a77 tempest-VolumesActionsTest-762406275 None] Copy volume to image completed successfully. Jul 07 08:27:46 devstack sudo[100438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e47cd42-8ea1-4176-98fd-07717a63f2d2 Jul 07 08:27:46 devstack sudo[100438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:47 devstack sudo[100438]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-04553733-06da-4992-bd1a-e01df9855f74 req-0d919a44-71d0-49ce-9db5-2b00e4895ba9 tempest-TestMinimumBasicScenario-1903662404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e47cd42-8ea1-4176-98fd-07717a63f2d2" returned: 0 in 1.035s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-04553733-06da-4992-bd1a-e01df9855f74 req-0d919a44-71d0-49ce-9db5-2b00e4895ba9 tempest-TestMinimumBasicScenario-1903662404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.059s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:27:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-04553733-06da-4992-bd1a-e01df9855f74 req-0d919a44-71d0-49ce-9db5-2b00e4895ba9 tempest-TestMinimumBasicScenario-1903662404 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b', 'name': 'volume-6e47cd42-8ea1-4176-98fd-07717a63f2d2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0b9311d7-7424-43a6-8f84-1bf616b06ad0', 'enforce_multipath': True} {{(pid=87199) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 08:27:47 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-04553733-06da-4992-bd1a-e01df9855f74 req-0d919a44-71d0-49ce-9db5-2b00e4895ba9 tempest-TestMinimumBasicScenario-1903662404 None] attachment_update completed successfully. Jul 07 08:27:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7d6f31a9-8fd7-4168-a556-7cdcebcbd62e tempest-VolumesActionsTest-762406275 None] Acquiring lock "cinder-bdde83c0-d3b1-406d-b93e-ef59ca7e7b04-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:27:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7d6f31a9-8fd7-4168-a556-7cdcebcbd62e tempest-VolumesActionsTest-762406275 None] Lock "cinder-bdde83c0-d3b1-406d-b93e-ef59ca7e7b04-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:27:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7d6f31a9-8fd7-4168-a556-7cdcebcbd62e tempest-VolumesActionsTest-762406275 None] Acquiring lock "cinder-quobyte-bdde83c0-d3b1-406d-b93e-ef59ca7e7b04" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:27:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7d6f31a9-8fd7-4168-a556-7cdcebcbd62e tempest-VolumesActionsTest-762406275 None] Lock "cinder-quobyte-bdde83c0-d3b1-406d-b93e-ef59ca7e7b04" acquired by "delete_volume" :: waited 0.023s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:27:48 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b19c6d-9573-4d14-b29d-8fd7b212a573]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:27:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7d6f31a9-8fd7-4168-a556-7cdcebcbd62e tempest-VolumesActionsTest-762406275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-bdde83c0-d3b1-406d-b93e-ef59ca7e7b04 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:48 devstack sudo[100536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-bdde83c0-d3b1-406d-b93e-ef59ca7e7b04 Jul 07 08:27:48 devstack sudo[100536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:49 devstack sudo[100536]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7d6f31a9-8fd7-4168-a556-7cdcebcbd62e tempest-VolumesActionsTest-762406275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-bdde83c0-d3b1-406d-b93e-ef59ca7e7b04" returned: 0 in 0.819s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7d6f31a9-8fd7-4168-a556-7cdcebcbd62e tempest-VolumesActionsTest-762406275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-bdde83c0-d3b1-406d-b93e-ef59ca7e7b04 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:49 devstack sudo[100857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-bdde83c0-d3b1-406d-b93e-ef59ca7e7b04 Jul 07 08:27:49 devstack sudo[100857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:50 devstack sudo[100857]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7d6f31a9-8fd7-4168-a556-7cdcebcbd62e tempest-VolumesActionsTest-762406275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-bdde83c0-d3b1-406d-b93e-ef59ca7e7b04" returned: 0 in 0.674s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:50 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7d6f31a9-8fd7-4168-a556-7cdcebcbd62e tempest-VolumesActionsTest-762406275 None] Lock "cinder-quobyte-bdde83c0-d3b1-406d-b93e-ef59ca7e7b04" released by "delete_volume" :: held 1.540s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:27:50 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-7d6f31a9-8fd7-4168-a556-7cdcebcbd62e tempest-VolumesActionsTest-762406275 None] Created reservations ['2a637c43-7205-4219-a81e-6d2224d423c9', '846dc05e-9119-455a-ad7e-b376e00b3491', '722894c7-c1af-4002-9f0d-62e4d3b6e67b', 'cd98ebb6-c301-470e-81eb-98e8c0a6f6c3'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:27:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7d6f31a9-8fd7-4168-a556-7cdcebcbd62e tempest-VolumesActionsTest-762406275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:27:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7d6f31a9-8fd7-4168-a556-7cdcebcbd62e tempest-VolumesActionsTest-762406275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:27:50 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-7d6f31a9-8fd7-4168-a556-7cdcebcbd62e tempest-VolumesActionsTest-762406275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:27:50 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-7d6f31a9-8fd7-4168-a556-7cdcebcbd62e tempest-VolumesActionsTest-762406275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:27:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7d6f31a9-8fd7-4168-a556-7cdcebcbd62e tempest-VolumesActionsTest-762406275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:27:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7d6f31a9-8fd7-4168-a556-7cdcebcbd62e tempest-VolumesActionsTest-762406275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:50 devstack sudo[100860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:27:50 devstack sudo[100860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:50 devstack sudo[100860]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7d6f31a9-8fd7-4168-a556-7cdcebcbd62e tempest-VolumesActionsTest-762406275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.713s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:50 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-7d6f31a9-8fd7-4168-a556-7cdcebcbd62e tempest-VolumesActionsTest-762406275 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:27:51 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-7d6f31a9-8fd7-4168-a556-7cdcebcbd62e tempest-VolumesActionsTest-762406275 None] Deleted volume successfully. Jul 07 08:27:51 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7d6f31a9-8fd7-4168-a556-7cdcebcbd62e tempest-VolumesActionsTest-762406275 None] Lock "cinder-bdde83c0-d3b1-406d-b93e-ef59ca7e7b04-delete_volume" released by "delete_volume" :: held 2.499s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:27:53 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-51ed237b-9c1e-42c6-898c-daf806d82d19 tempest-TestStampPattern-2031995845 None] Acquiring lock "cinder-41132466-ee52-4e9d-a449-1c486576cee9-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:27:53 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-51ed237b-9c1e-42c6-898c-daf806d82d19 tempest-TestStampPattern-2031995845 None] Lock "cinder-41132466-ee52-4e9d-a449-1c486576cee9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:27:53 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-51ed237b-9c1e-42c6-898c-daf806d82d19 tempest-TestStampPattern-2031995845 None] Acquiring lock "cinder-quobyte-41132466-ee52-4e9d-a449-1c486576cee9" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:27:53 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-51ed237b-9c1e-42c6-898c-daf806d82d19 tempest-TestStampPattern-2031995845 None] Lock "cinder-quobyte-41132466-ee52-4e9d-a449-1c486576cee9" acquired by "delete_volume" :: waited 0.054s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:27:53 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2feb2bc-9126-44e9-90f1-d1d7fd97a886]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:27:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-51ed237b-9c1e-42c6-898c-daf806d82d19 tempest-TestStampPattern-2031995845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41132466-ee52-4e9d-a449-1c486576cee9 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:53 devstack sudo[100865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41132466-ee52-4e9d-a449-1c486576cee9 Jul 07 08:27:53 devstack sudo[100865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:54 devstack sudo[100865]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-51ed237b-9c1e-42c6-898c-daf806d82d19 tempest-TestStampPattern-2031995845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41132466-ee52-4e9d-a449-1c486576cee9" returned: 0 in 0.894s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-51ed237b-9c1e-42c6-898c-daf806d82d19 tempest-TestStampPattern-2031995845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41132466-ee52-4e9d-a449-1c486576cee9 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:54 devstack sudo[100870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41132466-ee52-4e9d-a449-1c486576cee9 Jul 07 08:27:54 devstack sudo[100870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:54 devstack sudo[100870]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-51ed237b-9c1e-42c6-898c-daf806d82d19 tempest-TestStampPattern-2031995845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41132466-ee52-4e9d-a449-1c486576cee9" returned: 0 in 0.746s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:54 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-51ed237b-9c1e-42c6-898c-daf806d82d19 tempest-TestStampPattern-2031995845 None] Lock "cinder-quobyte-41132466-ee52-4e9d-a449-1c486576cee9" released by "delete_volume" :: held 1.709s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:27:54 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-51ed237b-9c1e-42c6-898c-daf806d82d19 tempest-TestStampPattern-2031995845 None] Created reservations ['5db83a52-15b2-4688-b9b6-41ba5fcde476', '1bc35444-36d2-4424-a2e0-855507749580', '298a5478-75ff-47a2-bf7a-0d20eba272e9', 'b74cacef-b480-4b44-ae9e-660966d494a1'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:27:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-51ed237b-9c1e-42c6-898c-daf806d82d19 tempest-TestStampPattern-2031995845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:27:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-51ed237b-9c1e-42c6-898c-daf806d82d19 tempest-TestStampPattern-2031995845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:27:55 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-51ed237b-9c1e-42c6-898c-daf806d82d19 tempest-TestStampPattern-2031995845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:27:55 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-51ed237b-9c1e-42c6-898c-daf806d82d19 tempest-TestStampPattern-2031995845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:27:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-51ed237b-9c1e-42c6-898c-daf806d82d19 tempest-TestStampPattern-2031995845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:27:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-51ed237b-9c1e-42c6-898c-daf806d82d19 tempest-TestStampPattern-2031995845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:55 devstack sudo[100875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:27:55 devstack sudo[100875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:55 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-99f89765-fd4e-433a-9bdf-23c6a21cfdb0 tempest-TestStampPattern-2031995845 None] Acquiring lock "cinder-d7dad97d-1709-4fad-9190-49f7de185111-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:27:55 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-99f89765-fd4e-433a-9bdf-23c6a21cfdb0 tempest-TestStampPattern-2031995845 None] Lock "cinder-d7dad97d-1709-4fad-9190-49f7de185111-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:27:55 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-99f89765-fd4e-433a-9bdf-23c6a21cfdb0 tempest-TestStampPattern-2031995845 None] Acquiring lock "cinder-quobyte-5ab52e0c-f1b1-4225-b8bd-7bc07317f788" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:27:55 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-99f89765-fd4e-433a-9bdf-23c6a21cfdb0 tempest-TestStampPattern-2031995845 None] Lock "cinder-quobyte-5ab52e0c-f1b1-4225-b8bd-7bc07317f788" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:27:55 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-99f89765-fd4e-433a-9bdf-23c6a21cfdb0 tempest-TestStampPattern-2031995845 None] Acquiring lock "cinder-quobyte-d7dad97d-1709-4fad-9190-49f7de185111" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:27:55 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-99f89765-fd4e-433a-9bdf-23c6a21cfdb0 tempest-TestStampPattern-2031995845 None] Lock "cinder-quobyte-d7dad97d-1709-4fad-9190-49f7de185111" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:27:55 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-99f89765-fd4e-433a-9bdf-23c6a21cfdb0 tempest-TestStampPattern-2031995845 None] Deleting offline snapshot d7dad97d-1709-4fad-9190-49f7de185111 of volume 5ab52e0c-f1b1-4225-b8bd-7bc07317f788 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:27:55 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-99f89765-fd4e-433a-9bdf-23c6a21cfdb0 tempest-TestStampPattern-2031995845 None] snapshot_file for this snap is: volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788.d7dad97d-1709-4fad-9190-49f7de185111 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:27:55 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5367a6-702f-4b92-a6ee-c19de85bc540]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:27:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-99f89765-fd4e-433a-9bdf-23c6a21cfdb0 tempest-TestStampPattern-2031995845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788.d7dad97d-1709-4fad-9190-49f7de185111 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:56 devstack sudo[100878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788.d7dad97d-1709-4fad-9190-49f7de185111 Jul 07 08:27:56 devstack sudo[100878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:56 devstack sudo[100875]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-51ed237b-9c1e-42c6-898c-daf806d82d19 tempest-TestStampPattern-2031995845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 1.377s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:56 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-51ed237b-9c1e-42c6-898c-daf806d82d19 tempest-TestStampPattern-2031995845 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:27:56 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-51ed237b-9c1e-42c6-898c-daf806d82d19 tempest-TestStampPattern-2031995845 None] Deleted volume successfully. Jul 07 08:27:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-51ed237b-9c1e-42c6-898c-daf806d82d19 tempest-TestStampPattern-2031995845 None] Lock "cinder-41132466-ee52-4e9d-a449-1c486576cee9-delete_volume" released by "delete_volume" :: held 3.412s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:27:57 devstack sudo[100878]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-99f89765-fd4e-433a-9bdf-23c6a21cfdb0 tempest-TestStampPattern-2031995845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788.d7dad97d-1709-4fad-9190-49f7de185111" returned: 0 in 1.131s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-99f89765-fd4e-433a-9bdf-23c6a21cfdb0 tempest-TestStampPattern-2031995845 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:27:57 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[148f3167-3e0f-47e6-b188-4eb1f0e00aed]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:27:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-99f89765-fd4e-433a-9bdf-23c6a21cfdb0 tempest-TestStampPattern-2031995845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:57 devstack sudo[100884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788 Jul 07 08:27:57 devstack sudo[100884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:58 devstack sudo[100884]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-99f89765-fd4e-433a-9bdf-23c6a21cfdb0 tempest-TestStampPattern-2031995845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788" returned: 0 in 0.908s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-99f89765-fd4e-433a-9bdf-23c6a21cfdb0 tempest-TestStampPattern-2031995845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788.d7dad97d-1709-4fad-9190-49f7de185111 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:58 devstack sudo[100889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788.d7dad97d-1709-4fad-9190-49f7de185111 Jul 07 08:27:58 devstack sudo[100889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:58 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-51d679a0-0817-405e-b4fc-f776afaaae1d tempest-VolumesCloneNegativeTest-434853174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:27:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-51d679a0-0817-405e-b4fc-f776afaaae1d tempest-VolumesCloneNegativeTest-434853174 None] Flow 'volume_create_manager' (661333e6-0991-4890-a465-9d8f7b21f66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:27:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-51d679a0-0817-405e-b4fc-f776afaaae1d tempest-VolumesCloneNegativeTest-434853174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa8ae311-210a-4c18-b082-3cdbb848da40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:27:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-51d679a0-0817-405e-b4fc-f776afaaae1d tempest-VolumesCloneNegativeTest-434853174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa8ae311-210a-4c18-b082-3cdbb848da40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-936264375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ca72331-cdcc-4340-8af3-ad9200a47743,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ae0f8cdeb8d481688fa59602b3c4e37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:27:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:27:58Z,use_quota=True,user_id='47a584bc92a24f56a9cff8dfe704ef8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:27:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-51d679a0-0817-405e-b4fc-f776afaaae1d tempest-VolumesCloneNegativeTest-434853174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96d04a06-7edd-46cf-b401-b49dc456d7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:27:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-51d679a0-0817-405e-b4fc-f776afaaae1d tempest-VolumesCloneNegativeTest-434853174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96d04a06-7edd-46cf-b401-b49dc456d7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:27:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-51d679a0-0817-405e-b4fc-f776afaaae1d tempest-VolumesCloneNegativeTest-434853174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23c62b14-e1ae-4b5b-a36a-4cfe6bbe122b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:27:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-51d679a0-0817-405e-b4fc-f776afaaae1d tempest-VolumesCloneNegativeTest-434853174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23c62b14-e1ae-4b5b-a36a-4cfe6bbe122b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ca72331-cdcc-4340-8af3-ad9200a47743', 'volume_name': 'volume-8ca72331-cdcc-4340-8af3-ad9200a47743', 'volume_size': 2}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:27:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-51d679a0-0817-405e-b4fc-f776afaaae1d tempest-VolumesCloneNegativeTest-434853174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfc839c3-7806-4a8f-88d7-1b9b31ad4b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:27:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-51d679a0-0817-405e-b4fc-f776afaaae1d tempest-VolumesCloneNegativeTest-434853174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfc839c3-7806-4a8f-88d7-1b9b31ad4b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:27:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-51d679a0-0817-405e-b4fc-f776afaaae1d tempest-VolumesCloneNegativeTest-434853174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b810e8e-a09b-4ad6-bc8a-865367276590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:27:58 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-51d679a0-0817-405e-b4fc-f776afaaae1d tempest-VolumesCloneNegativeTest-434853174 None] Volume 8ca72331-cdcc-4340-8af3-ad9200a47743: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ca72331-cdcc-4340-8af3-ad9200a47743', 'volume_size': 2} Jul 07 08:27:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-51d679a0-0817-405e-b4fc-f776afaaae1d tempest-VolumesCloneNegativeTest-434853174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:27:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-51d679a0-0817-405e-b4fc-f776afaaae1d tempest-VolumesCloneNegativeTest-434853174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:27:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-51d679a0-0817-405e-b4fc-f776afaaae1d tempest-VolumesCloneNegativeTest-434853174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-936264375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ca72331-cdcc-4340-8af3-ad9200a47743,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ae0f8cdeb8d481688fa59602b3c4e37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:27:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:27:58Z,use_quota=True,user_id='47a584bc92a24f56a9cff8dfe704ef8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:27:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-51d679a0-0817-405e-b4fc-f776afaaae1d tempest-VolumesCloneNegativeTest-434853174 None] Creating volume 8ca72331-cdcc-4340-8af3-ad9200a47743 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:27:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-51d679a0-0817-405e-b4fc-f776afaaae1d tempest-VolumesCloneNegativeTest-434853174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:27:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-51d679a0-0817-405e-b4fc-f776afaaae1d tempest-VolumesCloneNegativeTest-434853174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:27:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-51d679a0-0817-405e-b4fc-f776afaaae1d tempest-VolumesCloneNegativeTest-434853174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:27:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-51d679a0-0817-405e-b4fc-f776afaaae1d tempest-VolumesCloneNegativeTest-434853174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:27:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-51d679a0-0817-405e-b4fc-f776afaaae1d tempest-VolumesCloneNegativeTest-434853174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:27:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-51d679a0-0817-405e-b4fc-f776afaaae1d tempest-VolumesCloneNegativeTest-434853174 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:27:58 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-51d679a0-0817-405e-b4fc-f776afaaae1d tempest-VolumesCloneNegativeTest-434853174 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:27:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-51d679a0-0817-405e-b4fc-f776afaaae1d tempest-VolumesCloneNegativeTest-434853174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8ca72331-cdcc-4340-8af3-ad9200a47743 2147483648 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:58 devstack sudo[100891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8ca72331-cdcc-4340-8af3-ad9200a47743 2147483648 Jul 07 08:27:58 devstack sudo[100891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:58 devstack sudo[100889]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-99f89765-fd4e-433a-9bdf-23c6a21cfdb0 tempest-TestStampPattern-2031995845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788.d7dad97d-1709-4fad-9190-49f7de185111" returned: 0 in 0.853s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-99f89765-fd4e-433a-9bdf-23c6a21cfdb0 tempest-TestStampPattern-2031995845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788.d7dad97d-1709-4fad-9190-49f7de185111 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:58 devstack sudo[100897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788.d7dad97d-1709-4fad-9190-49f7de185111 Jul 07 08:27:58 devstack sudo[100897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:59 devstack sudo[100891]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-51d679a0-0817-405e-b4fc-f776afaaae1d tempest-VolumesCloneNegativeTest-434853174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8ca72331-cdcc-4340-8af3-ad9200a47743 2147483648" returned: 0 in 0.966s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-51d679a0-0817-405e-b4fc-f776afaaae1d tempest-VolumesCloneNegativeTest-434853174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8ca72331-cdcc-4340-8af3-ad9200a47743 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:59 devstack sudo[100903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8ca72331-cdcc-4340-8af3-ad9200a47743 Jul 07 08:27:59 devstack sudo[100903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:59 devstack sudo[100897]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-99f89765-fd4e-433a-9bdf-23c6a21cfdb0 tempest-TestStampPattern-2031995845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788.d7dad97d-1709-4fad-9190-49f7de185111" returned: 0 in 0.738s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:59 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-99f89765-fd4e-433a-9bdf-23c6a21cfdb0 tempest-TestStampPattern-2031995845 None] Lock "cinder-quobyte-d7dad97d-1709-4fad-9190-49f7de185111" released by "_delete_snapshot" :: held 3.825s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:27:59 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-99f89765-fd4e-433a-9bdf-23c6a21cfdb0 tempest-TestStampPattern-2031995845 None] Lock "cinder-quobyte-5ab52e0c-f1b1-4225-b8bd-7bc07317f788" released by "delete_snapshot" :: held 3.867s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:27:59 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-99f89765-fd4e-433a-9bdf-23c6a21cfdb0 tempest-TestStampPattern-2031995845 None] Created reservations ['9497d8ee-e6e5-49d3-b9f7-93e12ef08fe8', 'a5afa3a9-6578-4431-85cd-121b9eb1dc6d', '6a4e3869-e43a-4e0c-be8f-2d9b5b094c8f', '72b699e6-50a2-407f-bb55-e98c2124bb82'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:27:59 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-99f89765-fd4e-433a-9bdf-23c6a21cfdb0 tempest-TestStampPattern-2031995845 None] Delete snapshot completed successfully. Jul 07 08:27:59 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-99f89765-fd4e-433a-9bdf-23c6a21cfdb0 tempest-TestStampPattern-2031995845 None] Lock "cinder-d7dad97d-1709-4fad-9190-49f7de185111-delete_snapshot" released by "delete_snapshot" :: held 4.038s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:28:00 devstack sudo[100903]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-51d679a0-0817-405e-b4fc-f776afaaae1d tempest-VolumesCloneNegativeTest-434853174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8ca72331-cdcc-4340-8af3-ad9200a47743" returned: 0 in 0.704s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:00 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-51d679a0-0817-405e-b4fc-f776afaaae1d tempest-VolumesCloneNegativeTest-434853174 None] <== create_volume: return (1722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:28:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-51d679a0-0817-405e-b4fc-f776afaaae1d tempest-VolumesCloneNegativeTest-434853174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.724s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:28:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-51d679a0-0817-405e-b4fc-f776afaaae1d tempest-VolumesCloneNegativeTest-434853174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b810e8e-a09b-4ad6-bc8a-865367276590) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ca72331-cdcc-4340-8af3-ad9200a47743', 'volume_size': 2}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-51d679a0-0817-405e-b4fc-f776afaaae1d tempest-VolumesCloneNegativeTest-434853174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82978d6c-e69b-4e03-b854-07e877b52941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:00 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-51d679a0-0817-405e-b4fc-f776afaaae1d tempest-VolumesCloneNegativeTest-434853174 None] Volume volume-8ca72331-cdcc-4340-8af3-ad9200a47743 (8ca72331-cdcc-4340-8af3-ad9200a47743): created successfully Jul 07 08:28:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-51d679a0-0817-405e-b4fc-f776afaaae1d tempest-VolumesCloneNegativeTest-434853174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82978d6c-e69b-4e03-b854-07e877b52941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-51d679a0-0817-405e-b4fc-f776afaaae1d tempest-VolumesCloneNegativeTest-434853174 None] Flow 'volume_create_manager' (661333e6-0991-4890-a465-9d8f7b21f66b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:28:00 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-51d679a0-0817-405e-b4fc-f776afaaae1d tempest-VolumesCloneNegativeTest-434853174 None] Created volume successfully. Jul 07 08:28:00 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f430d7b6-e611-4fdf-829a-2418a76f6387 tempest-VolumesCloneNegativeTest-434853174 None] Acquiring lock "cinder-8ca72331-cdcc-4340-8af3-ad9200a47743-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:28:00 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f430d7b6-e611-4fdf-829a-2418a76f6387 tempest-VolumesCloneNegativeTest-434853174 None] Lock "cinder-8ca72331-cdcc-4340-8af3-ad9200a47743-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:28:00 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f430d7b6-e611-4fdf-829a-2418a76f6387 tempest-VolumesCloneNegativeTest-434853174 None] Acquiring lock "cinder-quobyte-8ca72331-cdcc-4340-8af3-ad9200a47743" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:28:00 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f430d7b6-e611-4fdf-829a-2418a76f6387 tempest-VolumesCloneNegativeTest-434853174 None] Lock "cinder-quobyte-8ca72331-cdcc-4340-8af3-ad9200a47743" acquired by "delete_volume" :: waited 0.022s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:28:00 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b59ec4-5463-4e56-a2cd-ae990ea14f15]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:28:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f430d7b6-e611-4fdf-829a-2418a76f6387 tempest-VolumesCloneNegativeTest-434853174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8ca72331-cdcc-4340-8af3-ad9200a47743 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:00 devstack sudo[100910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8ca72331-cdcc-4340-8af3-ad9200a47743 Jul 07 08:28:00 devstack sudo[100910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:01 devstack sudo[100910]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f430d7b6-e611-4fdf-829a-2418a76f6387 tempest-VolumesCloneNegativeTest-434853174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8ca72331-cdcc-4340-8af3-ad9200a47743" returned: 0 in 0.884s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f430d7b6-e611-4fdf-829a-2418a76f6387 tempest-VolumesCloneNegativeTest-434853174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8ca72331-cdcc-4340-8af3-ad9200a47743 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:01 devstack sudo[100920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8ca72331-cdcc-4340-8af3-ad9200a47743 Jul 07 08:28:01 devstack sudo[100920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:02 devstack sudo[100920]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f430d7b6-e611-4fdf-829a-2418a76f6387 tempest-VolumesCloneNegativeTest-434853174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8ca72331-cdcc-4340-8af3-ad9200a47743" returned: 0 in 0.701s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:02 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f430d7b6-e611-4fdf-829a-2418a76f6387 tempest-VolumesCloneNegativeTest-434853174 None] Lock "cinder-quobyte-8ca72331-cdcc-4340-8af3-ad9200a47743" released by "delete_volume" :: held 1.638s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:28:02 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=36,cinder:UPDATE=29,cinder:DELETE=3,cinder:INSERT=8 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:28:02 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-f430d7b6-e611-4fdf-829a-2418a76f6387 tempest-VolumesCloneNegativeTest-434853174 None] Created reservations ['b0ec3dd6-63e8-45b8-978e-38844b02448d', 'a95efb74-a467-43bf-b72d-e92ae60cbccf', 'cb21bc71-afee-4b4f-9cc5-43ee0492facf', '4aa17187-c5f0-410b-b69c-2da272c3e5b2'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:28:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f430d7b6-e611-4fdf-829a-2418a76f6387 tempest-VolumesCloneNegativeTest-434853174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:28:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f430d7b6-e611-4fdf-829a-2418a76f6387 tempest-VolumesCloneNegativeTest-434853174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:28:02 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f430d7b6-e611-4fdf-829a-2418a76f6387 tempest-VolumesCloneNegativeTest-434853174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:28:02 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f430d7b6-e611-4fdf-829a-2418a76f6387 tempest-VolumesCloneNegativeTest-434853174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:28:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f430d7b6-e611-4fdf-829a-2418a76f6387 tempest-VolumesCloneNegativeTest-434853174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:28:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f430d7b6-e611-4fdf-829a-2418a76f6387 tempest-VolumesCloneNegativeTest-434853174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:02 devstack sudo[100925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:28:02 devstack sudo[100925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:03 devstack sudo[100925]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f430d7b6-e611-4fdf-829a-2418a76f6387 tempest-VolumesCloneNegativeTest-434853174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.903s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:03 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-f430d7b6-e611-4fdf-829a-2418a76f6387 tempest-VolumesCloneNegativeTest-434853174 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:28:03 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-f430d7b6-e611-4fdf-829a-2418a76f6387 tempest-VolumesCloneNegativeTest-434853174 None] Deleted volume successfully. Jul 07 08:28:03 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f430d7b6-e611-4fdf-829a-2418a76f6387 tempest-VolumesCloneNegativeTest-434853174 None] Lock "cinder-8ca72331-cdcc-4340-8af3-ad9200a47743-delete_volume" released by "delete_volume" :: held 2.770s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:28:05 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:28:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:28:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:28:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:28:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:28:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:28:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:05 devstack sudo[100950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:28:05 devstack sudo[100950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:06 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a27e4ae-ddc4-4289-836c-bf059c660e70 tempest-VolumesNegativeTest-1277888213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:28:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1a27e4ae-ddc4-4289-836c-bf059c660e70 tempest-VolumesNegativeTest-1277888213 None] Flow 'volume_create_manager' (d9190ee9-a642-4b4f-8d78-f7dcf929cb57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:28:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1a27e4ae-ddc4-4289-836c-bf059c660e70 tempest-VolumesNegativeTest-1277888213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f56bb7df-96d8-44fd-b1a5-6d726c3e81ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1a27e4ae-ddc4-4289-836c-bf059c660e70 tempest-VolumesNegativeTest-1277888213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f56bb7df-96d8-44fd-b1a5-6d726c3e81ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:28:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-530987323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61621d42-79f4-40c1-a2bf-56ae05079749,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29a09f5da06642b8bf0f9c2ee855004a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:28:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:28:06Z,use_quota=True,user_id='bb767c5d5535435ebcabac62b919d6aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1a27e4ae-ddc4-4289-836c-bf059c660e70 tempest-VolumesNegativeTest-1277888213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (badeba83-6d2c-427d-b567-11c3996d2253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1a27e4ae-ddc4-4289-836c-bf059c660e70 tempest-VolumesNegativeTest-1277888213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (badeba83-6d2c-427d-b567-11c3996d2253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1a27e4ae-ddc4-4289-836c-bf059c660e70 tempest-VolumesNegativeTest-1277888213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dc1308e-9404-4cde-8a8f-f501afa425a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1a27e4ae-ddc4-4289-836c-bf059c660e70 tempest-VolumesNegativeTest-1277888213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dc1308e-9404-4cde-8a8f-f501afa425a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61621d42-79f4-40c1-a2bf-56ae05079749', 'volume_name': 'volume-61621d42-79f4-40c1-a2bf-56ae05079749', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1a27e4ae-ddc4-4289-836c-bf059c660e70 tempest-VolumesNegativeTest-1277888213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d19bbee-da3d-470a-820c-3f4fdcda104a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1a27e4ae-ddc4-4289-836c-bf059c660e70 tempest-VolumesNegativeTest-1277888213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d19bbee-da3d-470a-820c-3f4fdcda104a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1a27e4ae-ddc4-4289-836c-bf059c660e70 tempest-VolumesNegativeTest-1277888213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c94f99fe-c824-4ab1-bbf0-8b24959134ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:06 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-1a27e4ae-ddc4-4289-836c-bf059c660e70 tempest-VolumesNegativeTest-1277888213 None] Volume 61621d42-79f4-40c1-a2bf-56ae05079749: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61621d42-79f4-40c1-a2bf-56ae05079749', 'volume_size': 1} Jul 07 08:28:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1a27e4ae-ddc4-4289-836c-bf059c660e70 tempest-VolumesNegativeTest-1277888213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:28:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1a27e4ae-ddc4-4289-836c-bf059c660e70 tempest-VolumesNegativeTest-1277888213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:28:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1a27e4ae-ddc4-4289-836c-bf059c660e70 tempest-VolumesNegativeTest-1277888213 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:28:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-530987323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61621d42-79f4-40c1-a2bf-56ae05079749,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29a09f5da06642b8bf0f9c2ee855004a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:28:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:28:06Z,use_quota=True,user_id='bb767c5d5535435ebcabac62b919d6aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:28:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-1a27e4ae-ddc4-4289-836c-bf059c660e70 tempest-VolumesNegativeTest-1277888213 None] Creating volume 61621d42-79f4-40c1-a2bf-56ae05079749 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:28:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1a27e4ae-ddc4-4289-836c-bf059c660e70 tempest-VolumesNegativeTest-1277888213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:28:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1a27e4ae-ddc4-4289-836c-bf059c660e70 tempest-VolumesNegativeTest-1277888213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:28:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1a27e4ae-ddc4-4289-836c-bf059c660e70 tempest-VolumesNegativeTest-1277888213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:28:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1a27e4ae-ddc4-4289-836c-bf059c660e70 tempest-VolumesNegativeTest-1277888213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:28:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1a27e4ae-ddc4-4289-836c-bf059c660e70 tempest-VolumesNegativeTest-1277888213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:28:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1a27e4ae-ddc4-4289-836c-bf059c660e70 tempest-VolumesNegativeTest-1277888213 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:28:06 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-1a27e4ae-ddc4-4289-836c-bf059c660e70 tempest-VolumesNegativeTest-1277888213 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:28:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1a27e4ae-ddc4-4289-836c-bf059c660e70 tempest-VolumesNegativeTest-1277888213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61621d42-79f4-40c1-a2bf-56ae05079749 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:06 devstack sudo[100954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61621d42-79f4-40c1-a2bf-56ae05079749 1073741824 Jul 07 08:28:06 devstack sudo[100954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:06 devstack sudo[100950]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.751s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:06 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:28:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running periodic task VolumeManager._thread_info {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:28:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] thread count: 29 {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 08:28:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] thread info: [<_MainThread(MainThread, started 133056092332160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 08:28:07 devstack sudo[100954]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1a27e4ae-ddc4-4289-836c-bf059c660e70 tempest-VolumesNegativeTest-1277888213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61621d42-79f4-40c1-a2bf-56ae05079749 1073741824" returned: 0 in 0.902s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1a27e4ae-ddc4-4289-836c-bf059c660e70 tempest-VolumesNegativeTest-1277888213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61621d42-79f4-40c1-a2bf-56ae05079749 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:07 devstack sudo[100975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61621d42-79f4-40c1-a2bf-56ae05079749 Jul 07 08:28:07 devstack sudo[100975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:07 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9fb48278-f97c-4f4b-8e73-8dc64c5c9964 tempest-TestStampPattern-2031995845 None] Acquiring lock "cinder-5ab52e0c-f1b1-4225-b8bd-7bc07317f788-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:28:07 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9fb48278-f97c-4f4b-8e73-8dc64c5c9964 tempest-TestStampPattern-2031995845 None] Lock "cinder-5ab52e0c-f1b1-4225-b8bd-7bc07317f788-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:28:07 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9fb48278-f97c-4f4b-8e73-8dc64c5c9964 tempest-TestStampPattern-2031995845 None] Acquiring lock "cinder-quobyte-5ab52e0c-f1b1-4225-b8bd-7bc07317f788" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:28:08 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9fb48278-f97c-4f4b-8e73-8dc64c5c9964 tempest-TestStampPattern-2031995845 None] Lock "cinder-quobyte-5ab52e0c-f1b1-4225-b8bd-7bc07317f788" acquired by "delete_volume" :: waited 0.020s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:28:08 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[2baa8f2c-ed8b-4a26-82d6-7ed488de27be]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:28:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9fb48278-f97c-4f4b-8e73-8dc64c5c9964 tempest-TestStampPattern-2031995845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:08 devstack sudo[100975]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1a27e4ae-ddc4-4289-836c-bf059c660e70 tempest-VolumesNegativeTest-1277888213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61621d42-79f4-40c1-a2bf-56ae05079749" returned: 0 in 0.685s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:08 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1a27e4ae-ddc4-4289-836c-bf059c660e70 tempest-VolumesNegativeTest-1277888213 None] <== create_volume: return (1632ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:28:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1a27e4ae-ddc4-4289-836c-bf059c660e70 tempest-VolumesNegativeTest-1277888213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.635s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:28:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1a27e4ae-ddc4-4289-836c-bf059c660e70 tempest-VolumesNegativeTest-1277888213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c94f99fe-c824-4ab1-bbf0-8b24959134ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61621d42-79f4-40c1-a2bf-56ae05079749', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1a27e4ae-ddc4-4289-836c-bf059c660e70 tempest-VolumesNegativeTest-1277888213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a20b006e-3254-4fa7-a662-5767d7224fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:08 devstack sudo[100988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788 Jul 07 08:28:08 devstack sudo[100988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:08 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-1a27e4ae-ddc4-4289-836c-bf059c660e70 tempest-VolumesNegativeTest-1277888213 None] Volume volume-61621d42-79f4-40c1-a2bf-56ae05079749 (61621d42-79f4-40c1-a2bf-56ae05079749): created successfully Jul 07 08:28:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1a27e4ae-ddc4-4289-836c-bf059c660e70 tempest-VolumesNegativeTest-1277888213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a20b006e-3254-4fa7-a662-5767d7224fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1a27e4ae-ddc4-4289-836c-bf059c660e70 tempest-VolumesNegativeTest-1277888213 None] Flow 'volume_create_manager' (d9190ee9-a642-4b4f-8d78-f7dcf929cb57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:28:08 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-1a27e4ae-ddc4-4289-836c-bf059c660e70 tempest-VolumesNegativeTest-1277888213 None] Created volume successfully. Jul 07 08:28:08 devstack sudo[100988]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9fb48278-f97c-4f4b-8e73-8dc64c5c9964 tempest-TestStampPattern-2031995845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788" returned: 0 in 0.907s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9fb48278-f97c-4f4b-8e73-8dc64c5c9964 tempest-TestStampPattern-2031995845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:08 devstack sudo[101019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788 Jul 07 08:28:08 devstack sudo[101019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:09 devstack sudo[101019]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9fb48278-f97c-4f4b-8e73-8dc64c5c9964 tempest-TestStampPattern-2031995845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5ab52e0c-f1b1-4225-b8bd-7bc07317f788" returned: 0 in 0.901s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:09 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9fb48278-f97c-4f4b-8e73-8dc64c5c9964 tempest-TestStampPattern-2031995845 None] Lock "cinder-quobyte-5ab52e0c-f1b1-4225-b8bd-7bc07317f788" released by "delete_volume" :: held 1.878s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:28:09 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-9fb48278-f97c-4f4b-8e73-8dc64c5c9964 tempest-TestStampPattern-2031995845 None] Created reservations ['b831fb9a-92a9-4006-a012-40f909cd3e8a', '448c15a6-08e7-48a2-a9c5-286747483294', 'c117740b-0572-48da-b02c-59e1544e25fa', 'aefa6862-1417-4709-b452-5562f430d5aa'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:28:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9fb48278-f97c-4f4b-8e73-8dc64c5c9964 tempest-TestStampPattern-2031995845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:28:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9fb48278-f97c-4f4b-8e73-8dc64c5c9964 tempest-TestStampPattern-2031995845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:28:10 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-9fb48278-f97c-4f4b-8e73-8dc64c5c9964 tempest-TestStampPattern-2031995845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:28:10 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-9fb48278-f97c-4f4b-8e73-8dc64c5c9964 tempest-TestStampPattern-2031995845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:28:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9fb48278-f97c-4f4b-8e73-8dc64c5c9964 tempest-TestStampPattern-2031995845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:28:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9fb48278-f97c-4f4b-8e73-8dc64c5c9964 tempest-TestStampPattern-2031995845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:10 devstack sudo[101026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:28:10 devstack sudo[101026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:10 devstack sudo[101026]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9fb48278-f97c-4f4b-8e73-8dc64c5c9964 tempest-TestStampPattern-2031995845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.855s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:10 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-9fb48278-f97c-4f4b-8e73-8dc64c5c9964 tempest-TestStampPattern-2031995845 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:28:10 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-9fb48278-f97c-4f4b-8e73-8dc64c5c9964 tempest-TestStampPattern-2031995845 None] Deleted volume successfully. Jul 07 08:28:10 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9fb48278-f97c-4f4b-8e73-8dc64c5c9964 tempest-TestStampPattern-2031995845 None] Lock "cinder-5ab52e0c-f1b1-4225-b8bd-7bc07317f788-delete_volume" released by "delete_volume" :: held 2.985s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:28:19 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:UPDATE=20,cinder:SELECT=7,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:28:20 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:UPDATE=53,cinder:SELECT=52,cinder:INSERT=11,cinder:DELETE=3 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:28:24 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a5883b5-02d0-4d88-bde9-598e2249e83d tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:28:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1a5883b5-02d0-4d88-bde9-598e2249e83d tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Flow 'volume_create_manager' (75f3eca7-b04e-4740-9ae9-64698c909842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:28:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1a5883b5-02d0-4d88-bde9-598e2249e83d tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (387e4e7f-5e95-45c2-9420-b630681e0047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1a5883b5-02d0-4d88-bde9-598e2249e83d tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (387e4e7f-5e95-45c2-9420-b630681e0047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-120120287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a06499a-d41b-48a1-a326-876e54d616e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c26df1c845534dd3ba7b5383cd107a71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:28:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:28:24Z,use_quota=True,user_id='da5a30dab44e4cb8820b0016ffb6368d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1a5883b5-02d0-4d88-bde9-598e2249e83d tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (081c30fd-c48b-4f69-845d-46bfa207cf83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1a5883b5-02d0-4d88-bde9-598e2249e83d tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (081c30fd-c48b-4f69-845d-46bfa207cf83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1a5883b5-02d0-4d88-bde9-598e2249e83d tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f292f11f-5fe6-48ae-b623-a25c7a9bcf36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1a5883b5-02d0-4d88-bde9-598e2249e83d tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f292f11f-5fe6-48ae-b623-a25c7a9bcf36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a06499a-d41b-48a1-a326-876e54d616e9', 'volume_name': 'volume-4a06499a-d41b-48a1-a326-876e54d616e9', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1a5883b5-02d0-4d88-bde9-598e2249e83d tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa008812-d3ca-4711-b6a1-aeaeb24fb1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1a5883b5-02d0-4d88-bde9-598e2249e83d tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa008812-d3ca-4711-b6a1-aeaeb24fb1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1a5883b5-02d0-4d88-bde9-598e2249e83d tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8db7e355-551e-4c59-98ff-0ea77011f9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:24 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-1a5883b5-02d0-4d88-bde9-598e2249e83d tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Volume 4a06499a-d41b-48a1-a326-876e54d616e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a06499a-d41b-48a1-a326-876e54d616e9', 'volume_size': 1} Jul 07 08:28:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1a5883b5-02d0-4d88-bde9-598e2249e83d tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:28:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1a5883b5-02d0-4d88-bde9-598e2249e83d tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:28:24 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1a5883b5-02d0-4d88-bde9-598e2249e83d tempest-CreateVolumesFromSourceVolumeTest-562473717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-120120287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a06499a-d41b-48a1-a326-876e54d616e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c26df1c845534dd3ba7b5383cd107a71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:28:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:28:24Z,use_quota=True,user_id='da5a30dab44e4cb8820b0016ffb6368d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:28:24 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-1a5883b5-02d0-4d88-bde9-598e2249e83d tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Creating volume 4a06499a-d41b-48a1-a326-876e54d616e9 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:28:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1a5883b5-02d0-4d88-bde9-598e2249e83d tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:28:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1a5883b5-02d0-4d88-bde9-598e2249e83d tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:28:24 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1a5883b5-02d0-4d88-bde9-598e2249e83d tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:28:24 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1a5883b5-02d0-4d88-bde9-598e2249e83d tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:28:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1a5883b5-02d0-4d88-bde9-598e2249e83d tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:28:24 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1a5883b5-02d0-4d88-bde9-598e2249e83d tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:28:24 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-1a5883b5-02d0-4d88-bde9-598e2249e83d tempest-CreateVolumesFromSourceVolumeTest-562473717 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:28:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1a5883b5-02d0-4d88-bde9-598e2249e83d tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4a06499a-d41b-48a1-a326-876e54d616e9 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:24 devstack sudo[101142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4a06499a-d41b-48a1-a326-876e54d616e9 1073741824 Jul 07 08:28:24 devstack sudo[101142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:25 devstack sudo[101142]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1a5883b5-02d0-4d88-bde9-598e2249e83d tempest-CreateVolumesFromSourceVolumeTest-562473717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4a06499a-d41b-48a1-a326-876e54d616e9 1073741824" returned: 0 in 0.955s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1a5883b5-02d0-4d88-bde9-598e2249e83d tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4a06499a-d41b-48a1-a326-876e54d616e9 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:25 devstack sudo[101148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4a06499a-d41b-48a1-a326-876e54d616e9 Jul 07 08:28:25 devstack sudo[101148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:26 devstack sudo[101148]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1a5883b5-02d0-4d88-bde9-598e2249e83d tempest-CreateVolumesFromSourceVolumeTest-562473717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4a06499a-d41b-48a1-a326-876e54d616e9" returned: 0 in 0.685s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:26 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1a5883b5-02d0-4d88-bde9-598e2249e83d tempest-CreateVolumesFromSourceVolumeTest-562473717 None] <== create_volume: return (1695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:28:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1a5883b5-02d0-4d88-bde9-598e2249e83d tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.699s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:28:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1a5883b5-02d0-4d88-bde9-598e2249e83d tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8db7e355-551e-4c59-98ff-0ea77011f9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a06499a-d41b-48a1-a326-876e54d616e9', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1a5883b5-02d0-4d88-bde9-598e2249e83d tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (386d12d2-63cc-48eb-accd-6f8cd7dd038a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:26 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-1a5883b5-02d0-4d88-bde9-598e2249e83d tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Volume volume-4a06499a-d41b-48a1-a326-876e54d616e9 (4a06499a-d41b-48a1-a326-876e54d616e9): created successfully Jul 07 08:28:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1a5883b5-02d0-4d88-bde9-598e2249e83d tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (386d12d2-63cc-48eb-accd-6f8cd7dd038a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1a5883b5-02d0-4d88-bde9-598e2249e83d tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Flow 'volume_create_manager' (75f3eca7-b04e-4740-9ae9-64698c909842) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:28:26 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-1a5883b5-02d0-4d88-bde9-598e2249e83d tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Created volume successfully. Jul 07 08:28:26 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-b97b400d-3356-410a-ac8a-ded55d994012 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:28:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b97b400d-3356-410a-ac8a-ded55d994012 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Flow 'volume_create_manager' (59fe036e-bcf1-42b5-b46c-747446cf68a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:28:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b97b400d-3356-410a-ac8a-ded55d994012 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03d303ae-65d1-4d32-a0e1-dcbd9c6c56e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b97b400d-3356-410a-ac8a-ded55d994012 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03d303ae-65d1-4d32-a0e1-dcbd9c6c56e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:28:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2014629566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8469588e-0361-4f3a-a858-0cf8784be271,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c26df1c845534dd3ba7b5383cd107a71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:28:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:28:27Z,use_quota=True,user_id='da5a30dab44e4cb8820b0016ffb6368d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b97b400d-3356-410a-ac8a-ded55d994012 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b08741a7-7f73-41d6-9cd8-8bea4b32b79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b97b400d-3356-410a-ac8a-ded55d994012 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b08741a7-7f73-41d6-9cd8-8bea4b32b79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b97b400d-3356-410a-ac8a-ded55d994012 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12f1997f-0d68-4ced-914b-f756f0b94184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b97b400d-3356-410a-ac8a-ded55d994012 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12f1997f-0d68-4ced-914b-f756f0b94184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8469588e-0361-4f3a-a858-0cf8784be271', 'volume_name': 'volume-8469588e-0361-4f3a-a858-0cf8784be271', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b97b400d-3356-410a-ac8a-ded55d994012 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f927751-e139-4cbb-b2f5-de43c80d623e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b97b400d-3356-410a-ac8a-ded55d994012 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f927751-e139-4cbb-b2f5-de43c80d623e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b97b400d-3356-410a-ac8a-ded55d994012 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22c8a36e-4f8a-43c6-8464-62643068dd0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:26 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-b97b400d-3356-410a-ac8a-ded55d994012 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Volume 8469588e-0361-4f3a-a858-0cf8784be271: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8469588e-0361-4f3a-a858-0cf8784be271', 'volume_size': 1} Jul 07 08:28:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b97b400d-3356-410a-ac8a-ded55d994012 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:28:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b97b400d-3356-410a-ac8a-ded55d994012 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:28:26 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b97b400d-3356-410a-ac8a-ded55d994012 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:28:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2014629566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8469588e-0361-4f3a-a858-0cf8784be271,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c26df1c845534dd3ba7b5383cd107a71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:28:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:28:27Z,use_quota=True,user_id='da5a30dab44e4cb8820b0016ffb6368d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:28:26 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-b97b400d-3356-410a-ac8a-ded55d994012 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Creating volume 8469588e-0361-4f3a-a858-0cf8784be271 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:28:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b97b400d-3356-410a-ac8a-ded55d994012 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:28:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b97b400d-3356-410a-ac8a-ded55d994012 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:28:26 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b97b400d-3356-410a-ac8a-ded55d994012 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:28:26 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b97b400d-3356-410a-ac8a-ded55d994012 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:28:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b97b400d-3356-410a-ac8a-ded55d994012 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:28:26 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b97b400d-3356-410a-ac8a-ded55d994012 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:28:26 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-b97b400d-3356-410a-ac8a-ded55d994012 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:28:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b97b400d-3356-410a-ac8a-ded55d994012 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8469588e-0361-4f3a-a858-0cf8784be271 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:27 devstack sudo[101151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8469588e-0361-4f3a-a858-0cf8784be271 1073741824 Jul 07 08:28:27 devstack sudo[101151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:27 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-1af9ad13-4c0e-4bc2-b718-b9429c054144 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:28:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1af9ad13-4c0e-4bc2-b718-b9429c054144 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Flow 'volume_create_manager' (cf49e6f0-2912-4adc-a586-04617d307429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:28:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1af9ad13-4c0e-4bc2-b718-b9429c054144 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93e10214-3871-47b3-8518-49cd1bf13609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1af9ad13-4c0e-4bc2-b718-b9429c054144 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93e10214-3871-47b3-8518-49cd1bf13609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:28:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1601998684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37574c17-3aee-40cb-b9a2-403a8b09b8ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c26df1c845534dd3ba7b5383cd107a71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:28:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:28:27Z,use_quota=True,user_id='da5a30dab44e4cb8820b0016ffb6368d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1af9ad13-4c0e-4bc2-b718-b9429c054144 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbd46421-df76-497b-be22-8106e82fd8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1af9ad13-4c0e-4bc2-b718-b9429c054144 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbd46421-df76-497b-be22-8106e82fd8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1af9ad13-4c0e-4bc2-b718-b9429c054144 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5866732e-17aa-4986-b4db-92ba4133b5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1af9ad13-4c0e-4bc2-b718-b9429c054144 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5866732e-17aa-4986-b4db-92ba4133b5d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37574c17-3aee-40cb-b9a2-403a8b09b8ec', 'volume_name': 'volume-37574c17-3aee-40cb-b9a2-403a8b09b8ec', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1af9ad13-4c0e-4bc2-b718-b9429c054144 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f681a83e-2063-46b8-bab1-6b7ebe58b862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1af9ad13-4c0e-4bc2-b718-b9429c054144 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f681a83e-2063-46b8-bab1-6b7ebe58b862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1af9ad13-4c0e-4bc2-b718-b9429c054144 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e45fa2a7-5dab-4ad6-a66e-2cc1473bf759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:27 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-1af9ad13-4c0e-4bc2-b718-b9429c054144 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Volume 37574c17-3aee-40cb-b9a2-403a8b09b8ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37574c17-3aee-40cb-b9a2-403a8b09b8ec', 'volume_size': 1} Jul 07 08:28:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1af9ad13-4c0e-4bc2-b718-b9429c054144 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:28:27 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae05d90e-0001-4194-9406-e7e89cf703f9 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:28:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ae05d90e-0001-4194-9406-e7e89cf703f9 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Flow 'volume_create_manager' (2b3211bd-ca70-41dd-9a97-41370cbe38ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:28:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ae05d90e-0001-4194-9406-e7e89cf703f9 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaa7a7b5-8b96-436f-823a-053e5f5a4148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ae05d90e-0001-4194-9406-e7e89cf703f9 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaa7a7b5-8b96-436f-823a-053e5f5a4148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:28:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1017494902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d53013a-92c0-4750-8eee-1bb601d07f46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c26df1c845534dd3ba7b5383cd107a71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:28:28Z,use_quota=True,user_id='da5a30dab44e4cb8820b0016ffb6368d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ae05d90e-0001-4194-9406-e7e89cf703f9 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dd6967e-8192-4740-be4e-7a81f7f4ddb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ae05d90e-0001-4194-9406-e7e89cf703f9 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dd6967e-8192-4740-be4e-7a81f7f4ddb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ae05d90e-0001-4194-9406-e7e89cf703f9 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bf4a03e-1118-43e3-a9b6-839991196697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ae05d90e-0001-4194-9406-e7e89cf703f9 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bf4a03e-1118-43e3-a9b6-839991196697) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d53013a-92c0-4750-8eee-1bb601d07f46', 'volume_name': 'volume-1d53013a-92c0-4750-8eee-1bb601d07f46', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ae05d90e-0001-4194-9406-e7e89cf703f9 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66f9572f-f073-444e-8250-eab3eb8678ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ae05d90e-0001-4194-9406-e7e89cf703f9 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66f9572f-f073-444e-8250-eab3eb8678ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ae05d90e-0001-4194-9406-e7e89cf703f9 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4dc5adc-fb2b-472e-86fe-8296b89c6657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:27 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-ae05d90e-0001-4194-9406-e7e89cf703f9 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Volume 1d53013a-92c0-4750-8eee-1bb601d07f46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d53013a-92c0-4750-8eee-1bb601d07f46', 'volume_size': 1} Jul 07 08:28:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ae05d90e-0001-4194-9406-e7e89cf703f9 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:28:28 devstack sudo[101151]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b97b400d-3356-410a-ac8a-ded55d994012 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8469588e-0361-4f3a-a858-0cf8784be271 1073741824" returned: 0 in 1.284s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b97b400d-3356-410a-ac8a-ded55d994012 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8469588e-0361-4f3a-a858-0cf8784be271 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:28 devstack sudo[101177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8469588e-0361-4f3a-a858-0cf8784be271 Jul 07 08:28:28 devstack sudo[101177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:28 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-074b13c0-449d-4f06-b2f1-1586b6860f37 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:28:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-074b13c0-449d-4f06-b2f1-1586b6860f37 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Flow 'volume_create_manager' (2b6aa74f-d65d-486a-ae16-71bd45e90f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:28:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-074b13c0-449d-4f06-b2f1-1586b6860f37 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e24fab14-4fbc-4494-a84c-15b579a0e8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-074b13c0-449d-4f06-b2f1-1586b6860f37 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e24fab14-4fbc-4494-a84c-15b579a0e8a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-377959901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff2eb1fb-3dce-421f-98cd-fe97f5148ec1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c26df1c845534dd3ba7b5383cd107a71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:28:28Z,use_quota=True,user_id='da5a30dab44e4cb8820b0016ffb6368d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-074b13c0-449d-4f06-b2f1-1586b6860f37 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68b8461c-c9da-45e7-9033-03cd1848c977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-074b13c0-449d-4f06-b2f1-1586b6860f37 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68b8461c-c9da-45e7-9033-03cd1848c977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-074b13c0-449d-4f06-b2f1-1586b6860f37 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f316ee2-0a98-4264-a343-94c21c20b497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-074b13c0-449d-4f06-b2f1-1586b6860f37 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f316ee2-0a98-4264-a343-94c21c20b497) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff2eb1fb-3dce-421f-98cd-fe97f5148ec1', 'volume_name': 'volume-ff2eb1fb-3dce-421f-98cd-fe97f5148ec1', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-074b13c0-449d-4f06-b2f1-1586b6860f37 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e533aa8-8c2a-4a21-b4f5-61178760a215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-074b13c0-449d-4f06-b2f1-1586b6860f37 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e533aa8-8c2a-4a21-b4f5-61178760a215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-074b13c0-449d-4f06-b2f1-1586b6860f37 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6eb4898f-2df0-45ff-b546-509428c6ab4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:28 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-074b13c0-449d-4f06-b2f1-1586b6860f37 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Volume ff2eb1fb-3dce-421f-98cd-fe97f5148ec1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff2eb1fb-3dce-421f-98cd-fe97f5148ec1', 'volume_size': 1} Jul 07 08:28:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-074b13c0-449d-4f06-b2f1-1586b6860f37 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:28:29 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb3a014d-57ae-4b6b-a299-b76b59df3b06 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:28:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bb3a014d-57ae-4b6b-a299-b76b59df3b06 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Flow 'volume_create_manager' (3c83e83e-198f-4dc3-884e-813be15450a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:28:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bb3a014d-57ae-4b6b-a299-b76b59df3b06 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcc74608-a6b0-4c69-bce2-eb9647a3b7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bb3a014d-57ae-4b6b-a299-b76b59df3b06 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcc74608-a6b0-4c69-bce2-eb9647a3b7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1668126508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e046231-6347-49ee-8f03-c566bb33902e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c26df1c845534dd3ba7b5383cd107a71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:28:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:28:29Z,use_quota=True,user_id='da5a30dab44e4cb8820b0016ffb6368d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bb3a014d-57ae-4b6b-a299-b76b59df3b06 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ea26466-def4-4b6f-b78e-e7055262a6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bb3a014d-57ae-4b6b-a299-b76b59df3b06 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ea26466-def4-4b6f-b78e-e7055262a6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bb3a014d-57ae-4b6b-a299-b76b59df3b06 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab2e23f3-68c0-4997-96ff-d5f46f94f8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bb3a014d-57ae-4b6b-a299-b76b59df3b06 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab2e23f3-68c0-4997-96ff-d5f46f94f8f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e046231-6347-49ee-8f03-c566bb33902e', 'volume_name': 'volume-5e046231-6347-49ee-8f03-c566bb33902e', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bb3a014d-57ae-4b6b-a299-b76b59df3b06 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75a477ac-ae1c-43db-b48a-d894a9cd9b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bb3a014d-57ae-4b6b-a299-b76b59df3b06 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75a477ac-ae1c-43db-b48a-d894a9cd9b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bb3a014d-57ae-4b6b-a299-b76b59df3b06 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b69aabb-7694-4303-bac3-81f1f22d21f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:29 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-bb3a014d-57ae-4b6b-a299-b76b59df3b06 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Volume 5e046231-6347-49ee-8f03-c566bb33902e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e046231-6347-49ee-8f03-c566bb33902e', 'volume_size': 1} Jul 07 08:28:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-bb3a014d-57ae-4b6b-a299-b76b59df3b06 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:28:29 devstack sudo[101177]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b97b400d-3356-410a-ac8a-ded55d994012 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8469588e-0361-4f3a-a858-0cf8784be271" returned: 0 in 1.150s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:29 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b97b400d-3356-410a-ac8a-ded55d994012 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] <== create_volume: return (2494ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:28:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b97b400d-3356-410a-ac8a-ded55d994012 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.499s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:28:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1af9ad13-4c0e-4bc2-b718-b9429c054144 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.120s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:28:29 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1af9ad13-4c0e-4bc2-b718-b9429c054144 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:28:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1601998684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37574c17-3aee-40cb-b9a2-403a8b09b8ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c26df1c845534dd3ba7b5383cd107a71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:28:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:28:27Z,use_quota=True,user_id='da5a30dab44e4cb8820b0016ffb6368d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:28:29 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-1af9ad13-4c0e-4bc2-b718-b9429c054144 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Creating volume 37574c17-3aee-40cb-b9a2-403a8b09b8ec {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:28:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1af9ad13-4c0e-4bc2-b718-b9429c054144 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:28:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1af9ad13-4c0e-4bc2-b718-b9429c054144 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:28:29 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1af9ad13-4c0e-4bc2-b718-b9429c054144 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:28:29 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1af9ad13-4c0e-4bc2-b718-b9429c054144 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:28:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1af9ad13-4c0e-4bc2-b718-b9429c054144 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:28:29 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1af9ad13-4c0e-4bc2-b718-b9429c054144 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:28:29 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-1af9ad13-4c0e-4bc2-b718-b9429c054144 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:28:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1af9ad13-4c0e-4bc2-b718-b9429c054144 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37574c17-3aee-40cb-b9a2-403a8b09b8ec 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:29 devstack sudo[101185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37574c17-3aee-40cb-b9a2-403a8b09b8ec 1073741824 Jul 07 08:28:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b97b400d-3356-410a-ac8a-ded55d994012 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22c8a36e-4f8a-43c6-8464-62643068dd0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8469588e-0361-4f3a-a858-0cf8784be271', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:29 devstack sudo[101185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b97b400d-3356-410a-ac8a-ded55d994012 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b33b0de-59a7-45b6-bf16-632f7677a324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:29 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-b97b400d-3356-410a-ac8a-ded55d994012 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Volume volume-8469588e-0361-4f3a-a858-0cf8784be271 (8469588e-0361-4f3a-a858-0cf8784be271): created successfully Jul 07 08:28:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b97b400d-3356-410a-ac8a-ded55d994012 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b33b0de-59a7-45b6-bf16-632f7677a324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b97b400d-3356-410a-ac8a-ded55d994012 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Flow 'volume_create_manager' (59fe036e-bcf1-42b5-b46c-747446cf68a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:28:29 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-b97b400d-3356-410a-ac8a-ded55d994012 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Created volume successfully. Jul 07 08:28:30 devstack sudo[101185]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1af9ad13-4c0e-4bc2-b718-b9429c054144 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37574c17-3aee-40cb-b9a2-403a8b09b8ec 1073741824" returned: 0 in 1.049s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1af9ad13-4c0e-4bc2-b718-b9429c054144 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37574c17-3aee-40cb-b9a2-403a8b09b8ec {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:30 devstack sudo[101195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37574c17-3aee-40cb-b9a2-403a8b09b8ec Jul 07 08:28:30 devstack sudo[101195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:31 devstack sudo[101195]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1af9ad13-4c0e-4bc2-b718-b9429c054144 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37574c17-3aee-40cb-b9a2-403a8b09b8ec" returned: 0 in 0.737s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:31 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1af9ad13-4c0e-4bc2-b718-b9429c054144 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] <== create_volume: return (1848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:28:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1af9ad13-4c0e-4bc2-b718-b9429c054144 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.851s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:28:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ae05d90e-0001-4194-9406-e7e89cf703f9 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.500s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:28:31 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ae05d90e-0001-4194-9406-e7e89cf703f9 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:28:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1017494902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d53013a-92c0-4750-8eee-1bb601d07f46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c26df1c845534dd3ba7b5383cd107a71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:28:28Z,use_quota=True,user_id='da5a30dab44e4cb8820b0016ffb6368d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:28:31 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-ae05d90e-0001-4194-9406-e7e89cf703f9 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Creating volume 1d53013a-92c0-4750-8eee-1bb601d07f46 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:28:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ae05d90e-0001-4194-9406-e7e89cf703f9 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:28:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ae05d90e-0001-4194-9406-e7e89cf703f9 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:28:31 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ae05d90e-0001-4194-9406-e7e89cf703f9 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:28:31 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ae05d90e-0001-4194-9406-e7e89cf703f9 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:28:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ae05d90e-0001-4194-9406-e7e89cf703f9 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:28:31 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ae05d90e-0001-4194-9406-e7e89cf703f9 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:28:31 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-ae05d90e-0001-4194-9406-e7e89cf703f9 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:28:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ae05d90e-0001-4194-9406-e7e89cf703f9 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1d53013a-92c0-4750-8eee-1bb601d07f46 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:31 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1af9ad13-4c0e-4bc2-b718-b9429c054144 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e45fa2a7-5dab-4ad6-a66e-2cc1473bf759) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37574c17-3aee-40cb-b9a2-403a8b09b8ec', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:31 devstack sudo[101207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1d53013a-92c0-4750-8eee-1bb601d07f46 1073741824 Jul 07 08:28:31 devstack sudo[101207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:31 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1af9ad13-4c0e-4bc2-b718-b9429c054144 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (473d5361-c449-44a1-a00c-655174d955d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:31 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-1af9ad13-4c0e-4bc2-b718-b9429c054144 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Volume volume-37574c17-3aee-40cb-b9a2-403a8b09b8ec (37574c17-3aee-40cb-b9a2-403a8b09b8ec): created successfully Jul 07 08:28:31 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1af9ad13-4c0e-4bc2-b718-b9429c054144 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (473d5361-c449-44a1-a00c-655174d955d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:31 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1af9ad13-4c0e-4bc2-b718-b9429c054144 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Flow 'volume_create_manager' (cf49e6f0-2912-4adc-a586-04617d307429) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:28:31 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-1af9ad13-4c0e-4bc2-b718-b9429c054144 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Created volume successfully. Jul 07 08:28:32 devstack sudo[101207]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ae05d90e-0001-4194-9406-e7e89cf703f9 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1d53013a-92c0-4750-8eee-1bb601d07f46 1073741824" returned: 0 in 0.991s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ae05d90e-0001-4194-9406-e7e89cf703f9 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1d53013a-92c0-4750-8eee-1bb601d07f46 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:32 devstack sudo[101220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1d53013a-92c0-4750-8eee-1bb601d07f46 Jul 07 08:28:32 devstack sudo[101220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:33 devstack sudo[101220]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ae05d90e-0001-4194-9406-e7e89cf703f9 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1d53013a-92c0-4750-8eee-1bb601d07f46" returned: 0 in 0.670s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:33 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ae05d90e-0001-4194-9406-e7e89cf703f9 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] <== create_volume: return (1716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:28:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ae05d90e-0001-4194-9406-e7e89cf703f9 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.719s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:28:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-074b13c0-449d-4f06-b2f1-1586b6860f37 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.466s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:28:33 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-074b13c0-449d-4f06-b2f1-1586b6860f37 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-377959901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff2eb1fb-3dce-421f-98cd-fe97f5148ec1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c26df1c845534dd3ba7b5383cd107a71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:28:28Z,use_quota=True,user_id='da5a30dab44e4cb8820b0016ffb6368d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:28:33 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-074b13c0-449d-4f06-b2f1-1586b6860f37 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Creating volume ff2eb1fb-3dce-421f-98cd-fe97f5148ec1 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:28:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-074b13c0-449d-4f06-b2f1-1586b6860f37 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:28:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-074b13c0-449d-4f06-b2f1-1586b6860f37 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:28:33 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-074b13c0-449d-4f06-b2f1-1586b6860f37 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:28:33 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-074b13c0-449d-4f06-b2f1-1586b6860f37 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:28:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-074b13c0-449d-4f06-b2f1-1586b6860f37 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:28:33 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-074b13c0-449d-4f06-b2f1-1586b6860f37 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:28:33 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-074b13c0-449d-4f06-b2f1-1586b6860f37 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:28:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-074b13c0-449d-4f06-b2f1-1586b6860f37 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ff2eb1fb-3dce-421f-98cd-fe97f5148ec1 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:33 devstack sudo[101223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ff2eb1fb-3dce-421f-98cd-fe97f5148ec1 1073741824 Jul 07 08:28:33 devstack sudo[101223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ae05d90e-0001-4194-9406-e7e89cf703f9 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4dc5adc-fb2b-472e-86fe-8296b89c6657) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d53013a-92c0-4750-8eee-1bb601d07f46', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ae05d90e-0001-4194-9406-e7e89cf703f9 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9a4b473-2a47-4376-9591-62f5d592c3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:33 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-ae05d90e-0001-4194-9406-e7e89cf703f9 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Volume volume-1d53013a-92c0-4750-8eee-1bb601d07f46 (1d53013a-92c0-4750-8eee-1bb601d07f46): created successfully Jul 07 08:28:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ae05d90e-0001-4194-9406-e7e89cf703f9 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9a4b473-2a47-4376-9591-62f5d592c3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ae05d90e-0001-4194-9406-e7e89cf703f9 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Flow 'volume_create_manager' (2b3211bd-ca70-41dd-9a97-41370cbe38ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:28:33 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-ae05d90e-0001-4194-9406-e7e89cf703f9 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Created volume successfully. Jul 07 08:28:33 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-1976fc68-bbe7-46b2-b133-daa5e885f2f8 req-5f3dff72-2c36-4d27-b365-7ab53fa3b001 tempest-TestMinimumBasicScenario-1903662404 None] Terminate volume connection completed successfully. Jul 07 08:28:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-1976fc68-bbe7-46b2-b133-daa5e885f2f8 req-5f3dff72-2c36-4d27-b365-7ab53fa3b001 tempest-TestMinimumBasicScenario-1903662404 None] Deleting attachment 0b9311d7-7424-43a6-8f84-1bf616b06ad0. {{(pid=87199) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 08:28:34 devstack sudo[101223]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-074b13c0-449d-4f06-b2f1-1586b6860f37 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ff2eb1fb-3dce-421f-98cd-fe97f5148ec1 1073741824" returned: 0 in 1.040s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-074b13c0-449d-4f06-b2f1-1586b6860f37 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ff2eb1fb-3dce-421f-98cd-fe97f5148ec1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:34 devstack sudo[101268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ff2eb1fb-3dce-421f-98cd-fe97f5148ec1 Jul 07 08:28:34 devstack sudo[101268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:34 devstack sudo[101268]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-074b13c0-449d-4f06-b2f1-1586b6860f37 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ff2eb1fb-3dce-421f-98cd-fe97f5148ec1" returned: 0 in 0.676s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:34 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-074b13c0-449d-4f06-b2f1-1586b6860f37 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] <== create_volume: return (1757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:28:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-074b13c0-449d-4f06-b2f1-1586b6860f37 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.759s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:28:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-bb3a014d-57ae-4b6b-a299-b76b59df3b06 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.577s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:28:34 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-bb3a014d-57ae-4b6b-a299-b76b59df3b06 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1668126508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e046231-6347-49ee-8f03-c566bb33902e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c26df1c845534dd3ba7b5383cd107a71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:28:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:28:29Z,use_quota=True,user_id='da5a30dab44e4cb8820b0016ffb6368d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:28:34 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-bb3a014d-57ae-4b6b-a299-b76b59df3b06 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Creating volume 5e046231-6347-49ee-8f03-c566bb33902e {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:28:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-bb3a014d-57ae-4b6b-a299-b76b59df3b06 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:28:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-bb3a014d-57ae-4b6b-a299-b76b59df3b06 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:28:34 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-bb3a014d-57ae-4b6b-a299-b76b59df3b06 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:28:34 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-bb3a014d-57ae-4b6b-a299-b76b59df3b06 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:28:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-bb3a014d-57ae-4b6b-a299-b76b59df3b06 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:28:34 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-bb3a014d-57ae-4b6b-a299-b76b59df3b06 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:28:34 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-bb3a014d-57ae-4b6b-a299-b76b59df3b06 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:28:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bb3a014d-57ae-4b6b-a299-b76b59df3b06 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5e046231-6347-49ee-8f03-c566bb33902e 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:34 devstack sudo[101271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5e046231-6347-49ee-8f03-c566bb33902e 1073741824 Jul 07 08:28:34 devstack sudo[101271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-074b13c0-449d-4f06-b2f1-1586b6860f37 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6eb4898f-2df0-45ff-b546-509428c6ab4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff2eb1fb-3dce-421f-98cd-fe97f5148ec1', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-074b13c0-449d-4f06-b2f1-1586b6860f37 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9304923a-1978-4460-a28e-d998d64faa9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:34 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-074b13c0-449d-4f06-b2f1-1586b6860f37 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Volume volume-ff2eb1fb-3dce-421f-98cd-fe97f5148ec1 (ff2eb1fb-3dce-421f-98cd-fe97f5148ec1): created successfully Jul 07 08:28:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-074b13c0-449d-4f06-b2f1-1586b6860f37 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9304923a-1978-4460-a28e-d998d64faa9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-074b13c0-449d-4f06-b2f1-1586b6860f37 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Flow 'volume_create_manager' (2b6aa74f-d65d-486a-ae16-71bd45e90f32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:28:34 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-074b13c0-449d-4f06-b2f1-1586b6860f37 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Created volume successfully. Jul 07 08:28:35 devstack sudo[101271]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bb3a014d-57ae-4b6b-a299-b76b59df3b06 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5e046231-6347-49ee-8f03-c566bb33902e 1073741824" returned: 0 in 0.950s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bb3a014d-57ae-4b6b-a299-b76b59df3b06 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5e046231-6347-49ee-8f03-c566bb33902e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:35 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ccc43848-3107-4df7-8ab4-f16d9e361485 tempest-TestMinimumBasicScenario-1903662404 None] Acquiring lock "cinder-6e47cd42-8ea1-4176-98fd-07717a63f2d2-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:28:35 devstack sudo[101277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5e046231-6347-49ee-8f03-c566bb33902e Jul 07 08:28:35 devstack sudo[101277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:35 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ccc43848-3107-4df7-8ab4-f16d9e361485 tempest-TestMinimumBasicScenario-1903662404 None] Lock "cinder-6e47cd42-8ea1-4176-98fd-07717a63f2d2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:28:35 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ccc43848-3107-4df7-8ab4-f16d9e361485 tempest-TestMinimumBasicScenario-1903662404 None] Acquiring lock "cinder-quobyte-6e47cd42-8ea1-4176-98fd-07717a63f2d2" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:28:35 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ccc43848-3107-4df7-8ab4-f16d9e361485 tempest-TestMinimumBasicScenario-1903662404 None] Lock "cinder-quobyte-6e47cd42-8ea1-4176-98fd-07717a63f2d2" acquired by "delete_volume" :: waited 0.019s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:28:35 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[149e5164-0a6a-4033-9e24-a8ab69f1d00c]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:28:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ccc43848-3107-4df7-8ab4-f16d9e361485 tempest-TestMinimumBasicScenario-1903662404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e47cd42-8ea1-4176-98fd-07717a63f2d2 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:36 devstack sudo[101279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e47cd42-8ea1-4176-98fd-07717a63f2d2 Jul 07 08:28:36 devstack sudo[101279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:36 devstack sudo[101277]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bb3a014d-57ae-4b6b-a299-b76b59df3b06 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5e046231-6347-49ee-8f03-c566bb33902e" returned: 0 in 0.745s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-bb3a014d-57ae-4b6b-a299-b76b59df3b06 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] <== create_volume: return (1739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:28:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-bb3a014d-57ae-4b6b-a299-b76b59df3b06 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.742s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:28:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bb3a014d-57ae-4b6b-a299-b76b59df3b06 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b69aabb-7694-4303-bac3-81f1f22d21f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e046231-6347-49ee-8f03-c566bb33902e', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bb3a014d-57ae-4b6b-a299-b76b59df3b06 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cda91d3b-17ce-4426-8129-fa056d8d2944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:36 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-bb3a014d-57ae-4b6b-a299-b76b59df3b06 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Volume volume-5e046231-6347-49ee-8f03-c566bb33902e (5e046231-6347-49ee-8f03-c566bb33902e): created successfully Jul 07 08:28:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bb3a014d-57ae-4b6b-a299-b76b59df3b06 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cda91d3b-17ce-4426-8129-fa056d8d2944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-bb3a014d-57ae-4b6b-a299-b76b59df3b06 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Flow 'volume_create_manager' (3c83e83e-198f-4dc3-884e-813be15450a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:28:36 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-bb3a014d-57ae-4b6b-a299-b76b59df3b06 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Created volume successfully. Jul 07 08:28:36 devstack sudo[101279]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ccc43848-3107-4df7-8ab4-f16d9e361485 tempest-TestMinimumBasicScenario-1903662404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e47cd42-8ea1-4176-98fd-07717a63f2d2" returned: 0 in 0.809s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ccc43848-3107-4df7-8ab4-f16d9e361485 tempest-TestMinimumBasicScenario-1903662404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e47cd42-8ea1-4176-98fd-07717a63f2d2 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:36 devstack sudo[101287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e47cd42-8ea1-4176-98fd-07717a63f2d2 Jul 07 08:28:36 devstack sudo[101287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:37 devstack sudo[101287]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ccc43848-3107-4df7-8ab4-f16d9e361485 tempest-TestMinimumBasicScenario-1903662404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6e47cd42-8ea1-4176-98fd-07717a63f2d2" returned: 0 in 0.666s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:37 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ccc43848-3107-4df7-8ab4-f16d9e361485 tempest-TestMinimumBasicScenario-1903662404 None] Lock "cinder-quobyte-6e47cd42-8ea1-4176-98fd-07717a63f2d2" released by "delete_volume" :: held 1.521s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:28:37 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-ccc43848-3107-4df7-8ab4-f16d9e361485 tempest-TestMinimumBasicScenario-1903662404 None] Created reservations ['4360039d-d975-4ea8-869b-de64ebbe8ef6', '92001ddd-c070-4f26-93c8-f3c184202ed7', '9beeeb43-7b61-4a5b-80b6-b2b4c81a2030', '21ea0394-50ec-41e3-8554-2142401f1cb7'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:28:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ccc43848-3107-4df7-8ab4-f16d9e361485 tempest-TestMinimumBasicScenario-1903662404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:28:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ccc43848-3107-4df7-8ab4-f16d9e361485 tempest-TestMinimumBasicScenario-1903662404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:28:37 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ccc43848-3107-4df7-8ab4-f16d9e361485 tempest-TestMinimumBasicScenario-1903662404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:28:37 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ccc43848-3107-4df7-8ab4-f16d9e361485 tempest-TestMinimumBasicScenario-1903662404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:28:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ccc43848-3107-4df7-8ab4-f16d9e361485 tempest-TestMinimumBasicScenario-1903662404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:28:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ccc43848-3107-4df7-8ab4-f16d9e361485 tempest-TestMinimumBasicScenario-1903662404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:37 devstack sudo[101291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:28:37 devstack sudo[101291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:37 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9a7d0ab6-8cd7-4162-b4f0-5d14d3bfd4f6 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Acquiring lock "cinder-5e046231-6347-49ee-8f03-c566bb33902e-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:28:37 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9a7d0ab6-8cd7-4162-b4f0-5d14d3bfd4f6 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Lock "cinder-5e046231-6347-49ee-8f03-c566bb33902e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:28:37 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9a7d0ab6-8cd7-4162-b4f0-5d14d3bfd4f6 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Acquiring lock "cinder-quobyte-5e046231-6347-49ee-8f03-c566bb33902e" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:28:37 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9a7d0ab6-8cd7-4162-b4f0-5d14d3bfd4f6 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Lock "cinder-quobyte-5e046231-6347-49ee-8f03-c566bb33902e" acquired by "delete_volume" :: waited 0.021s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:28:37 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[824cbb7e-b388-4d65-8330-28a174ab3011]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:28:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9a7d0ab6-8cd7-4162-b4f0-5d14d3bfd4f6 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5e046231-6347-49ee-8f03-c566bb33902e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:38 devstack sudo[101293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5e046231-6347-49ee-8f03-c566bb33902e Jul 07 08:28:38 devstack sudo[101293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:38 devstack sudo[101291]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ccc43848-3107-4df7-8ab4-f16d9e361485 tempest-TestMinimumBasicScenario-1903662404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.809s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:38 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ccc43848-3107-4df7-8ab4-f16d9e361485 tempest-TestMinimumBasicScenario-1903662404 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:28:38 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-ccc43848-3107-4df7-8ab4-f16d9e361485 tempest-TestMinimumBasicScenario-1903662404 None] Deleted volume successfully. Jul 07 08:28:38 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ccc43848-3107-4df7-8ab4-f16d9e361485 tempest-TestMinimumBasicScenario-1903662404 None] Lock "cinder-6e47cd42-8ea1-4176-98fd-07717a63f2d2-delete_volume" released by "delete_volume" :: held 2.562s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:28:38 devstack sudo[101293]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9a7d0ab6-8cd7-4162-b4f0-5d14d3bfd4f6 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5e046231-6347-49ee-8f03-c566bb33902e" returned: 0 in 0.932s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9a7d0ab6-8cd7-4162-b4f0-5d14d3bfd4f6 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5e046231-6347-49ee-8f03-c566bb33902e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:38 devstack sudo[101299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5e046231-6347-49ee-8f03-c566bb33902e Jul 07 08:28:38 devstack sudo[101299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:39 devstack sudo[101299]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9a7d0ab6-8cd7-4162-b4f0-5d14d3bfd4f6 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-5e046231-6347-49ee-8f03-c566bb33902e" returned: 0 in 0.686s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:39 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9a7d0ab6-8cd7-4162-b4f0-5d14d3bfd4f6 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Lock "cinder-quobyte-5e046231-6347-49ee-8f03-c566bb33902e" released by "delete_volume" :: held 1.669s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:28:39 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-9a7d0ab6-8cd7-4162-b4f0-5d14d3bfd4f6 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Created reservations ['0aaa7514-ff2b-4279-855b-16f209fd4de1', 'a68d7563-f440-4546-ac03-95fe90fb4ea3', '417e2cf6-d6d9-44e9-8a90-ea6fac5647ea', 'f3d89da6-93ad-459f-857a-ab268025c4ef'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:28:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9a7d0ab6-8cd7-4162-b4f0-5d14d3bfd4f6 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:28:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9a7d0ab6-8cd7-4162-b4f0-5d14d3bfd4f6 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:28:39 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-9a7d0ab6-8cd7-4162-b4f0-5d14d3bfd4f6 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:28:39 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-9a7d0ab6-8cd7-4162-b4f0-5d14d3bfd4f6 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:28:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9a7d0ab6-8cd7-4162-b4f0-5d14d3bfd4f6 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:28:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9a7d0ab6-8cd7-4162-b4f0-5d14d3bfd4f6 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:39 devstack sudo[101308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:28:39 devstack sudo[101308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e2e3abc9-c2d9-48fe-bf2e-7f17108d3aa9 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Acquiring lock "cinder-ff2eb1fb-3dce-421f-98cd-fe97f5148ec1-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:28:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e2e3abc9-c2d9-48fe-bf2e-7f17108d3aa9 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Lock "cinder-ff2eb1fb-3dce-421f-98cd-fe97f5148ec1-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:28:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e2e3abc9-c2d9-48fe-bf2e-7f17108d3aa9 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Acquiring lock "cinder-quobyte-ff2eb1fb-3dce-421f-98cd-fe97f5148ec1" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:28:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e2e3abc9-c2d9-48fe-bf2e-7f17108d3aa9 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Lock "cinder-quobyte-ff2eb1fb-3dce-421f-98cd-fe97f5148ec1" acquired by "delete_volume" :: waited 0.030s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:28:40 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a56ad2-dc85-40c5-a8ec-78794941159b]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:28:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e2e3abc9-c2d9-48fe-bf2e-7f17108d3aa9 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ff2eb1fb-3dce-421f-98cd-fe97f5148ec1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:40 devstack sudo[101324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ff2eb1fb-3dce-421f-98cd-fe97f5148ec1 Jul 07 08:28:40 devstack sudo[101324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:40 devstack sudo[101308]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9a7d0ab6-8cd7-4162-b4f0-5d14d3bfd4f6 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.994s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:40 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-9a7d0ab6-8cd7-4162-b4f0-5d14d3bfd4f6 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:28:40 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-9a7d0ab6-8cd7-4162-b4f0-5d14d3bfd4f6 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Deleted volume successfully. Jul 07 08:28:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9a7d0ab6-8cd7-4162-b4f0-5d14d3bfd4f6 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Lock "cinder-5e046231-6347-49ee-8f03-c566bb33902e-delete_volume" released by "delete_volume" :: held 2.953s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:28:41 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d3aa1c98-d78e-4874-aa4c-5de1bcae6164 tempest-VolumesNegativeTest-1277888213 None] Acquiring lock "cinder-61621d42-79f4-40c1-a2bf-56ae05079749-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:28:41 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d3aa1c98-d78e-4874-aa4c-5de1bcae6164 tempest-VolumesNegativeTest-1277888213 None] Lock "cinder-61621d42-79f4-40c1-a2bf-56ae05079749-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:28:41 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d3aa1c98-d78e-4874-aa4c-5de1bcae6164 tempest-VolumesNegativeTest-1277888213 None] Acquiring lock "cinder-quobyte-61621d42-79f4-40c1-a2bf-56ae05079749" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:28:41 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d3aa1c98-d78e-4874-aa4c-5de1bcae6164 tempest-VolumesNegativeTest-1277888213 None] Lock "cinder-quobyte-61621d42-79f4-40c1-a2bf-56ae05079749" acquired by "delete_volume" :: waited 0.020s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:28:41 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[54fa5cd8-4c2e-4240-a3bf-5c56eb194d7e]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:28:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d3aa1c98-d78e-4874-aa4c-5de1bcae6164 tempest-VolumesNegativeTest-1277888213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61621d42-79f4-40c1-a2bf-56ae05079749 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:41 devstack sudo[101333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61621d42-79f4-40c1-a2bf-56ae05079749 Jul 07 08:28:41 devstack sudo[101333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:41 devstack sudo[101324]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e2e3abc9-c2d9-48fe-bf2e-7f17108d3aa9 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ff2eb1fb-3dce-421f-98cd-fe97f5148ec1" returned: 0 in 0.999s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e2e3abc9-c2d9-48fe-bf2e-7f17108d3aa9 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ff2eb1fb-3dce-421f-98cd-fe97f5148ec1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:41 devstack sudo[101336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ff2eb1fb-3dce-421f-98cd-fe97f5148ec1 Jul 07 08:28:41 devstack sudo[101336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:42 devstack sudo[101333]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d3aa1c98-d78e-4874-aa4c-5de1bcae6164 tempest-VolumesNegativeTest-1277888213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61621d42-79f4-40c1-a2bf-56ae05079749" returned: 0 in 0.820s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d3aa1c98-d78e-4874-aa4c-5de1bcae6164 tempest-VolumesNegativeTest-1277888213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61621d42-79f4-40c1-a2bf-56ae05079749 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:42 devstack sudo[101336]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e2e3abc9-c2d9-48fe-bf2e-7f17108d3aa9 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ff2eb1fb-3dce-421f-98cd-fe97f5148ec1" returned: 0 in 0.697s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:42 devstack sudo[101343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61621d42-79f4-40c1-a2bf-56ae05079749 Jul 07 08:28:42 devstack sudo[101343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:42 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e2e3abc9-c2d9-48fe-bf2e-7f17108d3aa9 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Lock "cinder-quobyte-ff2eb1fb-3dce-421f-98cd-fe97f5148ec1" released by "delete_volume" :: held 1.768s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:28:42 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-e2e3abc9-c2d9-48fe-bf2e-7f17108d3aa9 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Created reservations ['3fa0f15c-8a0b-4a9c-9424-0b1abc7581bd', 'cc398c59-4763-4eb0-bb0e-27406b368957', 'dcf76f29-0442-408e-ad35-1a14132889ff', '2c08edbe-462a-4693-9cd2-58152e56863a'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:28:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e2e3abc9-c2d9-48fe-bf2e-7f17108d3aa9 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:28:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e2e3abc9-c2d9-48fe-bf2e-7f17108d3aa9 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:28:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e2e3abc9-c2d9-48fe-bf2e-7f17108d3aa9 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:28:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e2e3abc9-c2d9-48fe-bf2e-7f17108d3aa9 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:28:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e2e3abc9-c2d9-48fe-bf2e-7f17108d3aa9 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:28:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e2e3abc9-c2d9-48fe-bf2e-7f17108d3aa9 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:42 devstack sudo[101345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:28:42 devstack sudo[101345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:42 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-371594df-dbe5-49a2-b020-748750bb8b3a tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Acquiring lock "cinder-1d53013a-92c0-4750-8eee-1bb601d07f46-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:28:42 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-371594df-dbe5-49a2-b020-748750bb8b3a tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Lock "cinder-1d53013a-92c0-4750-8eee-1bb601d07f46-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:28:42 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-371594df-dbe5-49a2-b020-748750bb8b3a tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Acquiring lock "cinder-quobyte-1d53013a-92c0-4750-8eee-1bb601d07f46" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:28:42 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-371594df-dbe5-49a2-b020-748750bb8b3a tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Lock "cinder-quobyte-1d53013a-92c0-4750-8eee-1bb601d07f46" acquired by "delete_volume" :: waited 0.027s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:28:42 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[61371f66-097c-4e43-97d9-a20f4517dba8]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:28:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-371594df-dbe5-49a2-b020-748750bb8b3a tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1d53013a-92c0-4750-8eee-1bb601d07f46 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:42 devstack sudo[101347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1d53013a-92c0-4750-8eee-1bb601d07f46 Jul 07 08:28:42 devstack sudo[101347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:42 devstack sudo[101343]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d3aa1c98-d78e-4874-aa4c-5de1bcae6164 tempest-VolumesNegativeTest-1277888213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61621d42-79f4-40c1-a2bf-56ae05079749" returned: 0 in 0.776s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:42 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d3aa1c98-d78e-4874-aa4c-5de1bcae6164 tempest-VolumesNegativeTest-1277888213 None] Lock "cinder-quobyte-61621d42-79f4-40c1-a2bf-56ae05079749" released by "delete_volume" :: held 1.642s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:28:42 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-d3aa1c98-d78e-4874-aa4c-5de1bcae6164 tempest-VolumesNegativeTest-1277888213 None] Created reservations ['9f4e32b3-6cb1-48d3-bc4f-a6c43814dc4d', 'fe1aba7e-f238-4310-96cb-ab871b533300', 'f73c5c8f-44b2-4c73-9299-669142598392', '62e7cd16-df8a-4c6b-816f-99f49af56116'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:28:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d3aa1c98-d78e-4874-aa4c-5de1bcae6164 tempest-VolumesNegativeTest-1277888213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:28:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d3aa1c98-d78e-4874-aa4c-5de1bcae6164 tempest-VolumesNegativeTest-1277888213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:28:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d3aa1c98-d78e-4874-aa4c-5de1bcae6164 tempest-VolumesNegativeTest-1277888213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:28:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d3aa1c98-d78e-4874-aa4c-5de1bcae6164 tempest-VolumesNegativeTest-1277888213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:28:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d3aa1c98-d78e-4874-aa4c-5de1bcae6164 tempest-VolumesNegativeTest-1277888213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:28:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d3aa1c98-d78e-4874-aa4c-5de1bcae6164 tempest-VolumesNegativeTest-1277888213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:43 devstack sudo[101351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:28:43 devstack sudo[101351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:43 devstack sudo[101345]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e2e3abc9-c2d9-48fe-bf2e-7f17108d3aa9 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.796s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:43 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-e2e3abc9-c2d9-48fe-bf2e-7f17108d3aa9 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:28:43 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-e2e3abc9-c2d9-48fe-bf2e-7f17108d3aa9 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Deleted volume successfully. Jul 07 08:28:43 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e2e3abc9-c2d9-48fe-bf2e-7f17108d3aa9 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Lock "cinder-ff2eb1fb-3dce-421f-98cd-fe97f5148ec1-delete_volume" released by "delete_volume" :: held 2.891s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:28:43 devstack sudo[101347]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-371594df-dbe5-49a2-b020-748750bb8b3a tempest-CreateVolumesFromSourceVolumeTest-562473717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1d53013a-92c0-4750-8eee-1bb601d07f46" returned: 0 in 0.896s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-371594df-dbe5-49a2-b020-748750bb8b3a tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1d53013a-92c0-4750-8eee-1bb601d07f46 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:43 devstack sudo[101356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1d53013a-92c0-4750-8eee-1bb601d07f46 Jul 07 08:28:43 devstack sudo[101356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:43 devstack sudo[101351]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d3aa1c98-d78e-4874-aa4c-5de1bcae6164 tempest-VolumesNegativeTest-1277888213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.725s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:43 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-d3aa1c98-d78e-4874-aa4c-5de1bcae6164 tempest-VolumesNegativeTest-1277888213 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:28:43 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-d3aa1c98-d78e-4874-aa4c-5de1bcae6164 tempest-VolumesNegativeTest-1277888213 None] Deleted volume successfully. Jul 07 08:28:43 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d3aa1c98-d78e-4874-aa4c-5de1bcae6164 tempest-VolumesNegativeTest-1277888213 None] Lock "cinder-61621d42-79f4-40c1-a2bf-56ae05079749-delete_volume" released by "delete_volume" :: held 2.631s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:28:44 devstack sudo[101356]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-371594df-dbe5-49a2-b020-748750bb8b3a tempest-CreateVolumesFromSourceVolumeTest-562473717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1d53013a-92c0-4750-8eee-1bb601d07f46" returned: 0 in 0.721s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:44 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-371594df-dbe5-49a2-b020-748750bb8b3a tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Lock "cinder-quobyte-1d53013a-92c0-4750-8eee-1bb601d07f46" released by "delete_volume" :: held 1.691s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:28:44 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-371594df-dbe5-49a2-b020-748750bb8b3a tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Created reservations ['c93e4a61-206f-48db-8c8e-2e812d8016a5', '533d3613-b37a-491e-95bf-aa26adc87758', 'd1c156b9-73e2-46e4-a581-6bf902cfb33d', '7ef5b140-3995-4928-a678-c11871a21c6f'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:28:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-371594df-dbe5-49a2-b020-748750bb8b3a tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:28:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-371594df-dbe5-49a2-b020-748750bb8b3a tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:28:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-371594df-dbe5-49a2-b020-748750bb8b3a tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:28:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-371594df-dbe5-49a2-b020-748750bb8b3a tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:28:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-371594df-dbe5-49a2-b020-748750bb8b3a tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:28:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-371594df-dbe5-49a2-b020-748750bb8b3a tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:44 devstack sudo[101361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:28:44 devstack sudo[101361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9fcf6a6d-136d-47d6-84f4-238300db3703 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Acquiring lock "cinder-37574c17-3aee-40cb-b9a2-403a8b09b8ec-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:28:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9fcf6a6d-136d-47d6-84f4-238300db3703 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Lock "cinder-37574c17-3aee-40cb-b9a2-403a8b09b8ec-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:28:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9fcf6a6d-136d-47d6-84f4-238300db3703 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Acquiring lock "cinder-quobyte-37574c17-3aee-40cb-b9a2-403a8b09b8ec" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:28:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9fcf6a6d-136d-47d6-84f4-238300db3703 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Lock "cinder-quobyte-37574c17-3aee-40cb-b9a2-403a8b09b8ec" acquired by "delete_volume" :: waited 0.019s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:28:45 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[defe1587-8b7a-40e6-a61a-9b2a593774e5]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:28:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9fcf6a6d-136d-47d6-84f4-238300db3703 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37574c17-3aee-40cb-b9a2-403a8b09b8ec {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:45 devstack sudo[101361]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-371594df-dbe5-49a2-b020-748750bb8b3a tempest-CreateVolumesFromSourceVolumeTest-562473717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.759s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:45 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-371594df-dbe5-49a2-b020-748750bb8b3a tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:28:45 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-371594df-dbe5-49a2-b020-748750bb8b3a tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Deleted volume successfully. Jul 07 08:28:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-371594df-dbe5-49a2-b020-748750bb8b3a tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Lock "cinder-1d53013a-92c0-4750-8eee-1bb601d07f46-delete_volume" released by "delete_volume" :: held 2.728s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:28:45 devstack sudo[101364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37574c17-3aee-40cb-b9a2-403a8b09b8ec Jul 07 08:28:45 devstack sudo[101364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:46 devstack sudo[101364]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9fcf6a6d-136d-47d6-84f4-238300db3703 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37574c17-3aee-40cb-b9a2-403a8b09b8ec" returned: 0 in 0.901s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9fcf6a6d-136d-47d6-84f4-238300db3703 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37574c17-3aee-40cb-b9a2-403a8b09b8ec {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:46 devstack sudo[101370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37574c17-3aee-40cb-b9a2-403a8b09b8ec Jul 07 08:28:46 devstack sudo[101370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:46 devstack sudo[101370]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9fcf6a6d-136d-47d6-84f4-238300db3703 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37574c17-3aee-40cb-b9a2-403a8b09b8ec" returned: 0 in 0.777s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9fcf6a6d-136d-47d6-84f4-238300db3703 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Lock "cinder-quobyte-37574c17-3aee-40cb-b9a2-403a8b09b8ec" released by "delete_volume" :: held 1.728s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:28:46 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-9fcf6a6d-136d-47d6-84f4-238300db3703 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Created reservations ['4f416216-83d9-4af3-b410-0337a3f06761', 'c7a953ab-7c8f-4fbf-8065-5dbdb7c7cc7a', '1d5896ce-5387-45ef-9a74-1942404710ce', '38142d95-7b7c-41c7-9885-a3ce53a97dbe'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:28:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9fcf6a6d-136d-47d6-84f4-238300db3703 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:28:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9fcf6a6d-136d-47d6-84f4-238300db3703 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:28:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-9fcf6a6d-136d-47d6-84f4-238300db3703 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:28:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-9fcf6a6d-136d-47d6-84f4-238300db3703 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:28:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9fcf6a6d-136d-47d6-84f4-238300db3703 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:28:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9fcf6a6d-136d-47d6-84f4-238300db3703 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:47 devstack sudo[101379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:28:47 devstack sudo[101379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:47 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a97de7ef-9ab5-4e3b-92b5-93798a7f9925 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Acquiring lock "cinder-8469588e-0361-4f3a-a858-0cf8784be271-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:28:47 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a97de7ef-9ab5-4e3b-92b5-93798a7f9925 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Lock "cinder-8469588e-0361-4f3a-a858-0cf8784be271-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:28:47 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a97de7ef-9ab5-4e3b-92b5-93798a7f9925 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Acquiring lock "cinder-quobyte-8469588e-0361-4f3a-a858-0cf8784be271" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:28:47 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a97de7ef-9ab5-4e3b-92b5-93798a7f9925 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Lock "cinder-quobyte-8469588e-0361-4f3a-a858-0cf8784be271" acquired by "delete_volume" :: waited 0.019s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:28:47 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fcbb904-384c-4bf6-b8ed-fe78f98e6378]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:28:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a97de7ef-9ab5-4e3b-92b5-93798a7f9925 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8469588e-0361-4f3a-a858-0cf8784be271 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:47 devstack sudo[101381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8469588e-0361-4f3a-a858-0cf8784be271 Jul 07 08:28:47 devstack sudo[101381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:47 devstack sudo[101379]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9fcf6a6d-136d-47d6-84f4-238300db3703 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.793s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:47 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-9fcf6a6d-136d-47d6-84f4-238300db3703 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:28:47 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-9fcf6a6d-136d-47d6-84f4-238300db3703 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Deleted volume successfully. Jul 07 08:28:47 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9fcf6a6d-136d-47d6-84f4-238300db3703 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Lock "cinder-37574c17-3aee-40cb-b9a2-403a8b09b8ec-delete_volume" released by "delete_volume" :: held 2.857s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:28:48 devstack sudo[101381]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a97de7ef-9ab5-4e3b-92b5-93798a7f9925 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8469588e-0361-4f3a-a858-0cf8784be271" returned: 0 in 0.926s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a97de7ef-9ab5-4e3b-92b5-93798a7f9925 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8469588e-0361-4f3a-a858-0cf8784be271 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:48 devstack sudo[101389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8469588e-0361-4f3a-a858-0cf8784be271 Jul 07 08:28:48 devstack sudo[101389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:49 devstack sudo[101389]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a97de7ef-9ab5-4e3b-92b5-93798a7f9925 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8469588e-0361-4f3a-a858-0cf8784be271" returned: 0 in 0.753s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:49 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a97de7ef-9ab5-4e3b-92b5-93798a7f9925 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Lock "cinder-quobyte-8469588e-0361-4f3a-a858-0cf8784be271" released by "delete_volume" :: held 1.740s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:28:49 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-a97de7ef-9ab5-4e3b-92b5-93798a7f9925 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Created reservations ['82ce62a0-a999-468b-b747-bc219984e25f', 'e3cefd75-96c8-4cbe-9ffe-bb59825dd800', '59cf9f6a-311c-474d-a47f-0d9a8038f953', 'b3e6936d-5082-4716-b024-00def7c98ff6'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:28:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a97de7ef-9ab5-4e3b-92b5-93798a7f9925 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:28:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a97de7ef-9ab5-4e3b-92b5-93798a7f9925 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:28:49 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a97de7ef-9ab5-4e3b-92b5-93798a7f9925 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:28:49 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a97de7ef-9ab5-4e3b-92b5-93798a7f9925 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:28:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a97de7ef-9ab5-4e3b-92b5-93798a7f9925 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:28:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a97de7ef-9ab5-4e3b-92b5-93798a7f9925 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:49 devstack sudo[101392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:28:49 devstack sudo[101392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:49 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e6a18279-04e3-45e3-bc18-39fa2b9b7e9d tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Acquiring lock "cinder-4a06499a-d41b-48a1-a326-876e54d616e9-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:28:49 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e6a18279-04e3-45e3-bc18-39fa2b9b7e9d tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Lock "cinder-4a06499a-d41b-48a1-a326-876e54d616e9-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:28:49 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e6a18279-04e3-45e3-bc18-39fa2b9b7e9d tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Acquiring lock "cinder-quobyte-4a06499a-d41b-48a1-a326-876e54d616e9" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:28:49 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e6a18279-04e3-45e3-bc18-39fa2b9b7e9d tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Lock "cinder-quobyte-4a06499a-d41b-48a1-a326-876e54d616e9" acquired by "delete_volume" :: waited 0.019s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:28:49 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e28a84-5135-4a31-9ba0-32876d4dc1c7]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:28:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e6a18279-04e3-45e3-bc18-39fa2b9b7e9d tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4a06499a-d41b-48a1-a326-876e54d616e9 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:49 devstack sudo[101394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4a06499a-d41b-48a1-a326-876e54d616e9 Jul 07 08:28:49 devstack sudo[101394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:50 devstack sudo[101392]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a97de7ef-9ab5-4e3b-92b5-93798a7f9925 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 1.014s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:50 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-a97de7ef-9ab5-4e3b-92b5-93798a7f9925 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:28:50 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-a97de7ef-9ab5-4e3b-92b5-93798a7f9925 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Deleted volume successfully. Jul 07 08:28:50 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a97de7ef-9ab5-4e3b-92b5-93798a7f9925 tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Lock "cinder-8469588e-0361-4f3a-a858-0cf8784be271-delete_volume" released by "delete_volume" :: held 3.070s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:28:50 devstack sudo[101394]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e6a18279-04e3-45e3-bc18-39fa2b9b7e9d tempest-CreateVolumesFromSourceVolumeTest-562473717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4a06499a-d41b-48a1-a326-876e54d616e9" returned: 0 in 0.895s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e6a18279-04e3-45e3-bc18-39fa2b9b7e9d tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4a06499a-d41b-48a1-a326-876e54d616e9 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:50 devstack sudo[101401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4a06499a-d41b-48a1-a326-876e54d616e9 Jul 07 08:28:50 devstack sudo[101401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:51 devstack sudo[101401]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e6a18279-04e3-45e3-bc18-39fa2b9b7e9d tempest-CreateVolumesFromSourceVolumeTest-562473717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4a06499a-d41b-48a1-a326-876e54d616e9" returned: 0 in 0.762s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:51 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e6a18279-04e3-45e3-bc18-39fa2b9b7e9d tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Lock "cinder-quobyte-4a06499a-d41b-48a1-a326-876e54d616e9" released by "delete_volume" :: held 1.722s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:28:51 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-e6a18279-04e3-45e3-bc18-39fa2b9b7e9d tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Created reservations ['95dd3149-4255-4e44-a9d4-2c60cae21884', '8679c8e7-7159-46ed-b9c5-5b370b5c3f1c', '1b6c2fac-4cd8-4f74-bbee-4f132db3c928', '56088c4a-6e01-45c3-92bc-75d89ea3a01d'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:28:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e6a18279-04e3-45e3-bc18-39fa2b9b7e9d tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:28:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e6a18279-04e3-45e3-bc18-39fa2b9b7e9d tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:28:51 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e6a18279-04e3-45e3-bc18-39fa2b9b7e9d tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:28:51 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e6a18279-04e3-45e3-bc18-39fa2b9b7e9d tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:28:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e6a18279-04e3-45e3-bc18-39fa2b9b7e9d tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:28:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e6a18279-04e3-45e3-bc18-39fa2b9b7e9d tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:51 devstack sudo[101405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:28:51 devstack sudo[101405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:52 devstack sudo[101405]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e6a18279-04e3-45e3-bc18-39fa2b9b7e9d tempest-CreateVolumesFromSourceVolumeTest-562473717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.742s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:52 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-e6a18279-04e3-45e3-bc18-39fa2b9b7e9d tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:28:52 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-e6a18279-04e3-45e3-bc18-39fa2b9b7e9d tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Deleted volume successfully. Jul 07 08:28:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e6a18279-04e3-45e3-bc18-39fa2b9b7e9d tempest-CreateVolumesFromSourceVolumeTest-562473717 None] Lock "cinder-4a06499a-d41b-48a1-a326-876e54d616e9-delete_volume" released by "delete_volume" :: held 2.802s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:28:57 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-c57f54f6-2686-4a5e-a5a3-bf8f91ac9e5d tempest-ProjectReaderTests-1754239654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:28:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c57f54f6-2686-4a5e-a5a3-bf8f91ac9e5d tempest-ProjectReaderTests-1754239654 None] Flow 'volume_create_manager' (abaa7fc9-5999-4c52-8027-1a37a0be72e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:28:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c57f54f6-2686-4a5e-a5a3-bf8f91ac9e5d tempest-ProjectReaderTests-1754239654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc5ed1c3-9bf1-4894-b613-9f71434c6ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c57f54f6-2686-4a5e-a5a3-bf8f91ac9e5d tempest-ProjectReaderTests-1754239654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc5ed1c3-9bf1-4894-b613-9f71434c6ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-302529021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74b201c6-5fb7-45d1-8493-8b5e3b889635,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8ed2ffe292b4f6db15c6ef8a75c6494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:28:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:28:58Z,use_quota=True,user_id='fd35646d103f45cdaaaa01dc5a77ed25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c57f54f6-2686-4a5e-a5a3-bf8f91ac9e5d tempest-ProjectReaderTests-1754239654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f87c4b94-8ee8-4096-a74a-821c47f52e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c57f54f6-2686-4a5e-a5a3-bf8f91ac9e5d tempest-ProjectReaderTests-1754239654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f87c4b94-8ee8-4096-a74a-821c47f52e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c57f54f6-2686-4a5e-a5a3-bf8f91ac9e5d tempest-ProjectReaderTests-1754239654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22f7b581-d9d4-41f3-8c1b-00f02c8a245b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c57f54f6-2686-4a5e-a5a3-bf8f91ac9e5d tempest-ProjectReaderTests-1754239654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22f7b581-d9d4-41f3-8c1b-00f02c8a245b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74b201c6-5fb7-45d1-8493-8b5e3b889635', 'volume_name': 'volume-74b201c6-5fb7-45d1-8493-8b5e3b889635', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c57f54f6-2686-4a5e-a5a3-bf8f91ac9e5d tempest-ProjectReaderTests-1754239654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9de0daec-be2e-4ec8-bb79-efb738de97e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c57f54f6-2686-4a5e-a5a3-bf8f91ac9e5d tempest-ProjectReaderTests-1754239654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9de0daec-be2e-4ec8-bb79-efb738de97e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c57f54f6-2686-4a5e-a5a3-bf8f91ac9e5d tempest-ProjectReaderTests-1754239654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb75ad39-b26b-48e1-b17a-f8da126eabdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:57 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-c57f54f6-2686-4a5e-a5a3-bf8f91ac9e5d tempest-ProjectReaderTests-1754239654 None] Volume 74b201c6-5fb7-45d1-8493-8b5e3b889635: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74b201c6-5fb7-45d1-8493-8b5e3b889635', 'volume_size': 1} Jul 07 08:28:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c57f54f6-2686-4a5e-a5a3-bf8f91ac9e5d tempest-ProjectReaderTests-1754239654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:28:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c57f54f6-2686-4a5e-a5a3-bf8f91ac9e5d tempest-ProjectReaderTests-1754239654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:28:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c57f54f6-2686-4a5e-a5a3-bf8f91ac9e5d tempest-ProjectReaderTests-1754239654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-302529021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74b201c6-5fb7-45d1-8493-8b5e3b889635,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8ed2ffe292b4f6db15c6ef8a75c6494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:28:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:28:58Z,use_quota=True,user_id='fd35646d103f45cdaaaa01dc5a77ed25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:28:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-c57f54f6-2686-4a5e-a5a3-bf8f91ac9e5d tempest-ProjectReaderTests-1754239654 None] Creating volume 74b201c6-5fb7-45d1-8493-8b5e3b889635 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:28:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c57f54f6-2686-4a5e-a5a3-bf8f91ac9e5d tempest-ProjectReaderTests-1754239654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:28:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c57f54f6-2686-4a5e-a5a3-bf8f91ac9e5d tempest-ProjectReaderTests-1754239654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:28:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c57f54f6-2686-4a5e-a5a3-bf8f91ac9e5d tempest-ProjectReaderTests-1754239654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:28:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c57f54f6-2686-4a5e-a5a3-bf8f91ac9e5d tempest-ProjectReaderTests-1754239654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:28:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c57f54f6-2686-4a5e-a5a3-bf8f91ac9e5d tempest-ProjectReaderTests-1754239654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:28:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c57f54f6-2686-4a5e-a5a3-bf8f91ac9e5d tempest-ProjectReaderTests-1754239654 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:28:57 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-c57f54f6-2686-4a5e-a5a3-bf8f91ac9e5d tempest-ProjectReaderTests-1754239654 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:28:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c57f54f6-2686-4a5e-a5a3-bf8f91ac9e5d tempest-ProjectReaderTests-1754239654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-74b201c6-5fb7-45d1-8493-8b5e3b889635 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:57 devstack sudo[101410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-74b201c6-5fb7-45d1-8493-8b5e3b889635 1073741824 Jul 07 08:28:57 devstack sudo[101410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:59 devstack sudo[101410]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c57f54f6-2686-4a5e-a5a3-bf8f91ac9e5d tempest-ProjectReaderTests-1754239654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-74b201c6-5fb7-45d1-8493-8b5e3b889635 1073741824" returned: 0 in 1.079s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c57f54f6-2686-4a5e-a5a3-bf8f91ac9e5d tempest-ProjectReaderTests-1754239654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-74b201c6-5fb7-45d1-8493-8b5e3b889635 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:59 devstack sudo[101417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-74b201c6-5fb7-45d1-8493-8b5e3b889635 Jul 07 08:28:59 devstack sudo[101417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:59 devstack sudo[101417]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c57f54f6-2686-4a5e-a5a3-bf8f91ac9e5d tempest-ProjectReaderTests-1754239654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-74b201c6-5fb7-45d1-8493-8b5e3b889635" returned: 0 in 0.754s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:59 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c57f54f6-2686-4a5e-a5a3-bf8f91ac9e5d tempest-ProjectReaderTests-1754239654 None] <== create_volume: return (1884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:28:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c57f54f6-2686-4a5e-a5a3-bf8f91ac9e5d tempest-ProjectReaderTests-1754239654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.886s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:28:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c57f54f6-2686-4a5e-a5a3-bf8f91ac9e5d tempest-ProjectReaderTests-1754239654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb75ad39-b26b-48e1-b17a-f8da126eabdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74b201c6-5fb7-45d1-8493-8b5e3b889635', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c57f54f6-2686-4a5e-a5a3-bf8f91ac9e5d tempest-ProjectReaderTests-1754239654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b608a979-a1b8-47e9-b395-9f48f3afdbda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:59 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-c57f54f6-2686-4a5e-a5a3-bf8f91ac9e5d tempest-ProjectReaderTests-1754239654 None] Volume volume-74b201c6-5fb7-45d1-8493-8b5e3b889635 (74b201c6-5fb7-45d1-8493-8b5e3b889635): created successfully Jul 07 08:28:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c57f54f6-2686-4a5e-a5a3-bf8f91ac9e5d tempest-ProjectReaderTests-1754239654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b608a979-a1b8-47e9-b395-9f48f3afdbda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c57f54f6-2686-4a5e-a5a3-bf8f91ac9e5d tempest-ProjectReaderTests-1754239654 None] Flow 'volume_create_manager' (abaa7fc9-5999-4c52-8027-1a37a0be72e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:28:59 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-c57f54f6-2686-4a5e-a5a3-bf8f91ac9e5d tempest-ProjectReaderTests-1754239654 None] Created volume successfully. Jul 07 08:29:01 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d22c477b-a105-4c96-8e71-d802da9905fa tempest-ProjectReaderTests-1754239654 None] Acquiring lock "cinder-74b201c6-5fb7-45d1-8493-8b5e3b889635-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:29:01 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d22c477b-a105-4c96-8e71-d802da9905fa tempest-ProjectReaderTests-1754239654 None] Lock "cinder-74b201c6-5fb7-45d1-8493-8b5e3b889635-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:29:01 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d22c477b-a105-4c96-8e71-d802da9905fa tempest-ProjectReaderTests-1754239654 None] Acquiring lock "cinder-quobyte-74b201c6-5fb7-45d1-8493-8b5e3b889635" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:29:01 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d22c477b-a105-4c96-8e71-d802da9905fa tempest-ProjectReaderTests-1754239654 None] Lock "cinder-quobyte-74b201c6-5fb7-45d1-8493-8b5e3b889635" acquired by "delete_volume" :: waited 0.016s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:29:01 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2da706-be85-44ae-9b4c-c8a43e9a0e16]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:29:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d22c477b-a105-4c96-8e71-d802da9905fa tempest-ProjectReaderTests-1754239654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-74b201c6-5fb7-45d1-8493-8b5e3b889635 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:29:01 devstack sudo[101423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-74b201c6-5fb7-45d1-8493-8b5e3b889635 Jul 07 08:29:01 devstack sudo[101423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:29:02 devstack sudo[101423]: pam_unix(sudo:session): session closed for user root Jul 07 08:29:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d22c477b-a105-4c96-8e71-d802da9905fa tempest-ProjectReaderTests-1754239654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-74b201c6-5fb7-45d1-8493-8b5e3b889635" returned: 0 in 0.845s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:29:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d22c477b-a105-4c96-8e71-d802da9905fa tempest-ProjectReaderTests-1754239654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-74b201c6-5fb7-45d1-8493-8b5e3b889635 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:29:02 devstack sudo[101428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-74b201c6-5fb7-45d1-8493-8b5e3b889635 Jul 07 08:29:02 devstack sudo[101428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:29:03 devstack sudo[101428]: pam_unix(sudo:session): session closed for user root Jul 07 08:29:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d22c477b-a105-4c96-8e71-d802da9905fa tempest-ProjectReaderTests-1754239654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-74b201c6-5fb7-45d1-8493-8b5e3b889635" returned: 0 in 0.729s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:29:03 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d22c477b-a105-4c96-8e71-d802da9905fa tempest-ProjectReaderTests-1754239654 None] Lock "cinder-quobyte-74b201c6-5fb7-45d1-8493-8b5e3b889635" released by "delete_volume" :: held 1.631s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:29:03 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-d22c477b-a105-4c96-8e71-d802da9905fa tempest-ProjectReaderTests-1754239654 None] Created reservations ['bb8e61c1-7a97-4a27-bfa8-ed9b68192ab4', '917015bf-f6e3-4d76-80c8-90b0aba56d22', '08f047d7-61f7-4c1b-9d6b-082f5d6b2e26', 'a75ead52-b2b2-49e6-9dfc-32e4a688e19b'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:29:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d22c477b-a105-4c96-8e71-d802da9905fa tempest-ProjectReaderTests-1754239654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:29:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d22c477b-a105-4c96-8e71-d802da9905fa tempest-ProjectReaderTests-1754239654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:29:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d22c477b-a105-4c96-8e71-d802da9905fa tempest-ProjectReaderTests-1754239654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:29:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d22c477b-a105-4c96-8e71-d802da9905fa tempest-ProjectReaderTests-1754239654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:29:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d22c477b-a105-4c96-8e71-d802da9905fa tempest-ProjectReaderTests-1754239654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:29:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d22c477b-a105-4c96-8e71-d802da9905fa tempest-ProjectReaderTests-1754239654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:29:03 devstack sudo[101431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:29:03 devstack sudo[101431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:29:04 devstack sudo[101431]: pam_unix(sudo:session): session closed for user root Jul 07 08:29:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d22c477b-a105-4c96-8e71-d802da9905fa tempest-ProjectReaderTests-1754239654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 1.003s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:29:04 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-d22c477b-a105-4c96-8e71-d802da9905fa tempest-ProjectReaderTests-1754239654 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:29:04 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-d22c477b-a105-4c96-8e71-d802da9905fa tempest-ProjectReaderTests-1754239654 None] Deleted volume successfully. Jul 07 08:29:04 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d22c477b-a105-4c96-8e71-d802da9905fa tempest-ProjectReaderTests-1754239654 None] Lock "cinder-74b201c6-5fb7-45d1-8493-8b5e3b889635-delete_volume" released by "delete_volume" :: held 2.927s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:29:04 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-8452a25e-2b33-4340-8cd0-d8500dffe456 tempest-ProjectReaderTests-1754239654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:29:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8452a25e-2b33-4340-8cd0-d8500dffe456 tempest-ProjectReaderTests-1754239654 None] Flow 'volume_create_manager' (f77f40ab-1990-4d74-bd81-0a1de0334e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:29:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8452a25e-2b33-4340-8cd0-d8500dffe456 tempest-ProjectReaderTests-1754239654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1043be80-efb6-4b00-8f20-9aed3d4371cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:29:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8452a25e-2b33-4340-8cd0-d8500dffe456 tempest-ProjectReaderTests-1754239654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1043be80-efb6-4b00-8f20-9aed3d4371cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:29:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-879733471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14e213c5-9cd7-4c97-a2cf-827dbee9c9d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8ed2ffe292b4f6db15c6ef8a75c6494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:29:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:29:04Z,use_quota=True,user_id='fd35646d103f45cdaaaa01dc5a77ed25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:29:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8452a25e-2b33-4340-8cd0-d8500dffe456 tempest-ProjectReaderTests-1754239654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6d762e3-97a0-45e6-b0c8-ca9225b7d883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:29:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8452a25e-2b33-4340-8cd0-d8500dffe456 tempest-ProjectReaderTests-1754239654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6d762e3-97a0-45e6-b0c8-ca9225b7d883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:29:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8452a25e-2b33-4340-8cd0-d8500dffe456 tempest-ProjectReaderTests-1754239654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37d8dbe1-88ff-4ba1-8aa5-776ffbd5a58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:29:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8452a25e-2b33-4340-8cd0-d8500dffe456 tempest-ProjectReaderTests-1754239654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37d8dbe1-88ff-4ba1-8aa5-776ffbd5a58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14e213c5-9cd7-4c97-a2cf-827dbee9c9d8', 'volume_name': 'volume-14e213c5-9cd7-4c97-a2cf-827dbee9c9d8', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:29:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8452a25e-2b33-4340-8cd0-d8500dffe456 tempest-ProjectReaderTests-1754239654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c2b844e-0986-4fb7-90bb-685e7b3d8687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:29:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8452a25e-2b33-4340-8cd0-d8500dffe456 tempest-ProjectReaderTests-1754239654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c2b844e-0986-4fb7-90bb-685e7b3d8687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:29:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8452a25e-2b33-4340-8cd0-d8500dffe456 tempest-ProjectReaderTests-1754239654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16ede06a-e8f0-46b8-905b-9768801fd738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:29:04 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-8452a25e-2b33-4340-8cd0-d8500dffe456 tempest-ProjectReaderTests-1754239654 None] Volume 14e213c5-9cd7-4c97-a2cf-827dbee9c9d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14e213c5-9cd7-4c97-a2cf-827dbee9c9d8', 'volume_size': 1} Jul 07 08:29:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8452a25e-2b33-4340-8cd0-d8500dffe456 tempest-ProjectReaderTests-1754239654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:29:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8452a25e-2b33-4340-8cd0-d8500dffe456 tempest-ProjectReaderTests-1754239654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:29:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8452a25e-2b33-4340-8cd0-d8500dffe456 tempest-ProjectReaderTests-1754239654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:29:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-879733471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14e213c5-9cd7-4c97-a2cf-827dbee9c9d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8ed2ffe292b4f6db15c6ef8a75c6494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:29:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:29:04Z,use_quota=True,user_id='fd35646d103f45cdaaaa01dc5a77ed25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:29:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-8452a25e-2b33-4340-8cd0-d8500dffe456 tempest-ProjectReaderTests-1754239654 None] Creating volume 14e213c5-9cd7-4c97-a2cf-827dbee9c9d8 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:29:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8452a25e-2b33-4340-8cd0-d8500dffe456 tempest-ProjectReaderTests-1754239654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:29:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8452a25e-2b33-4340-8cd0-d8500dffe456 tempest-ProjectReaderTests-1754239654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:29:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8452a25e-2b33-4340-8cd0-d8500dffe456 tempest-ProjectReaderTests-1754239654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:29:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8452a25e-2b33-4340-8cd0-d8500dffe456 tempest-ProjectReaderTests-1754239654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:29:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8452a25e-2b33-4340-8cd0-d8500dffe456 tempest-ProjectReaderTests-1754239654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:29:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8452a25e-2b33-4340-8cd0-d8500dffe456 tempest-ProjectReaderTests-1754239654 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:29:04 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-8452a25e-2b33-4340-8cd0-d8500dffe456 tempest-ProjectReaderTests-1754239654 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:29:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8452a25e-2b33-4340-8cd0-d8500dffe456 tempest-ProjectReaderTests-1754239654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-14e213c5-9cd7-4c97-a2cf-827dbee9c9d8 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:29:04 devstack sudo[101434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-14e213c5-9cd7-4c97-a2cf-827dbee9c9d8 1073741824 Jul 07 08:29:04 devstack sudo[101434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:29:05 devstack sudo[101434]: pam_unix(sudo:session): session closed for user root Jul 07 08:29:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8452a25e-2b33-4340-8cd0-d8500dffe456 tempest-ProjectReaderTests-1754239654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-14e213c5-9cd7-4c97-a2cf-827dbee9c9d8 1073741824" returned: 0 in 0.992s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:29:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8452a25e-2b33-4340-8cd0-d8500dffe456 tempest-ProjectReaderTests-1754239654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-14e213c5-9cd7-4c97-a2cf-827dbee9c9d8 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:29:05 devstack sudo[101440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-14e213c5-9cd7-4c97-a2cf-827dbee9c9d8 Jul 07 08:29:05 devstack sudo[101440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:29:05 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:29:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:29:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:29:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:29:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:29:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:29:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:29:05 devstack sudo[101442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:29:05 devstack sudo[101442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:29:06 devstack sudo[101440]: pam_unix(sudo:session): session closed for user root Jul 07 08:29:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8452a25e-2b33-4340-8cd0-d8500dffe456 tempest-ProjectReaderTests-1754239654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-14e213c5-9cd7-4c97-a2cf-827dbee9c9d8" returned: 0 in 1.046s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:29:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8452a25e-2b33-4340-8cd0-d8500dffe456 tempest-ProjectReaderTests-1754239654 None] <== create_volume: return (2120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:29:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8452a25e-2b33-4340-8cd0-d8500dffe456 tempest-ProjectReaderTests-1754239654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.125s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:29:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8452a25e-2b33-4340-8cd0-d8500dffe456 tempest-ProjectReaderTests-1754239654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16ede06a-e8f0-46b8-905b-9768801fd738) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14e213c5-9cd7-4c97-a2cf-827dbee9c9d8', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:29:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8452a25e-2b33-4340-8cd0-d8500dffe456 tempest-ProjectReaderTests-1754239654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90ca074d-1102-4225-b2a5-109e7f77e87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:29:06 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-8452a25e-2b33-4340-8cd0-d8500dffe456 tempest-ProjectReaderTests-1754239654 None] Volume volume-14e213c5-9cd7-4c97-a2cf-827dbee9c9d8 (14e213c5-9cd7-4c97-a2cf-827dbee9c9d8): created successfully Jul 07 08:29:06 devstack sudo[101442]: pam_unix(sudo:session): session closed for user root Jul 07 08:29:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8452a25e-2b33-4340-8cd0-d8500dffe456 tempest-ProjectReaderTests-1754239654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90ca074d-1102-4225-b2a5-109e7f77e87f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:29:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8452a25e-2b33-4340-8cd0-d8500dffe456 tempest-ProjectReaderTests-1754239654 None] Flow 'volume_create_manager' (f77f40ab-1990-4d74-bd81-0a1de0334e69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:29:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.836s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:29:06 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:29:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running periodic task VolumeManager._thread_info {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:29:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] thread count: 29 {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 08:29:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] thread info: [<_MainThread(MainThread, started 133056092332160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 08:29:06 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-8452a25e-2b33-4340-8cd0-d8500dffe456 tempest-ProjectReaderTests-1754239654 None] Created volume successfully. Jul 07 08:29:07 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-41454c7d-a7ee-45cf-99e5-f9d645b88166 tempest-ProjectReaderTests-1754239654 None] Acquiring lock "cinder-14e213c5-9cd7-4c97-a2cf-827dbee9c9d8-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:29:07 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-41454c7d-a7ee-45cf-99e5-f9d645b88166 tempest-ProjectReaderTests-1754239654 None] Lock "cinder-14e213c5-9cd7-4c97-a2cf-827dbee9c9d8-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:29:07 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-41454c7d-a7ee-45cf-99e5-f9d645b88166 tempest-ProjectReaderTests-1754239654 None] Acquiring lock "cinder-quobyte-14e213c5-9cd7-4c97-a2cf-827dbee9c9d8" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:29:07 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-41454c7d-a7ee-45cf-99e5-f9d645b88166 tempest-ProjectReaderTests-1754239654 None] Lock "cinder-quobyte-14e213c5-9cd7-4c97-a2cf-827dbee9c9d8" acquired by "delete_volume" :: waited 0.025s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:29:07 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7e7f92-6dc9-48c6-920e-4ff7c40943e3]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:29:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-41454c7d-a7ee-45cf-99e5-f9d645b88166 tempest-ProjectReaderTests-1754239654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-14e213c5-9cd7-4c97-a2cf-827dbee9c9d8 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:29:07 devstack sudo[101446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-14e213c5-9cd7-4c97-a2cf-827dbee9c9d8 Jul 07 08:29:07 devstack sudo[101446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:29:08 devstack sudo[101446]: pam_unix(sudo:session): session closed for user root Jul 07 08:29:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-41454c7d-a7ee-45cf-99e5-f9d645b88166 tempest-ProjectReaderTests-1754239654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-14e213c5-9cd7-4c97-a2cf-827dbee9c9d8" returned: 0 in 0.974s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:29:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-41454c7d-a7ee-45cf-99e5-f9d645b88166 tempest-ProjectReaderTests-1754239654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-14e213c5-9cd7-4c97-a2cf-827dbee9c9d8 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:29:08 devstack sudo[101451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-14e213c5-9cd7-4c97-a2cf-827dbee9c9d8 Jul 07 08:29:08 devstack sudo[101451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:29:09 devstack sudo[101451]: pam_unix(sudo:session): session closed for user root Jul 07 08:29:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-41454c7d-a7ee-45cf-99e5-f9d645b88166 tempest-ProjectReaderTests-1754239654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-14e213c5-9cd7-4c97-a2cf-827dbee9c9d8" returned: 0 in 0.770s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:29:09 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-41454c7d-a7ee-45cf-99e5-f9d645b88166 tempest-ProjectReaderTests-1754239654 None] Lock "cinder-quobyte-14e213c5-9cd7-4c97-a2cf-827dbee9c9d8" released by "delete_volume" :: held 1.811s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:29:09 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-41454c7d-a7ee-45cf-99e5-f9d645b88166 tempest-ProjectReaderTests-1754239654 None] Created reservations ['0027b86f-1a79-4320-b457-1f223c6b73d9', 'c9941fe2-047a-4906-a57d-73018856a1b1', '4dba9564-c76d-4304-b388-ff56a351e82d', '6775b415-dc51-48bf-9b94-0f34fcb0c9af'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:29:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-41454c7d-a7ee-45cf-99e5-f9d645b88166 tempest-ProjectReaderTests-1754239654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:29:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-41454c7d-a7ee-45cf-99e5-f9d645b88166 tempest-ProjectReaderTests-1754239654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:29:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-41454c7d-a7ee-45cf-99e5-f9d645b88166 tempest-ProjectReaderTests-1754239654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:29:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-41454c7d-a7ee-45cf-99e5-f9d645b88166 tempest-ProjectReaderTests-1754239654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:29:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-41454c7d-a7ee-45cf-99e5-f9d645b88166 tempest-ProjectReaderTests-1754239654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:29:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-41454c7d-a7ee-45cf-99e5-f9d645b88166 tempest-ProjectReaderTests-1754239654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:29:09 devstack sudo[101454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:29:09 devstack sudo[101454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:29:10 devstack sudo[101454]: pam_unix(sudo:session): session closed for user root Jul 07 08:29:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-41454c7d-a7ee-45cf-99e5-f9d645b88166 tempest-ProjectReaderTests-1754239654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.878s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:29:10 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-41454c7d-a7ee-45cf-99e5-f9d645b88166 tempest-ProjectReaderTests-1754239654 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:29:10 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-41454c7d-a7ee-45cf-99e5-f9d645b88166 tempest-ProjectReaderTests-1754239654 None] Deleted volume successfully. Jul 07 08:29:10 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-41454c7d-a7ee-45cf-99e5-f9d645b88166 tempest-ProjectReaderTests-1754239654 None] Lock "cinder-14e213c5-9cd7-4c97-a2cf-827dbee9c9d8-delete_volume" released by "delete_volume" :: held 2.997s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:29:16 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca43daf5-91cd-47c5-a408-198a2e61c556 tempest-TestInstancesWithCinderVolumes-1289129289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:29:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca43daf5-91cd-47c5-a408-198a2e61c556 tempest-TestInstancesWithCinderVolumes-1289129289 None] Flow 'volume_create_manager' (a2d31589-bce8-4357-b4f1-0c637c72097b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:29:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca43daf5-91cd-47c5-a408-198a2e61c556 tempest-TestInstancesWithCinderVolumes-1289129289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57a8d2f9-0a2c-4bcb-8939-4ed6513ed90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:29:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca43daf5-91cd-47c5-a408-198a2e61c556 tempest-TestInstancesWithCinderVolumes-1289129289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57a8d2f9-0a2c-4bcb-8939-4ed6513ed90e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:29:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1580896853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=006e327c-20f8-4d7b-a300-d70ed3f4fb17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6449d8ca1c504e738d80e4140e489846',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:29:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:29:17Z,use_quota=True,user_id='6adb980f571f4b6a8c3986eddb61051b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86d98b2-5389-47aa-9ef5-4cb1c91946d5),volume_type_id=e86d98b2-5389-47aa-9ef5-4cb1c91946d5)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:29:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca43daf5-91cd-47c5-a408-198a2e61c556 tempest-TestInstancesWithCinderVolumes-1289129289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b182f63-b3f2-45b1-90a1-139da25afc8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:29:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca43daf5-91cd-47c5-a408-198a2e61c556 tempest-TestInstancesWithCinderVolumes-1289129289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b182f63-b3f2-45b1-90a1-139da25afc8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:29:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca43daf5-91cd-47c5-a408-198a2e61c556 tempest-TestInstancesWithCinderVolumes-1289129289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33238009-f497-4779-bcc0-8cda0bb60dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:29:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca43daf5-91cd-47c5-a408-198a2e61c556 tempest-TestInstancesWithCinderVolumes-1289129289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33238009-f497-4779-bcc0-8cda0bb60dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '006e327c-20f8-4d7b-a300-d70ed3f4fb17', 'volume_name': 'volume-006e327c-20f8-4d7b-a300-d70ed3f4fb17', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:29:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca43daf5-91cd-47c5-a408-198a2e61c556 tempest-TestInstancesWithCinderVolumes-1289129289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c756591-a2c8-483d-8680-3c4c7955bf9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:29:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca43daf5-91cd-47c5-a408-198a2e61c556 tempest-TestInstancesWithCinderVolumes-1289129289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c756591-a2c8-483d-8680-3c4c7955bf9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:29:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca43daf5-91cd-47c5-a408-198a2e61c556 tempest-TestInstancesWithCinderVolumes-1289129289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6629f2c-3867-410c-8bc1-d34e824256d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:29:17 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-ca43daf5-91cd-47c5-a408-198a2e61c556 tempest-TestInstancesWithCinderVolumes-1289129289 None] Volume 006e327c-20f8-4d7b-a300-d70ed3f4fb17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-006e327c-20f8-4d7b-a300-d70ed3f4fb17', 'volume_size': 1} Jul 07 08:29:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca43daf5-91cd-47c5-a408-198a2e61c556 tempest-TestInstancesWithCinderVolumes-1289129289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:29:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca43daf5-91cd-47c5-a408-198a2e61c556 tempest-TestInstancesWithCinderVolumes-1289129289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:29:17 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ca43daf5-91cd-47c5-a408-198a2e61c556 tempest-TestInstancesWithCinderVolumes-1289129289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:29:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1580896853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=006e327c-20f8-4d7b-a300-d70ed3f4fb17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6449d8ca1c504e738d80e4140e489846',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:29:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:29:17Z,use_quota=True,user_id='6adb980f571f4b6a8c3986eddb61051b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86d98b2-5389-47aa-9ef5-4cb1c91946d5),volume_type_id=e86d98b2-5389-47aa-9ef5-4cb1c91946d5)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:29:17 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-ca43daf5-91cd-47c5-a408-198a2e61c556 tempest-TestInstancesWithCinderVolumes-1289129289 None] Creating volume 006e327c-20f8-4d7b-a300-d70ed3f4fb17 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:29:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca43daf5-91cd-47c5-a408-198a2e61c556 tempest-TestInstancesWithCinderVolumes-1289129289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:29:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca43daf5-91cd-47c5-a408-198a2e61c556 tempest-TestInstancesWithCinderVolumes-1289129289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:29:17 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ca43daf5-91cd-47c5-a408-198a2e61c556 tempest-TestInstancesWithCinderVolumes-1289129289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:29:17 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ca43daf5-91cd-47c5-a408-198a2e61c556 tempest-TestInstancesWithCinderVolumes-1289129289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:29:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca43daf5-91cd-47c5-a408-198a2e61c556 tempest-TestInstancesWithCinderVolumes-1289129289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:29:17 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ca43daf5-91cd-47c5-a408-198a2e61c556 tempest-TestInstancesWithCinderVolumes-1289129289 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:29:17 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-ca43daf5-91cd-47c5-a408-198a2e61c556 tempest-TestInstancesWithCinderVolumes-1289129289 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:29:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca43daf5-91cd-47c5-a408-198a2e61c556 tempest-TestInstancesWithCinderVolumes-1289129289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-006e327c-20f8-4d7b-a300-d70ed3f4fb17 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:29:17 devstack sudo[101458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-006e327c-20f8-4d7b-a300-d70ed3f4fb17 1073741824 Jul 07 08:29:17 devstack sudo[101458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:29:17 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-aca6a541-0903-4695-9874-a9e4082ceb07 tempest-TestInstancesWithCinderVolumes-1289129289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:29:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-aca6a541-0903-4695-9874-a9e4082ceb07 tempest-TestInstancesWithCinderVolumes-1289129289 None] Flow 'volume_create_manager' (c82040ab-4fa4-48d5-87df-68ab2b3f59df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:29:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-aca6a541-0903-4695-9874-a9e4082ceb07 tempest-TestInstancesWithCinderVolumes-1289129289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ffd6de4-d270-438f-8198-1ca8f1e98703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:29:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-aca6a541-0903-4695-9874-a9e4082ceb07 tempest-TestInstancesWithCinderVolumes-1289129289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ffd6de4-d270-438f-8198-1ca8f1e98703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:29:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1470848527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5c67224-9967-4aef-832d-b4ba5bec1616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6449d8ca1c504e738d80e4140e489846',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:29:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:29:17Z,use_quota=True,user_id='6adb980f571f4b6a8c3986eddb61051b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27fa8073-e6a2-45d6-ae4a-40022476ce51),volume_type_id=27fa8073-e6a2-45d6-ae4a-40022476ce51)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:29:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-aca6a541-0903-4695-9874-a9e4082ceb07 tempest-TestInstancesWithCinderVolumes-1289129289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a12f5ac-47f5-40c0-b663-db308c441984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:29:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-aca6a541-0903-4695-9874-a9e4082ceb07 tempest-TestInstancesWithCinderVolumes-1289129289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a12f5ac-47f5-40c0-b663-db308c441984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:29:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-aca6a541-0903-4695-9874-a9e4082ceb07 tempest-TestInstancesWithCinderVolumes-1289129289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0f20b02-0f36-442b-9c6f-27f1b0c60b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:29:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-aca6a541-0903-4695-9874-a9e4082ceb07 tempest-TestInstancesWithCinderVolumes-1289129289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0f20b02-0f36-442b-9c6f-27f1b0c60b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5c67224-9967-4aef-832d-b4ba5bec1616', 'volume_name': 'volume-e5c67224-9967-4aef-832d-b4ba5bec1616', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:29:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-aca6a541-0903-4695-9874-a9e4082ceb07 tempest-TestInstancesWithCinderVolumes-1289129289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e924b86-1e3d-423f-a9a9-2fd8cdfe6c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:29:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-aca6a541-0903-4695-9874-a9e4082ceb07 tempest-TestInstancesWithCinderVolumes-1289129289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e924b86-1e3d-423f-a9a9-2fd8cdfe6c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:29:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-aca6a541-0903-4695-9874-a9e4082ceb07 tempest-TestInstancesWithCinderVolumes-1289129289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26e7245c-b726-4f62-90ee-9fe3a39a448e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:29:17 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-aca6a541-0903-4695-9874-a9e4082ceb07 tempest-TestInstancesWithCinderVolumes-1289129289 None] Volume e5c67224-9967-4aef-832d-b4ba5bec1616: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5c67224-9967-4aef-832d-b4ba5bec1616', 'volume_size': 1} Jul 07 08:29:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-aca6a541-0903-4695-9874-a9e4082ceb07 tempest-TestInstancesWithCinderVolumes-1289129289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:29:18 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:29:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] Flow 'volume_create_manager' (bcec6ced-a26e-4de1-8761-9de868703573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:29:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c70a517c-91e0-4f56-ae33-91f41fce66bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:29:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c70a517c-91e0-4f56-ae33-91f41fce66bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:29:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2019054667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f17ccc6-cbf4-4cf5-a89b-db9a54b0d8dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6449d8ca1c504e738d80e4140e489846',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:29:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:29:18Z,use_quota=True,user_id='6adb980f571f4b6a8c3986eddb61051b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6fd24d7-b9a2-4015-a40f-996affc4714b),volume_type_id=c6fd24d7-b9a2-4015-a40f-996affc4714b)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:29:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eb51303-895b-4928-9976-0be5c6796dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:29:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eb51303-895b-4928-9976-0be5c6796dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:29:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42d53f74-d7e5-49be-9d6d-44f851409d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:29:18 devstack cinder-volume[87199]: DEBUG cinder.image.glance [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] Creating Keystone auth plugin from conf {{(pid=87199) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 08:29:18 devstack sudo[101458]: pam_unix(sudo:session): session closed for user root Jul 07 08:29:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca43daf5-91cd-47c5-a408-198a2e61c556 tempest-TestInstancesWithCinderVolumes-1289129289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-006e327c-20f8-4d7b-a300-d70ed3f4fb17 1073741824" returned: 0 in 1.546s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:29:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca43daf5-91cd-47c5-a408-198a2e61c556 tempest-TestInstancesWithCinderVolumes-1289129289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-006e327c-20f8-4d7b-a300-d70ed3f4fb17 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:29:18 devstack sudo[101464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-006e327c-20f8-4d7b-a300-d70ed3f4fb17 Jul 07 08:29:18 devstack sudo[101464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:29:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42d53f74-d7e5-49be-9d6d-44f851409d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3f17ccc6-cbf4-4cf5-a89b-db9a54b0d8dc', 'volume_name': 'volume-3f17ccc6-cbf4-4cf5-a89b-db9a54b0d8dc', 'volume_size': 1, 'image_id': 'f4695355-1ce5-4b7f-85f8-c58341ad3eea', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f4695355-1ce5-4b7f-85f8-c58341ad3eea', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1134445155', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6449d8ca1c504e738d80e4140e489846', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f4695355-1ce5-4b7f-85f8-c58341ad3eea', 'created_at': datetime.datetime(2026, 7, 7, 6, 29, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 6, 29, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f4695355-1ce5-4b7f-85f8-c58341ad3eea/file', 'properties': {}}, 'image_service': }' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:29:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58e0090a-a056-42bd-b718-602bf44f1e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:29:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58e0090a-a056-42bd-b718-602bf44f1e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:29:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (182832f7-454c-45b1-adc2-f626321fc620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:29:18 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] Volume 3f17ccc6-cbf4-4cf5-a89b-db9a54b0d8dc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3f17ccc6-cbf4-4cf5-a89b-db9a54b0d8dc', 'volume_size': 1, 'image_id': 'f4695355-1ce5-4b7f-85f8-c58341ad3eea', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f4695355-1ce5-4b7f-85f8-c58341ad3eea', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1134445155', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6449d8ca1c504e738d80e4140e489846', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f4695355-1ce5-4b7f-85f8-c58341ad3eea', 'created_at': datetime.datetime(2026, 7, 7, 6, 29, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 6, 29, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f4695355-1ce5-4b7f-85f8-c58341ad3eea/file', 'properties': {}}, 'image_service': } Jul 07 08:29:18 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] Trying to clone 3f17ccc6-cbf4-4cf5-a89b-db9a54b0d8dc from image f4695355-1ce5-4b7f-85f8-c58341ad3eea at location (None, [{'url': 'file:///opt/stack/data/glance/images/f4695355-1ce5-4b7f-85f8-c58341ad3eea', 'metadata': {}}]). {{(pid=87199) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 08:29:19 devstack sudo[101464]: pam_unix(sudo:session): session closed for user root Jul 07 08:29:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca43daf5-91cd-47c5-a408-198a2e61c556 tempest-TestInstancesWithCinderVolumes-1289129289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-006e327c-20f8-4d7b-a300-d70ed3f4fb17" returned: 0 in 0.953s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:29:19 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ca43daf5-91cd-47c5-a408-198a2e61c556 tempest-TestInstancesWithCinderVolumes-1289129289 None] <== create_volume: return (2574ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:29:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca43daf5-91cd-47c5-a408-198a2e61c556 tempest-TestInstancesWithCinderVolumes-1289129289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.578s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:29:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-aca6a541-0903-4695-9874-a9e4082ceb07 tempest-TestInstancesWithCinderVolumes-1289129289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.820s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:29:19 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-aca6a541-0903-4695-9874-a9e4082ceb07 tempest-TestInstancesWithCinderVolumes-1289129289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:29:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1470848527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5c67224-9967-4aef-832d-b4ba5bec1616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6449d8ca1c504e738d80e4140e489846',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:29:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:29:17Z,use_quota=True,user_id='6adb980f571f4b6a8c3986eddb61051b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27fa8073-e6a2-45d6-ae4a-40022476ce51),volume_type_id=27fa8073-e6a2-45d6-ae4a-40022476ce51)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:29:19 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-aca6a541-0903-4695-9874-a9e4082ceb07 tempest-TestInstancesWithCinderVolumes-1289129289 None] Creating volume e5c67224-9967-4aef-832d-b4ba5bec1616 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:29:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-aca6a541-0903-4695-9874-a9e4082ceb07 tempest-TestInstancesWithCinderVolumes-1289129289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:29:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-aca6a541-0903-4695-9874-a9e4082ceb07 tempest-TestInstancesWithCinderVolumes-1289129289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:29:19 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-aca6a541-0903-4695-9874-a9e4082ceb07 tempest-TestInstancesWithCinderVolumes-1289129289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:29:19 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-aca6a541-0903-4695-9874-a9e4082ceb07 tempest-TestInstancesWithCinderVolumes-1289129289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:29:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-aca6a541-0903-4695-9874-a9e4082ceb07 tempest-TestInstancesWithCinderVolumes-1289129289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:29:19 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-aca6a541-0903-4695-9874-a9e4082ceb07 tempest-TestInstancesWithCinderVolumes-1289129289 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:29:19 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-aca6a541-0903-4695-9874-a9e4082ceb07 tempest-TestInstancesWithCinderVolumes-1289129289 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:29:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-aca6a541-0903-4695-9874-a9e4082ceb07 tempest-TestInstancesWithCinderVolumes-1289129289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-e5c67224-9967-4aef-832d-b4ba5bec1616 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:29:19 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca43daf5-91cd-47c5-a408-198a2e61c556 tempest-TestInstancesWithCinderVolumes-1289129289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6629f2c-3867-410c-8bc1-d34e824256d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-006e327c-20f8-4d7b-a300-d70ed3f4fb17', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:29:19 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca43daf5-91cd-47c5-a408-198a2e61c556 tempest-TestInstancesWithCinderVolumes-1289129289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (618a0afc-cbf9-471b-82da-b0894e729eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:29:19 devstack sudo[101467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-e5c67224-9967-4aef-832d-b4ba5bec1616 1073741824 Jul 07 08:29:19 devstack sudo[101467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:29:19 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-ca43daf5-91cd-47c5-a408-198a2e61c556 tempest-TestInstancesWithCinderVolumes-1289129289 None] Volume volume-006e327c-20f8-4d7b-a300-d70ed3f4fb17 (006e327c-20f8-4d7b-a300-d70ed3f4fb17): created successfully Jul 07 08:29:19 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca43daf5-91cd-47c5-a408-198a2e61c556 tempest-TestInstancesWithCinderVolumes-1289129289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (618a0afc-cbf9-471b-82da-b0894e729eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:29:19 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ca43daf5-91cd-47c5-a408-198a2e61c556 tempest-TestInstancesWithCinderVolumes-1289129289 None] Flow 'volume_create_manager' (a2d31589-bce8-4357-b4f1-0c637c72097b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:29:19 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-ca43daf5-91cd-47c5-a408-198a2e61c556 tempest-TestInstancesWithCinderVolumes-1289129289 None] Created volume successfully. Jul 07 08:29:20 devstack sudo[101467]: pam_unix(sudo:session): session closed for user root Jul 07 08:29:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-aca6a541-0903-4695-9874-a9e4082ceb07 tempest-TestInstancesWithCinderVolumes-1289129289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-e5c67224-9967-4aef-832d-b4ba5bec1616 1073741824" returned: 0 in 1.272s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:29:20 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=75,cinder:UPDATE=98,cinder:INSERT=25,cinder:DELETE=9 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:29:20 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=69,cinder:UPDATE=120,cinder:DELETE=10,cinder:INSERT=25 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:29:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-aca6a541-0903-4695-9874-a9e4082ceb07 tempest-TestInstancesWithCinderVolumes-1289129289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-e5c67224-9967-4aef-832d-b4ba5bec1616 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:29:20 devstack sudo[101473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-e5c67224-9967-4aef-832d-b4ba5bec1616 Jul 07 08:29:20 devstack sudo[101473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:29:21 devstack sudo[101473]: pam_unix(sudo:session): session closed for user root Jul 07 08:29:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-aca6a541-0903-4695-9874-a9e4082ceb07 tempest-TestInstancesWithCinderVolumes-1289129289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-e5c67224-9967-4aef-832d-b4ba5bec1616" returned: 0 in 0.774s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:29:21 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-aca6a541-0903-4695-9874-a9e4082ceb07 tempest-TestInstancesWithCinderVolumes-1289129289 None] <== create_volume: return (2101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:29:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-aca6a541-0903-4695-9874-a9e4082ceb07 tempest-TestInstancesWithCinderVolumes-1289129289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.104s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:29:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-aca6a541-0903-4695-9874-a9e4082ceb07 tempest-TestInstancesWithCinderVolumes-1289129289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26e7245c-b726-4f62-90ee-9fe3a39a448e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5c67224-9967-4aef-832d-b4ba5bec1616', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:29:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-aca6a541-0903-4695-9874-a9e4082ceb07 tempest-TestInstancesWithCinderVolumes-1289129289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5e74017-e6ef-48b4-a6cf-55d4d3d7af32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:29:21 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-aca6a541-0903-4695-9874-a9e4082ceb07 tempest-TestInstancesWithCinderVolumes-1289129289 None] Volume volume-e5c67224-9967-4aef-832d-b4ba5bec1616 (e5c67224-9967-4aef-832d-b4ba5bec1616): created successfully Jul 07 08:29:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-aca6a541-0903-4695-9874-a9e4082ceb07 tempest-TestInstancesWithCinderVolumes-1289129289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5e74017-e6ef-48b4-a6cf-55d4d3d7af32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:29:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-aca6a541-0903-4695-9874-a9e4082ceb07 tempest-TestInstancesWithCinderVolumes-1289129289 None] Flow 'volume_create_manager' (c82040ab-4fa4-48d5-87df-68ab2b3f59df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:29:21 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-aca6a541-0903-4695-9874-a9e4082ceb07 tempest-TestInstancesWithCinderVolumes-1289129289 None] Created volume successfully. Jul 07 08:29:22 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f4695355-1ce5-4b7f-85f8-c58341ad3eea_3g4oas6kdevstack@QuobyteHD, size 20.69 MB, duration 3.98 sec {{(pid=87199) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 08:29:22 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] Image download 20.69 MB at 5.19 MB/s Jul 07 08:29:22 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[852bdf2c-5f96-4ab5-a3fb-7c1db49615da]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:29:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4695355-1ce5-4b7f-85f8-c58341ad3eea_3g4oas6kdevstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:29:23 devstack sudo[101477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4695355-1ce5-4b7f-85f8-c58341ad3eea_3g4oas6kdevstack@QuobyteHD Jul 07 08:29:23 devstack sudo[101477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:29:23 devstack sudo[101477]: pam_unix(sudo:session): session closed for user root Jul 07 08:29:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4695355-1ce5-4b7f-85f8-c58341ad3eea_3g4oas6kdevstack@QuobyteHD" returned: 0 in 0.877s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:29:23 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] Temporary image f4695355-1ce5-4b7f-85f8-c58341ad3eea is fetched for user 6adb980f571f4b6a8c3986eddb61051b. {{(pid=87199) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 08:29:23 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb6c774-9571-498b-a4be-9394dea1dfd5]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:29:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4695355-1ce5-4b7f-85f8-c58341ad3eea_3g4oas6kdevstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:29:24 devstack sudo[101482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4695355-1ce5-4b7f-85f8-c58341ad3eea_3g4oas6kdevstack@QuobyteHD Jul 07 08:29:24 devstack sudo[101482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:29:24 devstack sudo[101482]: pam_unix(sudo:session): session closed for user root Jul 07 08:29:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4695355-1ce5-4b7f-85f8-c58341ad3eea_3g4oas6kdevstack@QuobyteHD" returned: 0 in 0.880s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:29:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:29:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:29:24 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:29:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2019054667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f17ccc6-cbf4-4cf5-a89b-db9a54b0d8dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6449d8ca1c504e738d80e4140e489846',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:29:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:29:18Z,use_quota=True,user_id='6adb980f571f4b6a8c3986eddb61051b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6fd24d7-b9a2-4015-a40f-996affc4714b),volume_type_id=c6fd24d7-b9a2-4015-a40f-996affc4714b)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:29:24 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] Creating volume 3f17ccc6-cbf4-4cf5-a89b-db9a54b0d8dc {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:29:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:29:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:29:24 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:29:24 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:29:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:29:24 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:29:24 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:29:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3f17ccc6-cbf4-4cf5-a89b-db9a54b0d8dc 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:29:24 devstack sudo[101488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3f17ccc6-cbf4-4cf5-a89b-db9a54b0d8dc 1073741824 Jul 07 08:29:24 devstack sudo[101488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:29:25 devstack sudo[101488]: pam_unix(sudo:session): session closed for user root Jul 07 08:29:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3f17ccc6-cbf4-4cf5-a89b-db9a54b0d8dc 1073741824" returned: 0 in 1.038s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:29:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3f17ccc6-cbf4-4cf5-a89b-db9a54b0d8dc {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:29:25 devstack sudo[101494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3f17ccc6-cbf4-4cf5-a89b-db9a54b0d8dc Jul 07 08:29:25 devstack sudo[101494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:29:26 devstack sudo[101494]: pam_unix(sudo:session): session closed for user root Jul 07 08:29:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3f17ccc6-cbf4-4cf5-a89b-db9a54b0d8dc" returned: 0 in 0.805s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:29:26 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] <== create_volume: return (1903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:29:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.908s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:29:26 devstack cinder-volume[87199]: DEBUG cinder.volume.volume_utils [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] Attempting download of f4695355-1ce5-4b7f-85f8-c58341ad3eea ((None, [{'url': 'file:///opt/stack/data/glance/images/f4695355-1ce5-4b7f-85f8-c58341ad3eea', 'metadata': {}}])) to volume 3f17ccc6-cbf4-4cf5-a89b-db9a54b0d8dc. {{(pid=87199) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 08:29:26 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[08518070-3bbf-4aa9-a8ca-07dada39e4eb]: (4, 'raw') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:29:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f4695355-1ce5-4b7f-85f8-c58341ad3eea_r6c3d3_p {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:29:26 devstack sudo[101497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f4695355-1ce5-4b7f-85f8-c58341ad3eea_r6c3d3_p Jul 07 08:29:26 devstack sudo[101497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:29:27 devstack sudo[101497]: pam_unix(sudo:session): session closed for user root Jul 07 08:29:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f4695355-1ce5-4b7f-85f8-c58341ad3eea_r6c3d3_p" returned: 0 in 0.829s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:29:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f4695355-1ce5-4b7f-85f8-c58341ad3eea_r6c3d3_p {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:29:27 devstack sudo[101501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f4695355-1ce5-4b7f-85f8-c58341ad3eea_r6c3d3_p Jul 07 08:29:27 devstack sudo[101501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:29:28 devstack sudo[101501]: pam_unix(sudo:session): session closed for user root Jul 07 08:29:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f4695355-1ce5-4b7f-85f8-c58341ad3eea_r6c3d3_p" returned: 1 in 0.948s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:29:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f4695355-1ce5-4b7f-85f8-c58341ad3eea_r6c3d3_p' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:29:28 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[6075ff9f-f215-4f58-a173-51a987d654fd]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:29:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4695355-1ce5-4b7f-85f8-c58341ad3eea_3g4oas6kdevstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:29:28 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-838b6d27-69a2-4f72-b876-2cb66d123b4c tempest-TestServerVolumeAttachmentScenario-1521268967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:29:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-838b6d27-69a2-4f72-b876-2cb66d123b4c tempest-TestServerVolumeAttachmentScenario-1521268967 None] Flow 'volume_create_manager' (2ca73dfa-e061-48eb-8458-7198b28a5be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:29:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-838b6d27-69a2-4f72-b876-2cb66d123b4c tempest-TestServerVolumeAttachmentScenario-1521268967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1172e09-a6da-42ca-adc4-7117f4326b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:29:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-838b6d27-69a2-4f72-b876-2cb66d123b4c tempest-TestServerVolumeAttachmentScenario-1521268967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1172e09-a6da-42ca-adc4-7117f4326b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:29:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1750106277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5629c26-d04e-41ff-80eb-8451dfd6d6b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49d9b2ed462546f2a9e2e529c13c845d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:29:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:29:29Z,use_quota=True,user_id='5e0c6dd320334c0ba79bb634cc952b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:29:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-838b6d27-69a2-4f72-b876-2cb66d123b4c tempest-TestServerVolumeAttachmentScenario-1521268967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c2a6f27-201d-4414-8987-ad9ff0d523fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:29:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-838b6d27-69a2-4f72-b876-2cb66d123b4c tempest-TestServerVolumeAttachmentScenario-1521268967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c2a6f27-201d-4414-8987-ad9ff0d523fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:29:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-838b6d27-69a2-4f72-b876-2cb66d123b4c tempest-TestServerVolumeAttachmentScenario-1521268967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90c49bd7-c7e8-46c9-b830-ea05b67984ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:29:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-838b6d27-69a2-4f72-b876-2cb66d123b4c tempest-TestServerVolumeAttachmentScenario-1521268967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90c49bd7-c7e8-46c9-b830-ea05b67984ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5629c26-d04e-41ff-80eb-8451dfd6d6b3', 'volume_name': 'volume-a5629c26-d04e-41ff-80eb-8451dfd6d6b3', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:29:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-838b6d27-69a2-4f72-b876-2cb66d123b4c tempest-TestServerVolumeAttachmentScenario-1521268967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25499b90-25c9-43d3-96cf-952e46a54355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:29:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-838b6d27-69a2-4f72-b876-2cb66d123b4c tempest-TestServerVolumeAttachmentScenario-1521268967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25499b90-25c9-43d3-96cf-952e46a54355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:29:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-838b6d27-69a2-4f72-b876-2cb66d123b4c tempest-TestServerVolumeAttachmentScenario-1521268967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60280edf-dcc3-4cb9-a6d7-2e3163f9c2d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:29:28 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-838b6d27-69a2-4f72-b876-2cb66d123b4c tempest-TestServerVolumeAttachmentScenario-1521268967 None] Volume a5629c26-d04e-41ff-80eb-8451dfd6d6b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5629c26-d04e-41ff-80eb-8451dfd6d6b3', 'volume_size': 1} Jul 07 08:29:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-838b6d27-69a2-4f72-b876-2cb66d123b4c tempest-TestServerVolumeAttachmentScenario-1521268967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:29:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-838b6d27-69a2-4f72-b876-2cb66d123b4c tempest-TestServerVolumeAttachmentScenario-1521268967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:29:28 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-838b6d27-69a2-4f72-b876-2cb66d123b4c tempest-TestServerVolumeAttachmentScenario-1521268967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:29:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1750106277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5629c26-d04e-41ff-80eb-8451dfd6d6b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49d9b2ed462546f2a9e2e529c13c845d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:29:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:29:29Z,use_quota=True,user_id='5e0c6dd320334c0ba79bb634cc952b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:29:28 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-838b6d27-69a2-4f72-b876-2cb66d123b4c tempest-TestServerVolumeAttachmentScenario-1521268967 None] Creating volume a5629c26-d04e-41ff-80eb-8451dfd6d6b3 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:29:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-838b6d27-69a2-4f72-b876-2cb66d123b4c tempest-TestServerVolumeAttachmentScenario-1521268967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:29:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-838b6d27-69a2-4f72-b876-2cb66d123b4c tempest-TestServerVolumeAttachmentScenario-1521268967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:29:28 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-838b6d27-69a2-4f72-b876-2cb66d123b4c tempest-TestServerVolumeAttachmentScenario-1521268967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:29:28 devstack sudo[101506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4695355-1ce5-4b7f-85f8-c58341ad3eea_3g4oas6kdevstack@QuobyteHD Jul 07 08:29:28 devstack sudo[101506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:29:28 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-838b6d27-69a2-4f72-b876-2cb66d123b4c tempest-TestServerVolumeAttachmentScenario-1521268967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:29:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-838b6d27-69a2-4f72-b876-2cb66d123b4c tempest-TestServerVolumeAttachmentScenario-1521268967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:29:28 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-838b6d27-69a2-4f72-b876-2cb66d123b4c tempest-TestServerVolumeAttachmentScenario-1521268967 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:29:28 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-838b6d27-69a2-4f72-b876-2cb66d123b4c tempest-TestServerVolumeAttachmentScenario-1521268967 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:29:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-838b6d27-69a2-4f72-b876-2cb66d123b4c tempest-TestServerVolumeAttachmentScenario-1521268967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-a5629c26-d04e-41ff-80eb-8451dfd6d6b3 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:29:28 devstack sudo[101508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-a5629c26-d04e-41ff-80eb-8451dfd6d6b3 1073741824 Jul 07 08:29:28 devstack sudo[101508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:29:29 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-28dede46-21a7-42c1-ab15-07f06cf6007a tempest-TestServerVolumeAttachmentScenario-1521268967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:29:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-28dede46-21a7-42c1-ab15-07f06cf6007a tempest-TestServerVolumeAttachmentScenario-1521268967 None] Flow 'volume_create_manager' (ca595b2d-21ff-4215-825b-3d6918a02b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:29:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-28dede46-21a7-42c1-ab15-07f06cf6007a tempest-TestServerVolumeAttachmentScenario-1521268967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f5df48b-5d42-4fea-833f-351773d2dc6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:29:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-28dede46-21a7-42c1-ab15-07f06cf6007a tempest-TestServerVolumeAttachmentScenario-1521268967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f5df48b-5d42-4fea-833f-351773d2dc6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:29:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1320073771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df892a44-fa93-4e50-b750-a971d4a0c256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49d9b2ed462546f2a9e2e529c13c845d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:29:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:29:29Z,use_quota=True,user_id='5e0c6dd320334c0ba79bb634cc952b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:29:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-28dede46-21a7-42c1-ab15-07f06cf6007a tempest-TestServerVolumeAttachmentScenario-1521268967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7f3c9f8-835d-4f16-a701-4e0881c0bacf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:29:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-28dede46-21a7-42c1-ab15-07f06cf6007a tempest-TestServerVolumeAttachmentScenario-1521268967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7f3c9f8-835d-4f16-a701-4e0881c0bacf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:29:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-28dede46-21a7-42c1-ab15-07f06cf6007a tempest-TestServerVolumeAttachmentScenario-1521268967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e906483-659c-4833-ae62-a42dab461864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:29:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-28dede46-21a7-42c1-ab15-07f06cf6007a tempest-TestServerVolumeAttachmentScenario-1521268967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e906483-659c-4833-ae62-a42dab461864) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df892a44-fa93-4e50-b750-a971d4a0c256', 'volume_name': 'volume-df892a44-fa93-4e50-b750-a971d4a0c256', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:29:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-28dede46-21a7-42c1-ab15-07f06cf6007a tempest-TestServerVolumeAttachmentScenario-1521268967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (918f8007-31bb-4ea6-8fd6-5887e91ad7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:29:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-28dede46-21a7-42c1-ab15-07f06cf6007a tempest-TestServerVolumeAttachmentScenario-1521268967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (918f8007-31bb-4ea6-8fd6-5887e91ad7d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:29:29 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-28dede46-21a7-42c1-ab15-07f06cf6007a tempest-TestServerVolumeAttachmentScenario-1521268967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb43ffd5-d7e4-4f67-b561-ca2b3ae11381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:29:29 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-28dede46-21a7-42c1-ab15-07f06cf6007a tempest-TestServerVolumeAttachmentScenario-1521268967 None] Volume df892a44-fa93-4e50-b750-a971d4a0c256: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df892a44-fa93-4e50-b750-a971d4a0c256', 'volume_size': 1} Jul 07 08:29:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-28dede46-21a7-42c1-ab15-07f06cf6007a tempest-TestServerVolumeAttachmentScenario-1521268967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:29:29 devstack sudo[101506]: pam_unix(sudo:session): session closed for user root Jul 07 08:29:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4695355-1ce5-4b7f-85f8-c58341ad3eea_3g4oas6kdevstack@QuobyteHD" returned: 0 in 1.009s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:29:29 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] f4695355-1ce5-4b7f-85f8-c58341ad3eea was qcow2, converting to raw {{(pid=87199) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 08:29:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f4695355-1ce5-4b7f-85f8-c58341ad3eea_3g4oas6kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3f17ccc6-cbf4-4cf5-a89b-db9a54b0d8dc {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:29:29 devstack sudo[101514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f4695355-1ce5-4b7f-85f8-c58341ad3eea_3g4oas6kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3f17ccc6-cbf4-4cf5-a89b-db9a54b0d8dc Jul 07 08:29:29 devstack sudo[101514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:29:30 devstack sudo[101508]: pam_unix(sudo:session): session closed for user root Jul 07 08:29:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-838b6d27-69a2-4f72-b876-2cb66d123b4c tempest-TestServerVolumeAttachmentScenario-1521268967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-a5629c26-d04e-41ff-80eb-8451dfd6d6b3 1073741824" returned: 0 in 1.383s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:29:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-838b6d27-69a2-4f72-b876-2cb66d123b4c tempest-TestServerVolumeAttachmentScenario-1521268967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-a5629c26-d04e-41ff-80eb-8451dfd6d6b3 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:29:30 devstack sudo[101520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-a5629c26-d04e-41ff-80eb-8451dfd6d6b3 Jul 07 08:29:30 devstack sudo[101520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:29:31 devstack sudo[101520]: pam_unix(sudo:session): session closed for user root Jul 07 08:29:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-838b6d27-69a2-4f72-b876-2cb66d123b4c tempest-TestServerVolumeAttachmentScenario-1521268967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-a5629c26-d04e-41ff-80eb-8451dfd6d6b3" returned: 0 in 0.891s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:29:31 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-838b6d27-69a2-4f72-b876-2cb66d123b4c tempest-TestServerVolumeAttachmentScenario-1521268967 None] <== create_volume: return (2349ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:29:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-838b6d27-69a2-4f72-b876-2cb66d123b4c tempest-TestServerVolumeAttachmentScenario-1521268967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.353s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:29:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-28dede46-21a7-42c1-ab15-07f06cf6007a tempest-TestServerVolumeAttachmentScenario-1521268967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.681s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:29:31 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-28dede46-21a7-42c1-ab15-07f06cf6007a tempest-TestServerVolumeAttachmentScenario-1521268967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:29:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1320073771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df892a44-fa93-4e50-b750-a971d4a0c256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49d9b2ed462546f2a9e2e529c13c845d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:29:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:29:29Z,use_quota=True,user_id='5e0c6dd320334c0ba79bb634cc952b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:29:31 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-28dede46-21a7-42c1-ab15-07f06cf6007a tempest-TestServerVolumeAttachmentScenario-1521268967 None] Creating volume df892a44-fa93-4e50-b750-a971d4a0c256 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:29:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-28dede46-21a7-42c1-ab15-07f06cf6007a tempest-TestServerVolumeAttachmentScenario-1521268967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:29:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-28dede46-21a7-42c1-ab15-07f06cf6007a tempest-TestServerVolumeAttachmentScenario-1521268967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:29:31 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-28dede46-21a7-42c1-ab15-07f06cf6007a tempest-TestServerVolumeAttachmentScenario-1521268967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:29:31 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-28dede46-21a7-42c1-ab15-07f06cf6007a tempest-TestServerVolumeAttachmentScenario-1521268967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:29:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-28dede46-21a7-42c1-ab15-07f06cf6007a tempest-TestServerVolumeAttachmentScenario-1521268967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:29:31 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-28dede46-21a7-42c1-ab15-07f06cf6007a tempest-TestServerVolumeAttachmentScenario-1521268967 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:29:31 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-28dede46-21a7-42c1-ab15-07f06cf6007a tempest-TestServerVolumeAttachmentScenario-1521268967 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:29:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-28dede46-21a7-42c1-ab15-07f06cf6007a tempest-TestServerVolumeAttachmentScenario-1521268967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-df892a44-fa93-4e50-b750-a971d4a0c256 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:29:31 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-838b6d27-69a2-4f72-b876-2cb66d123b4c tempest-TestServerVolumeAttachmentScenario-1521268967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60280edf-dcc3-4cb9-a6d7-2e3163f9c2d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5629c26-d04e-41ff-80eb-8451dfd6d6b3', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:29:31 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-838b6d27-69a2-4f72-b876-2cb66d123b4c tempest-TestServerVolumeAttachmentScenario-1521268967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5aa4997-b1f8-4bc6-b8ae-7f4c9bf9f61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:29:31 devstack sudo[101529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-df892a44-fa93-4e50-b750-a971d4a0c256 1073741824 Jul 07 08:29:31 devstack sudo[101529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:29:31 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-838b6d27-69a2-4f72-b876-2cb66d123b4c tempest-TestServerVolumeAttachmentScenario-1521268967 None] Volume volume-a5629c26-d04e-41ff-80eb-8451dfd6d6b3 (a5629c26-d04e-41ff-80eb-8451dfd6d6b3): created successfully Jul 07 08:29:31 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-838b6d27-69a2-4f72-b876-2cb66d123b4c tempest-TestServerVolumeAttachmentScenario-1521268967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5aa4997-b1f8-4bc6-b8ae-7f4c9bf9f61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:29:31 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-838b6d27-69a2-4f72-b876-2cb66d123b4c tempest-TestServerVolumeAttachmentScenario-1521268967 None] Flow 'volume_create_manager' (2ca73dfa-e061-48eb-8458-7198b28a5be1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:29:31 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-838b6d27-69a2-4f72-b876-2cb66d123b4c tempest-TestServerVolumeAttachmentScenario-1521268967 None] Created volume successfully. Jul 07 08:29:32 devstack sudo[101514]: pam_unix(sudo:session): session closed for user root Jul 07 08:29:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f4695355-1ce5-4b7f-85f8-c58341ad3eea_3g4oas6kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3f17ccc6-cbf4-4cf5-a89b-db9a54b0d8dc" returned: 0 in 2.519s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:29:32 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f4695355-1ce5-4b7f-85f8-c58341ad3eea_3g4oas6kdevstack@QuobyteHD, size 112.00 MB, duration 2.52 sec, destination /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3f17ccc6-cbf4-4cf5-a89b-db9a54b0d8dc {{(pid=87199) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 08:29:32 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] Converted 112.00 MB image at 44.44 MB/s Jul 07 08:29:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3f17ccc6-cbf4-4cf5-a89b-db9a54b0d8dc 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:29:32 devstack sudo[101538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3f17ccc6-cbf4-4cf5-a89b-db9a54b0d8dc 1G Jul 07 08:29:32 devstack sudo[101538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:29:32 devstack sudo[101529]: pam_unix(sudo:session): session closed for user root Jul 07 08:29:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-28dede46-21a7-42c1-ab15-07f06cf6007a tempest-TestServerVolumeAttachmentScenario-1521268967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-df892a44-fa93-4e50-b750-a971d4a0c256 1073741824" returned: 0 in 1.225s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:29:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-28dede46-21a7-42c1-ab15-07f06cf6007a tempest-TestServerVolumeAttachmentScenario-1521268967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-df892a44-fa93-4e50-b750-a971d4a0c256 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:29:32 devstack sudo[101540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-df892a44-fa93-4e50-b750-a971d4a0c256 Jul 07 08:29:32 devstack sudo[101540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:29:33 devstack sudo[101538]: pam_unix(sudo:session): session closed for user root Jul 07 08:29:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3f17ccc6-cbf4-4cf5-a89b-db9a54b0d8dc 1G" returned: 0 in 1.186s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:29:33 devstack sudo[101540]: pam_unix(sudo:session): session closed for user root Jul 07 08:29:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-28dede46-21a7-42c1-ab15-07f06cf6007a tempest-TestServerVolumeAttachmentScenario-1521268967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-df892a44-fa93-4e50-b750-a971d4a0c256" returned: 0 in 0.921s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:29:33 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-28dede46-21a7-42c1-ab15-07f06cf6007a tempest-TestServerVolumeAttachmentScenario-1521268967 None] <== create_volume: return (2209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:29:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-28dede46-21a7-42c1-ab15-07f06cf6007a tempest-TestServerVolumeAttachmentScenario-1521268967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.213s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:29:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-28dede46-21a7-42c1-ab15-07f06cf6007a tempest-TestServerVolumeAttachmentScenario-1521268967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb43ffd5-d7e4-4f67-b561-ca2b3ae11381) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df892a44-fa93-4e50-b750-a971d4a0c256', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:29:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-28dede46-21a7-42c1-ab15-07f06cf6007a tempest-TestServerVolumeAttachmentScenario-1521268967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (486ce986-2735-40bd-b294-d314ebb28c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:29:33 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[86487d1d-ec49-488d-b118-1dd2c76c60a6]: (4, 'raw') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:29:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3f17ccc6-cbf4-4cf5-a89b-db9a54b0d8dc {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:29:33 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-28dede46-21a7-42c1-ab15-07f06cf6007a tempest-TestServerVolumeAttachmentScenario-1521268967 None] Volume volume-df892a44-fa93-4e50-b750-a971d4a0c256 (df892a44-fa93-4e50-b750-a971d4a0c256): created successfully Jul 07 08:29:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-28dede46-21a7-42c1-ab15-07f06cf6007a tempest-TestServerVolumeAttachmentScenario-1521268967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (486ce986-2735-40bd-b294-d314ebb28c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:29:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-28dede46-21a7-42c1-ab15-07f06cf6007a tempest-TestServerVolumeAttachmentScenario-1521268967 None] Flow 'volume_create_manager' (ca595b2d-21ff-4215-825b-3d6918a02b33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:29:33 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-28dede46-21a7-42c1-ab15-07f06cf6007a tempest-TestServerVolumeAttachmentScenario-1521268967 None] Created volume successfully. Jul 07 08:29:33 devstack sudo[101549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3f17ccc6-cbf4-4cf5-a89b-db9a54b0d8dc Jul 07 08:29:33 devstack sudo[101549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:29:34 devstack sudo[101549]: pam_unix(sudo:session): session closed for user root Jul 07 08:29:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3f17ccc6-cbf4-4cf5-a89b-db9a54b0d8dc" returned: 0 in 0.962s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:29:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3f17ccc6-cbf4-4cf5-a89b-db9a54b0d8dc {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:29:34 devstack sudo[101589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3f17ccc6-cbf4-4cf5-a89b-db9a54b0d8dc Jul 07 08:29:34 devstack sudo[101589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:29:35 devstack sudo[101589]: pam_unix(sudo:session): session closed for user root Jul 07 08:29:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3f17ccc6-cbf4-4cf5-a89b-db9a54b0d8dc" returned: 1 in 0.813s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:29:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3f17ccc6-cbf4-4cf5-a89b-db9a54b0d8dc' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:29:35 devstack cinder-volume[87199]: DEBUG cinder.volume.volume_utils [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] Downloaded image f4695355-1ce5-4b7f-85f8-c58341ad3eea ((None, [{'url': 'file:///opt/stack/data/glance/images/f4695355-1ce5-4b7f-85f8-c58341ad3eea', 'metadata': {}}])) to volume 3f17ccc6-cbf4-4cf5-a89b-db9a54b0d8dc successfully. {{(pid=87199) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 08:29:35 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] Temporary image f4695355-1ce5-4b7f-85f8-c58341ad3eea for user 6adb980f571f4b6a8c3986eddb61051b is deleted. {{(pid=87199) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 08:29:35 devstack cinder-volume[87199]: DEBUG cinder.volume.volume_utils [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] Marking volume 3f17ccc6-cbf4-4cf5-a89b-db9a54b0d8dc as bootable. {{(pid=87199) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 08:29:35 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] Copying metadata from image f4695355-1ce5-4b7f-85f8-c58341ad3eea to 3f17ccc6-cbf4-4cf5-a89b-db9a54b0d8dc. {{(pid=87199) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 08:29:35 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] Creating volume glance metadata for volume 3f17ccc6-cbf4-4cf5-a89b-db9a54b0d8dc backed by image f4695355-1ce5-4b7f-85f8-c58341ad3eea with: {'image_id': 'f4695355-1ce5-4b7f-85f8-c58341ad3eea', 'image_name': 'tempest-scenario-img--1134445155', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87199) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 08:29:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (182832f7-454c-45b1-adc2-f626321fc620) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f17ccc6-cbf4-4cf5-a89b-db9a54b0d8dc', 'volume_size': 1, 'image_id': 'f4695355-1ce5-4b7f-85f8-c58341ad3eea', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f4695355-1ce5-4b7f-85f8-c58341ad3eea', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1134445155', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6449d8ca1c504e738d80e4140e489846', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f4695355-1ce5-4b7f-85f8-c58341ad3eea', 'created_at': datetime.datetime(2026, 7, 7, 6, 29, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 6, 29, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f4695355-1ce5-4b7f-85f8-c58341ad3eea/file', 'properties': {}}, 'image_service': }' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:29:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (937f09cd-79d3-4b17-871e-bbc52903f776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:29:35 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] Volume volume-3f17ccc6-cbf4-4cf5-a89b-db9a54b0d8dc (3f17ccc6-cbf4-4cf5-a89b-db9a54b0d8dc): created successfully Jul 07 08:29:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (937f09cd-79d3-4b17-871e-bbc52903f776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:29:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] Flow 'volume_create_manager' (bcec6ced-a26e-4de1-8761-9de868703573) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:29:35 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-334a6ead-7ece-4679-809b-f9daf86d9f37 tempest-TestInstancesWithCinderVolumes-1289129289 None] Created volume successfully. Jul 07 08:29:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-12eed897-5b28-4bf3-b6c3-f677b842b505 req-41fe219c-8047-479d-a522-5718b9e4128f tempest-TestInstancesWithCinderVolumes-1289129289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:29:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-12eed897-5b28-4bf3-b6c3-f677b842b505 req-41fe219c-8047-479d-a522-5718b9e4128f tempest-TestInstancesWithCinderVolumes-1289129289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:29:43 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1b8e78-da75-4b1b-8215-e0b06ec3273a]: (4, 'raw') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:29:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-12eed897-5b28-4bf3-b6c3-f677b842b505 req-41fe219c-8047-479d-a522-5718b9e4128f tempest-TestInstancesWithCinderVolumes-1289129289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3f17ccc6-cbf4-4cf5-a89b-db9a54b0d8dc {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:29:44 devstack sudo[101626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3f17ccc6-cbf4-4cf5-a89b-db9a54b0d8dc Jul 07 08:29:44 devstack sudo[101626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:29:44 devstack sudo[101626]: pam_unix(sudo:session): session closed for user root Jul 07 08:29:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-12eed897-5b28-4bf3-b6c3-f677b842b505 req-41fe219c-8047-479d-a522-5718b9e4128f tempest-TestInstancesWithCinderVolumes-1289129289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3f17ccc6-cbf4-4cf5-a89b-db9a54b0d8dc" returned: 0 in 0.917s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:29:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-12eed897-5b28-4bf3-b6c3-f677b842b505 req-41fe219c-8047-479d-a522-5718b9e4128f tempest-TestInstancesWithCinderVolumes-1289129289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3f17ccc6-cbf4-4cf5-a89b-db9a54b0d8dc {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:29:44 devstack sudo[101631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3f17ccc6-cbf4-4cf5-a89b-db9a54b0d8dc Jul 07 08:29:44 devstack sudo[101631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:29:45 devstack sudo[101631]: pam_unix(sudo:session): session closed for user root Jul 07 08:29:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-12eed897-5b28-4bf3-b6c3-f677b842b505 req-41fe219c-8047-479d-a522-5718b9e4128f tempest-TestInstancesWithCinderVolumes-1289129289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3f17ccc6-cbf4-4cf5-a89b-db9a54b0d8dc" returned: 1 in 0.951s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:29:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-12eed897-5b28-4bf3-b6c3-f677b842b505 req-41fe219c-8047-479d-a522-5718b9e4128f tempest-TestInstancesWithCinderVolumes-1289129289 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3f17ccc6-cbf4-4cf5-a89b-db9a54b0d8dc' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:29:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-12eed897-5b28-4bf3-b6c3-f677b842b505 req-41fe219c-8047-479d-a522-5718b9e4128f tempest-TestInstancesWithCinderVolumes-1289129289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.921s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:29:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-12eed897-5b28-4bf3-b6c3-f677b842b505 req-41fe219c-8047-479d-a522-5718b9e4128f tempest-TestInstancesWithCinderVolumes-1289129289 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b', 'name': 'volume-3f17ccc6-cbf4-4cf5-a89b-db9a54b0d8dc', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '00f1881f-36a8-4283-b835-9fae55cca2b2', 'enforce_multipath': True} {{(pid=87199) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 08:29:46 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-12eed897-5b28-4bf3-b6c3-f677b842b505 req-41fe219c-8047-479d-a522-5718b9e4128f tempest-TestInstancesWithCinderVolumes-1289129289 None] attachment_update completed successfully. Jul 07 08:29:48 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b849ec2-7ab7-4a5f-870b-7e3413aa701d tempest-SnapshotDependencyTests-1232203494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:29:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1b849ec2-7ab7-4a5f-870b-7e3413aa701d tempest-SnapshotDependencyTests-1232203494 None] Flow 'volume_create_manager' (a7299cbc-cd29-486f-8ff6-10ba2cdba014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:29:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1b849ec2-7ab7-4a5f-870b-7e3413aa701d tempest-SnapshotDependencyTests-1232203494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (288b940a-e29e-4245-943c-29061c566460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:29:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1b849ec2-7ab7-4a5f-870b-7e3413aa701d tempest-SnapshotDependencyTests-1232203494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (288b940a-e29e-4245-943c-29061c566460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-987736856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa2e3f55-39b6-42e2-b8cd-45ac92425dec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fb726a528ae4c04bfe18da2fc141dcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:29:49Z,use_quota=True,user_id='4f8fb82c1b62431a948b4e64b3a29d43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:29:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1b849ec2-7ab7-4a5f-870b-7e3413aa701d tempest-SnapshotDependencyTests-1232203494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dd29024-50f5-4a1a-94c6-56d1c6e7d09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:29:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1b849ec2-7ab7-4a5f-870b-7e3413aa701d tempest-SnapshotDependencyTests-1232203494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dd29024-50f5-4a1a-94c6-56d1c6e7d09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:29:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1b849ec2-7ab7-4a5f-870b-7e3413aa701d tempest-SnapshotDependencyTests-1232203494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a81f41f1-b91e-41e4-b894-1d26a8c60e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:29:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1b849ec2-7ab7-4a5f-870b-7e3413aa701d tempest-SnapshotDependencyTests-1232203494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a81f41f1-b91e-41e4-b894-1d26a8c60e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa2e3f55-39b6-42e2-b8cd-45ac92425dec', 'volume_name': 'volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:29:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1b849ec2-7ab7-4a5f-870b-7e3413aa701d tempest-SnapshotDependencyTests-1232203494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bc98b2a-7580-4e72-9b11-79efe09671ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:29:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1b849ec2-7ab7-4a5f-870b-7e3413aa701d tempest-SnapshotDependencyTests-1232203494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bc98b2a-7580-4e72-9b11-79efe09671ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:29:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1b849ec2-7ab7-4a5f-870b-7e3413aa701d tempest-SnapshotDependencyTests-1232203494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a930ed7c-3dd1-4a0c-8b82-8600b8078b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:29:48 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-1b849ec2-7ab7-4a5f-870b-7e3413aa701d tempest-SnapshotDependencyTests-1232203494 None] Volume fa2e3f55-39b6-42e2-b8cd-45ac92425dec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec', 'volume_size': 1} Jul 07 08:29:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1b849ec2-7ab7-4a5f-870b-7e3413aa701d tempest-SnapshotDependencyTests-1232203494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:29:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1b849ec2-7ab7-4a5f-870b-7e3413aa701d tempest-SnapshotDependencyTests-1232203494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:29:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1b849ec2-7ab7-4a5f-870b-7e3413aa701d tempest-SnapshotDependencyTests-1232203494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-987736856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa2e3f55-39b6-42e2-b8cd-45ac92425dec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fb726a528ae4c04bfe18da2fc141dcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:29:49Z,use_quota=True,user_id='4f8fb82c1b62431a948b4e64b3a29d43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:29:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-1b849ec2-7ab7-4a5f-870b-7e3413aa701d tempest-SnapshotDependencyTests-1232203494 None] Creating volume fa2e3f55-39b6-42e2-b8cd-45ac92425dec {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:29:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1b849ec2-7ab7-4a5f-870b-7e3413aa701d tempest-SnapshotDependencyTests-1232203494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:29:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1b849ec2-7ab7-4a5f-870b-7e3413aa701d tempest-SnapshotDependencyTests-1232203494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:29:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1b849ec2-7ab7-4a5f-870b-7e3413aa701d tempest-SnapshotDependencyTests-1232203494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:29:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1b849ec2-7ab7-4a5f-870b-7e3413aa701d tempest-SnapshotDependencyTests-1232203494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:29:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1b849ec2-7ab7-4a5f-870b-7e3413aa701d tempest-SnapshotDependencyTests-1232203494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:29:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1b849ec2-7ab7-4a5f-870b-7e3413aa701d tempest-SnapshotDependencyTests-1232203494 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:29:48 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-1b849ec2-7ab7-4a5f-870b-7e3413aa701d tempest-SnapshotDependencyTests-1232203494 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:29:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1b849ec2-7ab7-4a5f-870b-7e3413aa701d tempest-SnapshotDependencyTests-1232203494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:29:49 devstack sudo[101645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec 1073741824 Jul 07 08:29:49 devstack sudo[101645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:29:50 devstack sudo[101645]: pam_unix(sudo:session): session closed for user root Jul 07 08:29:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1b849ec2-7ab7-4a5f-870b-7e3413aa701d tempest-SnapshotDependencyTests-1232203494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec 1073741824" returned: 0 in 1.047s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:29:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1b849ec2-7ab7-4a5f-870b-7e3413aa701d tempest-SnapshotDependencyTests-1232203494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:29:50 devstack sudo[101759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec Jul 07 08:29:50 devstack sudo[101759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:29:51 devstack sudo[101759]: pam_unix(sudo:session): session closed for user root Jul 07 08:29:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1b849ec2-7ab7-4a5f-870b-7e3413aa701d tempest-SnapshotDependencyTests-1232203494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec" returned: 0 in 1.072s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:29:51 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1b849ec2-7ab7-4a5f-870b-7e3413aa701d tempest-SnapshotDependencyTests-1232203494 None] <== create_volume: return (2170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:29:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1b849ec2-7ab7-4a5f-870b-7e3413aa701d tempest-SnapshotDependencyTests-1232203494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.173s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:29:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1b849ec2-7ab7-4a5f-870b-7e3413aa701d tempest-SnapshotDependencyTests-1232203494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a930ed7c-3dd1-4a0c-8b82-8600b8078b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:29:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1b849ec2-7ab7-4a5f-870b-7e3413aa701d tempest-SnapshotDependencyTests-1232203494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d1a7b60-d748-4440-9451-b6361116977f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:29:51 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-1b849ec2-7ab7-4a5f-870b-7e3413aa701d tempest-SnapshotDependencyTests-1232203494 None] Volume volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec (fa2e3f55-39b6-42e2-b8cd-45ac92425dec): created successfully Jul 07 08:29:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1b849ec2-7ab7-4a5f-870b-7e3413aa701d tempest-SnapshotDependencyTests-1232203494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d1a7b60-d748-4440-9451-b6361116977f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:29:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1b849ec2-7ab7-4a5f-870b-7e3413aa701d tempest-SnapshotDependencyTests-1232203494 None] Flow 'volume_create_manager' (a7299cbc-cd29-486f-8ff6-10ba2cdba014) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:29:51 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-1b849ec2-7ab7-4a5f-870b-7e3413aa701d tempest-SnapshotDependencyTests-1232203494 None] Created volume successfully. Jul 07 08:29:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e5464093-54a2-44ce-9059-ec2c9d0a2fd8 tempest-SnapshotDependencyTests-1232203494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:29:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e5464093-54a2-44ce-9059-ec2c9d0a2fd8 tempest-SnapshotDependencyTests-1232203494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:29:52 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-e5464093-54a2-44ce-9059-ec2c9d0a2fd8 tempest-SnapshotDependencyTests-1232203494 None] Creating offline snapshot c3812a52-0e63-4264-9b60-a97a5c6e7a5f of volume fa2e3f55-39b6-42e2-b8cd-45ac92425dec {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:29:52 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[7821a0b8-cec1-4389-bd01-d70641168348]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:29:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e5464093-54a2-44ce-9059-ec2c9d0a2fd8 tempest-SnapshotDependencyTests-1232203494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:29:52 devstack sudo[102151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec Jul 07 08:29:52 devstack sudo[102151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:29:53 devstack sudo[102151]: pam_unix(sudo:session): session closed for user root Jul 07 08:29:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e5464093-54a2-44ce-9059-ec2c9d0a2fd8 tempest-SnapshotDependencyTests-1232203494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec" returned: 0 in 0.872s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:29:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e5464093-54a2-44ce-9059-ec2c9d0a2fd8 tempest-SnapshotDependencyTests-1232203494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec.c3812a52-0e63-4264-9b60-a97a5c6e7a5f 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:29:53 devstack sudo[102159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec.c3812a52-0e63-4264-9b60-a97a5c6e7a5f 1G Jul 07 08:29:53 devstack sudo[102159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:29:54 devstack sudo[102159]: pam_unix(sudo:session): session closed for user root Jul 07 08:29:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e5464093-54a2-44ce-9059-ec2c9d0a2fd8 tempest-SnapshotDependencyTests-1232203494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec.c3812a52-0e63-4264-9b60-a97a5c6e7a5f 1G" returned: 0 in 1.378s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:29:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e5464093-54a2-44ce-9059-ec2c9d0a2fd8 tempest-SnapshotDependencyTests-1232203494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec.c3812a52-0e63-4264-9b60-a97a5c6e7a5f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:29:54 devstack sudo[102169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec.c3812a52-0e63-4264-9b60-a97a5c6e7a5f Jul 07 08:29:54 devstack sudo[102169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:29:55 devstack sudo[102169]: pam_unix(sudo:session): session closed for user root Jul 07 08:29:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e5464093-54a2-44ce-9059-ec2c9d0a2fd8 tempest-SnapshotDependencyTests-1232203494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec.c3812a52-0e63-4264-9b60-a97a5c6e7a5f" returned: 0 in 1.067s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:29:55 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-e5464093-54a2-44ce-9059-ec2c9d0a2fd8 tempest-SnapshotDependencyTests-1232203494 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec.c3812a52-0e63-4264-9b60-a97a5c6e7a5f is being set with open permissions: ugo+rw Jul 07 08:29:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e5464093-54a2-44ce-9059-ec2c9d0a2fd8 tempest-SnapshotDependencyTests-1232203494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec.c3812a52-0e63-4264-9b60-a97a5c6e7a5f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:29:55 devstack sudo[102175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec.c3812a52-0e63-4264-9b60-a97a5c6e7a5f Jul 07 08:29:55 devstack sudo[102175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:29:56 devstack sudo[102175]: pam_unix(sudo:session): session closed for user root Jul 07 08:29:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e5464093-54a2-44ce-9059-ec2c9d0a2fd8 tempest-SnapshotDependencyTests-1232203494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec.c3812a52-0e63-4264-9b60-a97a5c6e7a5f" returned: 0 in 1.138s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:29:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e5464093-54a2-44ce-9059-ec2c9d0a2fd8 tempest-SnapshotDependencyTests-1232203494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:29:57 devstack sudo[102178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec.info Jul 07 08:29:57 devstack sudo[102178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:29:58 devstack sudo[102178]: pam_unix(sudo:session): session closed for user root Jul 07 08:29:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e5464093-54a2-44ce-9059-ec2c9d0a2fd8 tempest-SnapshotDependencyTests-1232203494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec.info" returned: 0 in 1.359s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:29:58 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-e5464093-54a2-44ce-9059-ec2c9d0a2fd8 tempest-SnapshotDependencyTests-1232203494 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec.info is being set with open permissions: ugo+rw Jul 07 08:29:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e5464093-54a2-44ce-9059-ec2c9d0a2fd8 tempest-SnapshotDependencyTests-1232203494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:29:58 devstack sudo[102182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec.info Jul 07 08:29:58 devstack sudo[102182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:29:59 devstack sudo[102182]: pam_unix(sudo:session): session closed for user root Jul 07 08:29:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e5464093-54a2-44ce-9059-ec2c9d0a2fd8 tempest-SnapshotDependencyTests-1232203494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec.info" returned: 0 in 1.194s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:29:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e5464093-54a2-44ce-9059-ec2c9d0a2fd8 tempest-SnapshotDependencyTests-1232203494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.151s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:29:59 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-e5464093-54a2-44ce-9059-ec2c9d0a2fd8 tempest-SnapshotDependencyTests-1232203494 None] Create snapshot completed successfully Jul 07 08:30:01 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-be05d8c8-9054-46c9-95fc-541207fbc74b tempest-SnapshotDependencyTests-1232203494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:30:01 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-be05d8c8-9054-46c9-95fc-541207fbc74b tempest-SnapshotDependencyTests-1232203494 None] Flow 'volume_create_manager' (b808f630-18ca-47fc-8aaf-6bf07d661c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:30:01 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-be05d8c8-9054-46c9-95fc-541207fbc74b tempest-SnapshotDependencyTests-1232203494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3003c2d3-bacd-4a9c-828d-26ff01f5b2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:30:01 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-be05d8c8-9054-46c9-95fc-541207fbc74b tempest-SnapshotDependencyTests-1232203494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3003c2d3-bacd-4a9c-828d-26ff01f5b2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f1f716b-6792-494b-b9ab-963bd8e4d8df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fb726a528ae4c04bfe18da2fc141dcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:30:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c3812a52-0e63-4264-9b60-a97a5c6e7a5f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:30:01Z,use_quota=True,user_id='4f8fb82c1b62431a948b4e64b3a29d43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:30:01 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-be05d8c8-9054-46c9-95fc-541207fbc74b tempest-SnapshotDependencyTests-1232203494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb4a539b-f902-4ab9-9c5c-2073aeda6737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:30:01 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-be05d8c8-9054-46c9-95fc-541207fbc74b tempest-SnapshotDependencyTests-1232203494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb4a539b-f902-4ab9-9c5c-2073aeda6737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:30:01 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-be05d8c8-9054-46c9-95fc-541207fbc74b tempest-SnapshotDependencyTests-1232203494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (578f4ddc-6dda-4133-9895-e2ab6d08f993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:30:01 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-be05d8c8-9054-46c9-95fc-541207fbc74b tempest-SnapshotDependencyTests-1232203494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (578f4ddc-6dda-4133-9895-e2ab6d08f993) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6f1f716b-6792-494b-b9ab-963bd8e4d8df', 'volume_name': 'volume-6f1f716b-6792-494b-b9ab-963bd8e4d8df', 'volume_size': 1, 'snapshot_id': 'c3812a52-0e63-4264-9b60-a97a5c6e7a5f'}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:30:01 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-be05d8c8-9054-46c9-95fc-541207fbc74b tempest-SnapshotDependencyTests-1232203494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d1b7f4e-ed61-4dfe-af6d-26733fa8996c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:30:01 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-be05d8c8-9054-46c9-95fc-541207fbc74b tempest-SnapshotDependencyTests-1232203494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d1b7f4e-ed61-4dfe-af6d-26733fa8996c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:30:01 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-be05d8c8-9054-46c9-95fc-541207fbc74b tempest-SnapshotDependencyTests-1232203494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a0b80af-1e69-4148-b17d-d3b007ce611f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:30:01 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-be05d8c8-9054-46c9-95fc-541207fbc74b tempest-SnapshotDependencyTests-1232203494 None] Volume 6f1f716b-6792-494b-b9ab-963bd8e4d8df: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6f1f716b-6792-494b-b9ab-963bd8e4d8df', 'volume_size': 1, 'snapshot_id': 'c3812a52-0e63-4264-9b60-a97a5c6e7a5f'} Jul 07 08:30:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-be05d8c8-9054-46c9-95fc-541207fbc74b tempest-SnapshotDependencyTests-1232203494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:30:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-be05d8c8-9054-46c9-95fc-541207fbc74b tempest-SnapshotDependencyTests-1232203494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:30:01 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-be05d8c8-9054-46c9-95fc-541207fbc74b tempest-SnapshotDependencyTests-1232203494 None] Acquiring lock "cinder-quobyte-c3812a52-0e63-4264-9b60-a97a5c6e7a5f-6f1f716b-6792-494b-b9ab-963bd8e4d8df" by "_create_volume_from_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:30:01 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-be05d8c8-9054-46c9-95fc-541207fbc74b tempest-SnapshotDependencyTests-1232203494 None] Lock "cinder-quobyte-c3812a52-0e63-4264-9b60-a97a5c6e7a5f-6f1f716b-6792-494b-b9ab-963bd8e4d8df" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:30:01 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-be05d8c8-9054-46c9-95fc-541207fbc74b tempest-SnapshotDependencyTests-1232203494 None] Creating volume 6f1f716b-6792-494b-b9ab-963bd8e4d8df from snapshot c3812a52-0e63-4264-9b60-a97a5c6e7a5f {{(pid=87199) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 08:30:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-be05d8c8-9054-46c9-95fc-541207fbc74b tempest-SnapshotDependencyTests-1232203494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:30:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-be05d8c8-9054-46c9-95fc-541207fbc74b tempest-SnapshotDependencyTests-1232203494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:30:01 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-be05d8c8-9054-46c9-95fc-541207fbc74b tempest-SnapshotDependencyTests-1232203494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:30:01 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-be05d8c8-9054-46c9-95fc-541207fbc74b tempest-SnapshotDependencyTests-1232203494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:30:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-be05d8c8-9054-46c9-95fc-541207fbc74b tempest-SnapshotDependencyTests-1232203494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:30:01 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-be05d8c8-9054-46c9-95fc-541207fbc74b tempest-SnapshotDependencyTests-1232203494 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:30:01 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-be05d8c8-9054-46c9-95fc-541207fbc74b tempest-SnapshotDependencyTests-1232203494 None] Acquiring lock "cinder-quobyte-6f1f716b-6792-494b-b9ab-963bd8e4d8df" by "_copy_volume_from_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:30:01 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-be05d8c8-9054-46c9-95fc-541207fbc74b tempest-SnapshotDependencyTests-1232203494 None] Lock "cinder-quobyte-6f1f716b-6792-494b-b9ab-963bd8e4d8df" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:30:01 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-be05d8c8-9054-46c9-95fc-541207fbc74b tempest-SnapshotDependencyTests-1232203494 None] snapshot: c3812a52-0e63-4264-9b60-a97a5c6e7a5f, volume: 6f1f716b-6792-494b-b9ab-963bd8e4d8df, {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 08:30:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-be05d8c8-9054-46c9-95fc-541207fbc74b tempest-SnapshotDependencyTests-1232203494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:30:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-be05d8c8-9054-46c9-95fc-541207fbc74b tempest-SnapshotDependencyTests-1232203494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:30:01 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-be05d8c8-9054-46c9-95fc-541207fbc74b tempest-SnapshotDependencyTests-1232203494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:30:01 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-be05d8c8-9054-46c9-95fc-541207fbc74b tempest-SnapshotDependencyTests-1232203494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:30:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-be05d8c8-9054-46c9-95fc-541207fbc74b tempest-SnapshotDependencyTests-1232203494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:30:01 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[8285b473-afef-4c4d-b857-1bf9e5f080c3]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:30:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-be05d8c8-9054-46c9-95fc-541207fbc74b tempest-SnapshotDependencyTests-1232203494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec.c3812a52-0e63-4264-9b60-a97a5c6e7a5f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:01 devstack sudo[102192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec.c3812a52-0e63-4264-9b60-a97a5c6e7a5f Jul 07 08:30:01 devstack sudo[102192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:03 devstack sudo[102192]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-be05d8c8-9054-46c9-95fc-541207fbc74b tempest-SnapshotDependencyTests-1232203494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec.c3812a52-0e63-4264-9b60-a97a5c6e7a5f" returned: 0 in 1.319s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-be05d8c8-9054-46c9-95fc-541207fbc74b tempest-SnapshotDependencyTests-1232203494 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:30:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-be05d8c8-9054-46c9-95fc-541207fbc74b tempest-SnapshotDependencyTests-1232203494 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 08:30:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-be05d8c8-9054-46c9-95fc-541207fbc74b tempest-SnapshotDependencyTests-1232203494 None] Creating direct copy from snapshot {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 08:30:03 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cac37ea-992d-4594-8c9f-ab597f0f7bc8]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:30:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-be05d8c8-9054-46c9-95fc-541207fbc74b tempest-SnapshotDependencyTests-1232203494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:03 devstack sudo[102197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec Jul 07 08:30:03 devstack sudo[102197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:04 devstack sudo[102197]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-be05d8c8-9054-46c9-95fc-541207fbc74b tempest-SnapshotDependencyTests-1232203494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec" returned: 0 in 1.299s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:04 devstack cinder-volume[87199]: DEBUG cinder.utils [None req-be05d8c8-9054-46c9-95fc-541207fbc74b tempest-SnapshotDependencyTests-1232203494 None] Path /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6f1f716b-6792-494b-b9ab-963bd8e4d8df not found in is_blk_device check {{(pid=87199) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 08:30:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-be05d8c8-9054-46c9-95fc-541207fbc74b tempest-SnapshotDependencyTests-1232203494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6f1f716b-6792-494b-b9ab-963bd8e4d8df {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:04 devstack sudo[102202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6f1f716b-6792-494b-b9ab-963bd8e4d8df Jul 07 08:30:04 devstack sudo[102202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:05 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:30:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:30:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:30:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:30:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:30:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:30:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:06 devstack sudo[102214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:30:06 devstack sudo[102214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:08 devstack sudo[102214]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 2.719s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:08 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:30:08 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running periodic task VolumeManager._thread_info {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:30:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] thread count: 29 {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 08:30:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] thread info: [<_MainThread(MainThread, started 133056092332160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 08:30:11 devstack sudo[102202]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-be05d8c8-9054-46c9-95fc-541207fbc74b tempest-SnapshotDependencyTests-1232203494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6f1f716b-6792-494b-b9ab-963bd8e4d8df" returned: 0 in 6.831s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:11 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[2240cb07-d9ff-4726-a73f-82e5a191dcae]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:30:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-be05d8c8-9054-46c9-95fc-541207fbc74b tempest-SnapshotDependencyTests-1232203494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:11 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:UPDATE=19,cinder:DELETE=4,cinder:SELECT=21,cinder:INSERT=6 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:30:11 devstack sudo[102281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec Jul 07 08:30:11 devstack sudo[102281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:11 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:UPDATE=18,cinder:SELECT=27,cinder:INSERT=8,cinder:DELETE=2 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:30:12 devstack sudo[102281]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-be05d8c8-9054-46c9-95fc-541207fbc74b tempest-SnapshotDependencyTests-1232203494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec" returned: 0 in 0.992s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:12 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-be05d8c8-9054-46c9-95fc-541207fbc74b tempest-SnapshotDependencyTests-1232203494 None] Image conversion details: src /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec, size 1024.00 MB, duration 6.83 sec, destination /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6f1f716b-6792-494b-b9ab-963bd8e4d8df {{(pid=87199) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 08:30:12 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-be05d8c8-9054-46c9-95fc-541207fbc74b tempest-SnapshotDependencyTests-1232203494 None] Converted 1024.00 MB image at 149.88 MB/s Jul 07 08:30:12 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-be05d8c8-9054-46c9-95fc-541207fbc74b tempest-SnapshotDependencyTests-1232203494 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6f1f716b-6792-494b-b9ab-963bd8e4d8df is being set with open permissions: ugo+rw Jul 07 08:30:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-be05d8c8-9054-46c9-95fc-541207fbc74b tempest-SnapshotDependencyTests-1232203494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6f1f716b-6792-494b-b9ab-963bd8e4d8df {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:12 devstack sudo[102310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6f1f716b-6792-494b-b9ab-963bd8e4d8df Jul 07 08:30:12 devstack sudo[102310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:12 devstack sudo[102310]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-be05d8c8-9054-46c9-95fc-541207fbc74b tempest-SnapshotDependencyTests-1232203494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6f1f716b-6792-494b-b9ab-963bd8e4d8df" returned: 0 in 0.696s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:12 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-be05d8c8-9054-46c9-95fc-541207fbc74b tempest-SnapshotDependencyTests-1232203494 None] Lock "cinder-quobyte-6f1f716b-6792-494b-b9ab-963bd8e4d8df" released by "_copy_volume_from_snapshot" :: held 11.306s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:30:12 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-be05d8c8-9054-46c9-95fc-541207fbc74b tempest-SnapshotDependencyTests-1232203494 None] Lock "cinder-quobyte-c3812a52-0e63-4264-9b60-a97a5c6e7a5f-6f1f716b-6792-494b-b9ab-963bd8e4d8df" released by "_create_volume_from_snapshot" :: held 11.375s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:30:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-be05d8c8-9054-46c9-95fc-541207fbc74b tempest-SnapshotDependencyTests-1232203494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.410s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:30:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-be05d8c8-9054-46c9-95fc-541207fbc74b tempest-SnapshotDependencyTests-1232203494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a0b80af-1e69-4148-b17d-d3b007ce611f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f1f716b-6792-494b-b9ab-963bd8e4d8df', 'volume_size': 1, 'snapshot_id': 'c3812a52-0e63-4264-9b60-a97a5c6e7a5f'}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:30:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-be05d8c8-9054-46c9-95fc-541207fbc74b tempest-SnapshotDependencyTests-1232203494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ab58a49-b2bd-4384-a300-28c889f24a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:30:13 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-be05d8c8-9054-46c9-95fc-541207fbc74b tempest-SnapshotDependencyTests-1232203494 None] Volume volume-6f1f716b-6792-494b-b9ab-963bd8e4d8df (6f1f716b-6792-494b-b9ab-963bd8e4d8df): created successfully Jul 07 08:30:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-be05d8c8-9054-46c9-95fc-541207fbc74b tempest-SnapshotDependencyTests-1232203494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ab58a49-b2bd-4384-a300-28c889f24a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:30:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-be05d8c8-9054-46c9-95fc-541207fbc74b tempest-SnapshotDependencyTests-1232203494 None] Flow 'volume_create_manager' (b808f630-18ca-47fc-8aaf-6bf07d661c3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:30:13 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-be05d8c8-9054-46c9-95fc-541207fbc74b tempest-SnapshotDependencyTests-1232203494 None] Created volume successfully. Jul 07 08:30:13 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-01805e78-515d-4044-a076-367a1880772a tempest-SnapshotDependencyTests-1232203494 None] Acquiring lock "cinder-c3812a52-0e63-4264-9b60-a97a5c6e7a5f-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:30:13 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-01805e78-515d-4044-a076-367a1880772a tempest-SnapshotDependencyTests-1232203494 None] Lock "cinder-c3812a52-0e63-4264-9b60-a97a5c6e7a5f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:30:13 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-01805e78-515d-4044-a076-367a1880772a tempest-SnapshotDependencyTests-1232203494 None] Acquiring lock "cinder-quobyte-fa2e3f55-39b6-42e2-b8cd-45ac92425dec" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:30:14 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-01805e78-515d-4044-a076-367a1880772a tempest-SnapshotDependencyTests-1232203494 None] Lock "cinder-quobyte-fa2e3f55-39b6-42e2-b8cd-45ac92425dec" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:30:14 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-01805e78-515d-4044-a076-367a1880772a tempest-SnapshotDependencyTests-1232203494 None] Acquiring lock "cinder-quobyte-c3812a52-0e63-4264-9b60-a97a5c6e7a5f" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:30:14 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-01805e78-515d-4044-a076-367a1880772a tempest-SnapshotDependencyTests-1232203494 None] Lock "cinder-quobyte-c3812a52-0e63-4264-9b60-a97a5c6e7a5f" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:30:14 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-01805e78-515d-4044-a076-367a1880772a tempest-SnapshotDependencyTests-1232203494 None] Deleting offline snapshot c3812a52-0e63-4264-9b60-a97a5c6e7a5f of volume fa2e3f55-39b6-42e2-b8cd-45ac92425dec {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:30:14 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-01805e78-515d-4044-a076-367a1880772a tempest-SnapshotDependencyTests-1232203494 None] snapshot_file for this snap is: volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec.c3812a52-0e63-4264-9b60-a97a5c6e7a5f {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:30:14 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[374d7b7c-1983-4f2a-93bb-aad8bb3ab1e2]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:30:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-01805e78-515d-4044-a076-367a1880772a tempest-SnapshotDependencyTests-1232203494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec.c3812a52-0e63-4264-9b60-a97a5c6e7a5f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:14 devstack sudo[102360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec.c3812a52-0e63-4264-9b60-a97a5c6e7a5f Jul 07 08:30:14 devstack sudo[102360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:14 devstack sudo[102360]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-01805e78-515d-4044-a076-367a1880772a tempest-SnapshotDependencyTests-1232203494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec.c3812a52-0e63-4264-9b60-a97a5c6e7a5f" returned: 0 in 0.744s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:14 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-01805e78-515d-4044-a076-367a1880772a tempest-SnapshotDependencyTests-1232203494 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:30:14 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee75a21d-f559-4e69-b0dc-39b251e97491]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:30:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-01805e78-515d-4044-a076-367a1880772a tempest-SnapshotDependencyTests-1232203494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:14 devstack sudo[102365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec Jul 07 08:30:14 devstack sudo[102365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:15 devstack sudo[102365]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-01805e78-515d-4044-a076-367a1880772a tempest-SnapshotDependencyTests-1232203494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec" returned: 0 in 0.739s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-01805e78-515d-4044-a076-367a1880772a tempest-SnapshotDependencyTests-1232203494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec.c3812a52-0e63-4264-9b60-a97a5c6e7a5f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:15 devstack sudo[102370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec.c3812a52-0e63-4264-9b60-a97a5c6e7a5f Jul 07 08:30:15 devstack sudo[102370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:16 devstack sudo[102370]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-01805e78-515d-4044-a076-367a1880772a tempest-SnapshotDependencyTests-1232203494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec.c3812a52-0e63-4264-9b60-a97a5c6e7a5f" returned: 0 in 0.748s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-01805e78-515d-4044-a076-367a1880772a tempest-SnapshotDependencyTests-1232203494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec.c3812a52-0e63-4264-9b60-a97a5c6e7a5f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:16 devstack sudo[102376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec.c3812a52-0e63-4264-9b60-a97a5c6e7a5f Jul 07 08:30:16 devstack sudo[102376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:16 devstack sudo[102376]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-01805e78-515d-4044-a076-367a1880772a tempest-SnapshotDependencyTests-1232203494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec.c3812a52-0e63-4264-9b60-a97a5c6e7a5f" returned: 0 in 0.646s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:17 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-01805e78-515d-4044-a076-367a1880772a tempest-SnapshotDependencyTests-1232203494 None] Lock "cinder-quobyte-c3812a52-0e63-4264-9b60-a97a5c6e7a5f" released by "_delete_snapshot" :: held 2.986s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:30:17 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-01805e78-515d-4044-a076-367a1880772a tempest-SnapshotDependencyTests-1232203494 None] Lock "cinder-quobyte-fa2e3f55-39b6-42e2-b8cd-45ac92425dec" released by "delete_snapshot" :: held 3.006s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:30:17 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-01805e78-515d-4044-a076-367a1880772a tempest-SnapshotDependencyTests-1232203494 None] Created reservations ['31e950a2-10da-4df8-af95-1d058df15df6', '5729e2a3-f88d-473a-826d-40dd256a17a4', '50309402-7563-4693-96e9-b268bef75d88', 'd0628914-9f6e-4e53-8f98-ef0a247fcdb3'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:30:17 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-01805e78-515d-4044-a076-367a1880772a tempest-SnapshotDependencyTests-1232203494 None] Delete snapshot completed successfully. Jul 07 08:30:17 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-01805e78-515d-4044-a076-367a1880772a tempest-SnapshotDependencyTests-1232203494 None] Lock "cinder-c3812a52-0e63-4264-9b60-a97a5c6e7a5f-delete_snapshot" released by "delete_snapshot" :: held 3.169s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:30:18 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f1df6150-372e-4d88-a3ec-d9b51af344b1 tempest-SnapshotDependencyTests-1232203494 None] Acquiring lock "cinder-fa2e3f55-39b6-42e2-b8cd-45ac92425dec-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:30:18 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f1df6150-372e-4d88-a3ec-d9b51af344b1 tempest-SnapshotDependencyTests-1232203494 None] Lock "cinder-fa2e3f55-39b6-42e2-b8cd-45ac92425dec-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:30:18 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f1df6150-372e-4d88-a3ec-d9b51af344b1 tempest-SnapshotDependencyTests-1232203494 None] Acquiring lock "cinder-quobyte-fa2e3f55-39b6-42e2-b8cd-45ac92425dec" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:30:18 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f1df6150-372e-4d88-a3ec-d9b51af344b1 tempest-SnapshotDependencyTests-1232203494 None] Lock "cinder-quobyte-fa2e3f55-39b6-42e2-b8cd-45ac92425dec" acquired by "delete_volume" :: waited 0.015s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:30:18 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92e4820-a9c2-4453-a503-153c5dd1f382]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:30:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f1df6150-372e-4d88-a3ec-d9b51af344b1 tempest-SnapshotDependencyTests-1232203494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:18 devstack sudo[102379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec Jul 07 08:30:18 devstack sudo[102379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:19 devstack sudo[102379]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f1df6150-372e-4d88-a3ec-d9b51af344b1 tempest-SnapshotDependencyTests-1232203494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec" returned: 0 in 0.758s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f1df6150-372e-4d88-a3ec-d9b51af344b1 tempest-SnapshotDependencyTests-1232203494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:19 devstack sudo[102386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec Jul 07 08:30:19 devstack sudo[102386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:19 devstack sudo[102386]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f1df6150-372e-4d88-a3ec-d9b51af344b1 tempest-SnapshotDependencyTests-1232203494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fa2e3f55-39b6-42e2-b8cd-45ac92425dec" returned: 0 in 0.655s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:19 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f1df6150-372e-4d88-a3ec-d9b51af344b1 tempest-SnapshotDependencyTests-1232203494 None] Lock "cinder-quobyte-fa2e3f55-39b6-42e2-b8cd-45ac92425dec" released by "delete_volume" :: held 1.473s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:30:19 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-f1df6150-372e-4d88-a3ec-d9b51af344b1 tempest-SnapshotDependencyTests-1232203494 None] Created reservations ['79151ee5-2591-467c-8b66-f223f8bf7887', '13ce0e0a-60f8-435a-97bc-7363d40b0e17', 'f8a207aa-765c-4125-a990-dc2774753c8c', 'f445d18a-454e-4e7e-ba44-95b05ff6f964'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:30:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f1df6150-372e-4d88-a3ec-d9b51af344b1 tempest-SnapshotDependencyTests-1232203494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:30:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f1df6150-372e-4d88-a3ec-d9b51af344b1 tempest-SnapshotDependencyTests-1232203494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:30:19 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f1df6150-372e-4d88-a3ec-d9b51af344b1 tempest-SnapshotDependencyTests-1232203494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:30:19 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f1df6150-372e-4d88-a3ec-d9b51af344b1 tempest-SnapshotDependencyTests-1232203494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:30:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f1df6150-372e-4d88-a3ec-d9b51af344b1 tempest-SnapshotDependencyTests-1232203494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:30:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f1df6150-372e-4d88-a3ec-d9b51af344b1 tempest-SnapshotDependencyTests-1232203494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:19 devstack sudo[102392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:30:19 devstack sudo[102392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:20 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-38d9fb29-4be7-4cbe-989f-6e0a47bb8488 tempest-SnapshotDependencyTests-1232203494 None] Acquiring lock "cinder-6f1f716b-6792-494b-b9ab-963bd8e4d8df-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:30:20 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-38d9fb29-4be7-4cbe-989f-6e0a47bb8488 tempest-SnapshotDependencyTests-1232203494 None] Lock "cinder-6f1f716b-6792-494b-b9ab-963bd8e4d8df-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:30:20 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-38d9fb29-4be7-4cbe-989f-6e0a47bb8488 tempest-SnapshotDependencyTests-1232203494 None] Acquiring lock "cinder-quobyte-6f1f716b-6792-494b-b9ab-963bd8e4d8df" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:30:20 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-38d9fb29-4be7-4cbe-989f-6e0a47bb8488 tempest-SnapshotDependencyTests-1232203494 None] Lock "cinder-quobyte-6f1f716b-6792-494b-b9ab-963bd8e4d8df" acquired by "delete_volume" :: waited 0.023s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:30:20 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3961e38-b1ff-4a59-9891-abade602dfc3]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:30:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-38d9fb29-4be7-4cbe-989f-6e0a47bb8488 tempest-SnapshotDependencyTests-1232203494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6f1f716b-6792-494b-b9ab-963bd8e4d8df {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:20 devstack sudo[102392]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f1df6150-372e-4d88-a3ec-d9b51af344b1 tempest-SnapshotDependencyTests-1232203494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.715s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:20 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-f1df6150-372e-4d88-a3ec-d9b51af344b1 tempest-SnapshotDependencyTests-1232203494 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:30:20 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-f1df6150-372e-4d88-a3ec-d9b51af344b1 tempest-SnapshotDependencyTests-1232203494 None] Deleted volume successfully. Jul 07 08:30:20 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f1df6150-372e-4d88-a3ec-d9b51af344b1 tempest-SnapshotDependencyTests-1232203494 None] Lock "cinder-fa2e3f55-39b6-42e2-b8cd-45ac92425dec-delete_volume" released by "delete_volume" :: held 2.401s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:30:20 devstack sudo[102395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6f1f716b-6792-494b-b9ab-963bd8e4d8df Jul 07 08:30:20 devstack sudo[102395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:21 devstack sudo[102395]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-38d9fb29-4be7-4cbe-989f-6e0a47bb8488 tempest-SnapshotDependencyTests-1232203494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6f1f716b-6792-494b-b9ab-963bd8e4d8df" returned: 0 in 0.875s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-38d9fb29-4be7-4cbe-989f-6e0a47bb8488 tempest-SnapshotDependencyTests-1232203494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6f1f716b-6792-494b-b9ab-963bd8e4d8df {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:21 devstack sudo[102401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6f1f716b-6792-494b-b9ab-963bd8e4d8df Jul 07 08:30:21 devstack sudo[102401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:22 devstack sudo[102401]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-38d9fb29-4be7-4cbe-989f-6e0a47bb8488 tempest-SnapshotDependencyTests-1232203494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6f1f716b-6792-494b-b9ab-963bd8e4d8df" returned: 0 in 0.668s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:22 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-38d9fb29-4be7-4cbe-989f-6e0a47bb8488 tempest-SnapshotDependencyTests-1232203494 None] Lock "cinder-quobyte-6f1f716b-6792-494b-b9ab-963bd8e4d8df" released by "delete_volume" :: held 1.595s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:30:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-b7bbf4cb-e4d4-4514-b564-0fbaad3f8243 req-abc82c5c-2dce-4880-91bc-ddc766c1e9bf tempest-TestServerVolumeAttachmentScenario-1521268967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:30:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-b7bbf4cb-e4d4-4514-b564-0fbaad3f8243 req-abc82c5c-2dce-4880-91bc-ddc766c1e9bf tempest-TestServerVolumeAttachmentScenario-1521268967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:30:22 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[eacb1e14-55b0-43a0-b9e3-8fd0aaaab048]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:30:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-b7bbf4cb-e4d4-4514-b564-0fbaad3f8243 req-abc82c5c-2dce-4880-91bc-ddc766c1e9bf tempest-TestServerVolumeAttachmentScenario-1521268967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-a5629c26-d04e-41ff-80eb-8451dfd6d6b3 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:22 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-38d9fb29-4be7-4cbe-989f-6e0a47bb8488 tempest-SnapshotDependencyTests-1232203494 None] Created reservations ['68e1360b-ab24-4694-bb1e-a56e49c0f500', '5770bcc9-304f-41ec-b4f4-430878719ad7', '1183dd01-1b41-4ae7-a112-4caee8437f42', '20f32ca5-a2bb-48ce-8709-aae411953959'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:30:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-38d9fb29-4be7-4cbe-989f-6e0a47bb8488 tempest-SnapshotDependencyTests-1232203494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:30:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-38d9fb29-4be7-4cbe-989f-6e0a47bb8488 tempest-SnapshotDependencyTests-1232203494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:30:22 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-38d9fb29-4be7-4cbe-989f-6e0a47bb8488 tempest-SnapshotDependencyTests-1232203494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:30:22 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-38d9fb29-4be7-4cbe-989f-6e0a47bb8488 tempest-SnapshotDependencyTests-1232203494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:30:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-38d9fb29-4be7-4cbe-989f-6e0a47bb8488 tempest-SnapshotDependencyTests-1232203494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:30:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-38d9fb29-4be7-4cbe-989f-6e0a47bb8488 tempest-SnapshotDependencyTests-1232203494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:22 devstack sudo[102412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-a5629c26-d04e-41ff-80eb-8451dfd6d6b3 Jul 07 08:30:22 devstack sudo[102412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:22 devstack sudo[102413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:30:22 devstack sudo[102413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:23 devstack sudo[102412]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-b7bbf4cb-e4d4-4514-b564-0fbaad3f8243 req-abc82c5c-2dce-4880-91bc-ddc766c1e9bf tempest-TestServerVolumeAttachmentScenario-1521268967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-a5629c26-d04e-41ff-80eb-8451dfd6d6b3" returned: 0 in 0.842s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-b7bbf4cb-e4d4-4514-b564-0fbaad3f8243 req-abc82c5c-2dce-4880-91bc-ddc766c1e9bf tempest-TestServerVolumeAttachmentScenario-1521268967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.866s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:30:23 devstack sudo[102413]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-38d9fb29-4be7-4cbe-989f-6e0a47bb8488 tempest-SnapshotDependencyTests-1232203494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.750s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:23 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-38d9fb29-4be7-4cbe-989f-6e0a47bb8488 tempest-SnapshotDependencyTests-1232203494 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:30:23 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-38d9fb29-4be7-4cbe-989f-6e0a47bb8488 tempest-SnapshotDependencyTests-1232203494 None] Deleted volume successfully. Jul 07 08:30:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-b7bbf4cb-e4d4-4514-b564-0fbaad3f8243 req-abc82c5c-2dce-4880-91bc-ddc766c1e9bf tempest-TestServerVolumeAttachmentScenario-1521268967 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b', 'name': 'volume-a5629c26-d04e-41ff-80eb-8451dfd6d6b3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6ae4e981-4109-492b-937d-0a79e2230203', 'enforce_multipath': True} {{(pid=87199) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 08:30:23 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-38d9fb29-4be7-4cbe-989f-6e0a47bb8488 tempest-SnapshotDependencyTests-1232203494 None] Lock "cinder-6f1f716b-6792-494b-b9ab-963bd8e4d8df-delete_volume" released by "delete_volume" :: held 2.613s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:30:23 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-b7bbf4cb-e4d4-4514-b564-0fbaad3f8243 req-abc82c5c-2dce-4880-91bc-ddc766c1e9bf tempest-TestServerVolumeAttachmentScenario-1521268967 None] attachment_update completed successfully. Jul 07 08:30:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-3fa0df0e-c4d5-488b-8047-ea394de17e18 req-2955548d-2d49-4e2b-a985-336309483074 tempest-TestInstancesWithCinderVolumes-1289129289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:30:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-3fa0df0e-c4d5-488b-8047-ea394de17e18 req-2955548d-2d49-4e2b-a985-336309483074 tempest-TestInstancesWithCinderVolumes-1289129289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:30:31 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[7581d33b-66b0-442f-abf9-b38ea63825f1]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:30:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-3fa0df0e-c4d5-488b-8047-ea394de17e18 req-2955548d-2d49-4e2b-a985-336309483074 tempest-TestInstancesWithCinderVolumes-1289129289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-006e327c-20f8-4d7b-a300-d70ed3f4fb17 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:31 devstack sudo[102446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-006e327c-20f8-4d7b-a300-d70ed3f4fb17 Jul 07 08:30:31 devstack sudo[102446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:32 devstack sudo[102446]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-3fa0df0e-c4d5-488b-8047-ea394de17e18 req-2955548d-2d49-4e2b-a985-336309483074 tempest-TestInstancesWithCinderVolumes-1289129289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-006e327c-20f8-4d7b-a300-d70ed3f4fb17" returned: 0 in 0.868s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-3fa0df0e-c4d5-488b-8047-ea394de17e18 req-2955548d-2d49-4e2b-a985-336309483074 tempest-TestInstancesWithCinderVolumes-1289129289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.891s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:30:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-3fa0df0e-c4d5-488b-8047-ea394de17e18 req-2955548d-2d49-4e2b-a985-336309483074 tempest-TestInstancesWithCinderVolumes-1289129289 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b', 'name': 'volume-006e327c-20f8-4d7b-a300-d70ed3f4fb17', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4a277988-6668-4ec1-b0f1-5d1e17b1ba25', 'enforce_multipath': True} {{(pid=87199) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 08:30:32 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-3fa0df0e-c4d5-488b-8047-ea394de17e18 req-2955548d-2d49-4e2b-a985-336309483074 tempest-TestInstancesWithCinderVolumes-1289129289 None] attachment_update completed successfully. Jul 07 08:30:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-0484adcc-10d8-4125-8aae-3bff1427338e req-51b9b863-219c-4395-bd87-44c21fd5a02e tempest-TestServerVolumeAttachmentScenario-1521268967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:30:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-0484adcc-10d8-4125-8aae-3bff1427338e req-51b9b863-219c-4395-bd87-44c21fd5a02e tempest-TestServerVolumeAttachmentScenario-1521268967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:30:32 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c46e287-ad45-4814-a3c1-300c0413353a]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:30:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-0484adcc-10d8-4125-8aae-3bff1427338e req-51b9b863-219c-4395-bd87-44c21fd5a02e tempest-TestServerVolumeAttachmentScenario-1521268967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-df892a44-fa93-4e50-b750-a971d4a0c256 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:32 devstack sudo[102459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-df892a44-fa93-4e50-b750-a971d4a0c256 Jul 07 08:30:32 devstack sudo[102459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:33 devstack sudo[102459]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-0484adcc-10d8-4125-8aae-3bff1427338e req-51b9b863-219c-4395-bd87-44c21fd5a02e tempest-TestServerVolumeAttachmentScenario-1521268967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-df892a44-fa93-4e50-b750-a971d4a0c256" returned: 0 in 0.831s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-0484adcc-10d8-4125-8aae-3bff1427338e req-51b9b863-219c-4395-bd87-44c21fd5a02e tempest-TestServerVolumeAttachmentScenario-1521268967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.847s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:30:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-0484adcc-10d8-4125-8aae-3bff1427338e req-51b9b863-219c-4395-bd87-44c21fd5a02e tempest-TestServerVolumeAttachmentScenario-1521268967 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b', 'name': 'volume-df892a44-fa93-4e50-b750-a971d4a0c256', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c893dd8a-4ada-4c61-94ae-4e1e5b0fcdf1', 'enforce_multipath': True} {{(pid=87199) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 08:30:33 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-0484adcc-10d8-4125-8aae-3bff1427338e req-51b9b863-219c-4395-bd87-44c21fd5a02e tempest-TestServerVolumeAttachmentScenario-1521268967 None] attachment_update completed successfully. Jul 07 08:30:39 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-cfc00fed-93a8-4151-b356-dd9f58dd9633 req-10668bbb-f82c-4845-8a78-93e3075330a7 tempest-TestServerVolumeAttachmentScenario-1521268967 None] Terminate volume connection completed successfully. Jul 07 08:30:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-cfc00fed-93a8-4151-b356-dd9f58dd9633 req-10668bbb-f82c-4845-8a78-93e3075330a7 tempest-TestServerVolumeAttachmentScenario-1521268967 None] Deleting attachment c893dd8a-4ada-4c61-94ae-4e1e5b0fcdf1. {{(pid=87199) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 08:30:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-ccf62bf0-eb2d-4d81-bf12-b3ec17a6d8a8 req-aa06e517-c077-4a61-913d-b1c41c4c58c2 tempest-TestInstancesWithCinderVolumes-1289129289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:30:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-ccf62bf0-eb2d-4d81-bf12-b3ec17a6d8a8 req-aa06e517-c077-4a61-913d-b1c41c4c58c2 tempest-TestInstancesWithCinderVolumes-1289129289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:30:40 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[915bd384-b7fa-4ebb-9be6-0c8300cef4a8]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:30:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-ccf62bf0-eb2d-4d81-bf12-b3ec17a6d8a8 req-aa06e517-c077-4a61-913d-b1c41c4c58c2 tempest-TestInstancesWithCinderVolumes-1289129289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-e5c67224-9967-4aef-832d-b4ba5bec1616 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:40 devstack sudo[102531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-e5c67224-9967-4aef-832d-b4ba5bec1616 Jul 07 08:30:40 devstack sudo[102531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:41 devstack sudo[102531]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-ccf62bf0-eb2d-4d81-bf12-b3ec17a6d8a8 req-aa06e517-c077-4a61-913d-b1c41c4c58c2 tempest-TestInstancesWithCinderVolumes-1289129289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-e5c67224-9967-4aef-832d-b4ba5bec1616" returned: 0 in 0.824s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-ccf62bf0-eb2d-4d81-bf12-b3ec17a6d8a8 req-aa06e517-c077-4a61-913d-b1c41c4c58c2 tempest-TestInstancesWithCinderVolumes-1289129289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.841s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:30:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-ccf62bf0-eb2d-4d81-bf12-b3ec17a6d8a8 req-aa06e517-c077-4a61-913d-b1c41c4c58c2 tempest-TestInstancesWithCinderVolumes-1289129289 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b', 'name': 'volume-e5c67224-9967-4aef-832d-b4ba5bec1616', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4b9273b3-6184-42f8-aa90-e37a4bee4c93', 'enforce_multipath': True} {{(pid=87199) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 08:30:41 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-ccf62bf0-eb2d-4d81-bf12-b3ec17a6d8a8 req-aa06e517-c077-4a61-913d-b1c41c4c58c2 tempest-TestInstancesWithCinderVolumes-1289129289 None] attachment_update completed successfully. Jul 07 08:30:42 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-47c03f29-bf2b-4c6f-89e6-9705baaf6ce4 req-827eeea7-4664-45af-99c8-62f0d3ea9f76 tempest-TestServerVolumeAttachmentScenario-1521268967 None] Terminate volume connection completed successfully. Jul 07 08:30:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-47c03f29-bf2b-4c6f-89e6-9705baaf6ce4 req-827eeea7-4664-45af-99c8-62f0d3ea9f76 tempest-TestServerVolumeAttachmentScenario-1521268967 None] Deleting attachment 6ae4e981-4109-492b-937d-0a79e2230203. {{(pid=87199) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 08:30:50 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-bfb6adbb-5953-4536-86fb-32950e44f1d1 req-7a1612f7-c005-4665-be1c-a275ed9b8d89 tempest-TestInstancesWithCinderVolumes-1289129289 None] Terminate volume connection completed successfully. Jul 07 08:30:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-bfb6adbb-5953-4536-86fb-32950e44f1d1 req-7a1612f7-c005-4665-be1c-a275ed9b8d89 tempest-TestInstancesWithCinderVolumes-1289129289 None] Deleting attachment 4a277988-6668-4ec1-b0f1-5d1e17b1ba25. {{(pid=87199) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 08:30:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-900be141-1684-4085-b76b-4ce4111fb244 tempest-TestInstancesWithCinderVolumes-1289129289 None] Acquiring lock "cinder-006e327c-20f8-4d7b-a300-d70ed3f4fb17-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:30:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-900be141-1684-4085-b76b-4ce4111fb244 tempest-TestInstancesWithCinderVolumes-1289129289 None] Lock "cinder-006e327c-20f8-4d7b-a300-d70ed3f4fb17-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:30:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-900be141-1684-4085-b76b-4ce4111fb244 tempest-TestInstancesWithCinderVolumes-1289129289 None] Acquiring lock "cinder-quobyte-006e327c-20f8-4d7b-a300-d70ed3f4fb17" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:30:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-900be141-1684-4085-b76b-4ce4111fb244 tempest-TestInstancesWithCinderVolumes-1289129289 None] Lock "cinder-quobyte-006e327c-20f8-4d7b-a300-d70ed3f4fb17" acquired by "delete_volume" :: waited 0.020s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:30:52 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[80835525-b99f-42e5-84c1-a155ea845acd]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:30:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-900be141-1684-4085-b76b-4ce4111fb244 tempest-TestInstancesWithCinderVolumes-1289129289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-006e327c-20f8-4d7b-a300-d70ed3f4fb17 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:52 devstack sudo[102610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-006e327c-20f8-4d7b-a300-d70ed3f4fb17 Jul 07 08:30:52 devstack sudo[102610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:53 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e47f75e0-6cef-4398-9323-31eb5efa36f1 tempest-TestServerVolumeAttachmentScenario-1521268967 None] Acquiring lock "cinder-df892a44-fa93-4e50-b750-a971d4a0c256-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:30:53 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e47f75e0-6cef-4398-9323-31eb5efa36f1 tempest-TestServerVolumeAttachmentScenario-1521268967 None] Lock "cinder-df892a44-fa93-4e50-b750-a971d4a0c256-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:30:53 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e47f75e0-6cef-4398-9323-31eb5efa36f1 tempest-TestServerVolumeAttachmentScenario-1521268967 None] Acquiring lock "cinder-quobyte-df892a44-fa93-4e50-b750-a971d4a0c256" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:30:53 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e47f75e0-6cef-4398-9323-31eb5efa36f1 tempest-TestServerVolumeAttachmentScenario-1521268967 None] Lock "cinder-quobyte-df892a44-fa93-4e50-b750-a971d4a0c256" acquired by "delete_volume" :: waited 0.021s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:30:53 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c870ea-d36f-416a-b765-ddbe392811be]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:30:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e47f75e0-6cef-4398-9323-31eb5efa36f1 tempest-TestServerVolumeAttachmentScenario-1521268967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-df892a44-fa93-4e50-b750-a971d4a0c256 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:53 devstack sudo[102614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-df892a44-fa93-4e50-b750-a971d4a0c256 Jul 07 08:30:53 devstack sudo[102614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:53 devstack sudo[102610]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-900be141-1684-4085-b76b-4ce4111fb244 tempest-TestInstancesWithCinderVolumes-1289129289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-006e327c-20f8-4d7b-a300-d70ed3f4fb17" returned: 0 in 0.866s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-900be141-1684-4085-b76b-4ce4111fb244 tempest-TestInstancesWithCinderVolumes-1289129289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-006e327c-20f8-4d7b-a300-d70ed3f4fb17 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:53 devstack sudo[102619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-006e327c-20f8-4d7b-a300-d70ed3f4fb17 Jul 07 08:30:53 devstack sudo[102619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:54 devstack sudo[102614]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e47f75e0-6cef-4398-9323-31eb5efa36f1 tempest-TestServerVolumeAttachmentScenario-1521268967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-df892a44-fa93-4e50-b750-a971d4a0c256" returned: 0 in 0.881s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e47f75e0-6cef-4398-9323-31eb5efa36f1 tempest-TestServerVolumeAttachmentScenario-1521268967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-df892a44-fa93-4e50-b750-a971d4a0c256 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:54 devstack sudo[102619]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-900be141-1684-4085-b76b-4ce4111fb244 tempest-TestInstancesWithCinderVolumes-1289129289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-006e327c-20f8-4d7b-a300-d70ed3f4fb17" returned: 0 in 0.683s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:54 devstack sudo[102625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-df892a44-fa93-4e50-b750-a971d4a0c256 Jul 07 08:30:54 devstack sudo[102625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:54 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-900be141-1684-4085-b76b-4ce4111fb244 tempest-TestInstancesWithCinderVolumes-1289129289 None] Lock "cinder-quobyte-006e327c-20f8-4d7b-a300-d70ed3f4fb17" released by "delete_volume" :: held 1.601s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:30:54 devstack cinder-volume[87199]: WARNING cinder.quota [None req-900be141-1684-4085-b76b-4ce4111fb244 tempest-TestInstancesWithCinderVolumes-1289129289 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1662387530-1921073271 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1662387530-1921073271, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:30:54 devstack cinder-volume[87199]: WARNING cinder.quota [None req-900be141-1684-4085-b76b-4ce4111fb244 tempest-TestInstancesWithCinderVolumes-1289129289 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1662387530-1921073271 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1662387530-1921073271, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:30:54 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-900be141-1684-4085-b76b-4ce4111fb244 tempest-TestInstancesWithCinderVolumes-1289129289 None] Created reservations ['6eba2fd4-10ec-4094-b3dc-9a9df260d280', 'bd93b727-7bdc-495f-8f7f-49ff27513bce', 'b09f1770-bc03-40b3-b871-dcee027f4367', '58ef0535-c8d7-483d-91ef-09eb19aad82b'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:30:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-900be141-1684-4085-b76b-4ce4111fb244 tempest-TestInstancesWithCinderVolumes-1289129289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:30:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-900be141-1684-4085-b76b-4ce4111fb244 tempest-TestInstancesWithCinderVolumes-1289129289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:30:54 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-900be141-1684-4085-b76b-4ce4111fb244 tempest-TestInstancesWithCinderVolumes-1289129289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:30:54 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-900be141-1684-4085-b76b-4ce4111fb244 tempest-TestInstancesWithCinderVolumes-1289129289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:30:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-900be141-1684-4085-b76b-4ce4111fb244 tempest-TestInstancesWithCinderVolumes-1289129289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:30:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-900be141-1684-4085-b76b-4ce4111fb244 tempest-TestInstancesWithCinderVolumes-1289129289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:54 devstack sudo[102627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:30:54 devstack sudo[102627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:54 devstack sudo[102625]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e47f75e0-6cef-4398-9323-31eb5efa36f1 tempest-TestServerVolumeAttachmentScenario-1521268967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-df892a44-fa93-4e50-b750-a971d4a0c256" returned: 0 in 0.650s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:54 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e47f75e0-6cef-4398-9323-31eb5efa36f1 tempest-TestServerVolumeAttachmentScenario-1521268967 None] Lock "cinder-quobyte-df892a44-fa93-4e50-b750-a971d4a0c256" released by "delete_volume" :: held 1.580s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:30:54 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-e47f75e0-6cef-4398-9323-31eb5efa36f1 tempest-TestServerVolumeAttachmentScenario-1521268967 None] Created reservations ['4f40cde9-290e-4749-b56f-e15309f76bf3', 'edf9d484-b2ea-4372-b2a5-a2264ce782eb', '3b5dbd5c-7eba-4917-a158-6838fee7ba66', '845d03e5-d1dc-4cce-938f-fa5896c24e4c'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:30:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e47f75e0-6cef-4398-9323-31eb5efa36f1 tempest-TestServerVolumeAttachmentScenario-1521268967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:30:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e47f75e0-6cef-4398-9323-31eb5efa36f1 tempest-TestServerVolumeAttachmentScenario-1521268967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:30:54 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e47f75e0-6cef-4398-9323-31eb5efa36f1 tempest-TestServerVolumeAttachmentScenario-1521268967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:30:54 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e47f75e0-6cef-4398-9323-31eb5efa36f1 tempest-TestServerVolumeAttachmentScenario-1521268967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:30:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e47f75e0-6cef-4398-9323-31eb5efa36f1 tempest-TestServerVolumeAttachmentScenario-1521268967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:30:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e47f75e0-6cef-4398-9323-31eb5efa36f1 tempest-TestServerVolumeAttachmentScenario-1521268967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:55 devstack sudo[102640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:30:55 devstack sudo[102640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:55 devstack sudo[102627]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-900be141-1684-4085-b76b-4ce4111fb244 tempest-TestInstancesWithCinderVolumes-1289129289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.706s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:55 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-900be141-1684-4085-b76b-4ce4111fb244 tempest-TestInstancesWithCinderVolumes-1289129289 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:30:55 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-900be141-1684-4085-b76b-4ce4111fb244 tempest-TestInstancesWithCinderVolumes-1289129289 None] Deleted volume successfully. Jul 07 08:30:55 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-900be141-1684-4085-b76b-4ce4111fb244 tempest-TestInstancesWithCinderVolumes-1289129289 None] Lock "cinder-006e327c-20f8-4d7b-a300-d70ed3f4fb17-delete_volume" released by "delete_volume" :: held 2.572s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:30:55 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-be5b40ff-9c22-41c4-9ce1-1c98fc70935a tempest-TestServerVolumeAttachmentScenario-1521268967 None] Acquiring lock "cinder-a5629c26-d04e-41ff-80eb-8451dfd6d6b3-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:30:55 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-be5b40ff-9c22-41c4-9ce1-1c98fc70935a tempest-TestServerVolumeAttachmentScenario-1521268967 None] Lock "cinder-a5629c26-d04e-41ff-80eb-8451dfd6d6b3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:30:55 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-be5b40ff-9c22-41c4-9ce1-1c98fc70935a tempest-TestServerVolumeAttachmentScenario-1521268967 None] Acquiring lock "cinder-quobyte-a5629c26-d04e-41ff-80eb-8451dfd6d6b3" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:30:55 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-be5b40ff-9c22-41c4-9ce1-1c98fc70935a tempest-TestServerVolumeAttachmentScenario-1521268967 None] Lock "cinder-quobyte-a5629c26-d04e-41ff-80eb-8451dfd6d6b3" acquired by "delete_volume" :: waited 0.019s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:30:55 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6fdfb5-4b99-4611-ae35-796b258df9b6]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:30:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-be5b40ff-9c22-41c4-9ce1-1c98fc70935a tempest-TestServerVolumeAttachmentScenario-1521268967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-a5629c26-d04e-41ff-80eb-8451dfd6d6b3 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:55 devstack sudo[102640]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e47f75e0-6cef-4398-9323-31eb5efa36f1 tempest-TestServerVolumeAttachmentScenario-1521268967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.691s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:55 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-e47f75e0-6cef-4398-9323-31eb5efa36f1 tempest-TestServerVolumeAttachmentScenario-1521268967 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:30:55 devstack sudo[102654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-a5629c26-d04e-41ff-80eb-8451dfd6d6b3 Jul 07 08:30:55 devstack sudo[102654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:55 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-e47f75e0-6cef-4398-9323-31eb5efa36f1 tempest-TestServerVolumeAttachmentScenario-1521268967 None] Deleted volume successfully. Jul 07 08:30:55 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e47f75e0-6cef-4398-9323-31eb5efa36f1 tempest-TestServerVolumeAttachmentScenario-1521268967 None] Lock "cinder-df892a44-fa93-4e50-b750-a971d4a0c256-delete_volume" released by "delete_volume" :: held 2.521s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:30:56 devstack sudo[102654]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-be5b40ff-9c22-41c4-9ce1-1c98fc70935a tempest-TestServerVolumeAttachmentScenario-1521268967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-a5629c26-d04e-41ff-80eb-8451dfd6d6b3" returned: 0 in 0.797s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-be5b40ff-9c22-41c4-9ce1-1c98fc70935a tempest-TestServerVolumeAttachmentScenario-1521268967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-a5629c26-d04e-41ff-80eb-8451dfd6d6b3 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:56 devstack sudo[102659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-a5629c26-d04e-41ff-80eb-8451dfd6d6b3 Jul 07 08:30:56 devstack sudo[102659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:57 devstack sudo[102659]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-be5b40ff-9c22-41c4-9ce1-1c98fc70935a tempest-TestServerVolumeAttachmentScenario-1521268967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-a5629c26-d04e-41ff-80eb-8451dfd6d6b3" returned: 0 in 0.657s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:57 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-be5b40ff-9c22-41c4-9ce1-1c98fc70935a tempest-TestServerVolumeAttachmentScenario-1521268967 None] Lock "cinder-quobyte-a5629c26-d04e-41ff-80eb-8451dfd6d6b3" released by "delete_volume" :: held 1.495s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:30:57 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-be5b40ff-9c22-41c4-9ce1-1c98fc70935a tempest-TestServerVolumeAttachmentScenario-1521268967 None] Created reservations ['76f96655-bfa9-4cd8-a08b-5aee232578f2', 'd5875a1e-54b9-4b39-80d7-2d41403f8e47', '77ff02ff-8e1c-49da-ac98-3ea434d90184', '5c2688c3-14fd-42fb-85d7-1f940d933360'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:30:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-be5b40ff-9c22-41c4-9ce1-1c98fc70935a tempest-TestServerVolumeAttachmentScenario-1521268967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:30:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-be5b40ff-9c22-41c4-9ce1-1c98fc70935a tempest-TestServerVolumeAttachmentScenario-1521268967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:30:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-be5b40ff-9c22-41c4-9ce1-1c98fc70935a tempest-TestServerVolumeAttachmentScenario-1521268967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:30:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-be5b40ff-9c22-41c4-9ce1-1c98fc70935a tempest-TestServerVolumeAttachmentScenario-1521268967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:30:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-be5b40ff-9c22-41c4-9ce1-1c98fc70935a tempest-TestServerVolumeAttachmentScenario-1521268967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:30:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-be5b40ff-9c22-41c4-9ce1-1c98fc70935a tempest-TestServerVolumeAttachmentScenario-1521268967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:57 devstack sudo[102663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:30:57 devstack sudo[102663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:57 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-1df4fd78-7106-4ff9-b955-e0a50710db18 req-06b8b69a-ef6a-4ad6-87ae-37250f05391d tempest-TestInstancesWithCinderVolumes-1289129289 None] Terminate volume connection completed successfully. Jul 07 08:30:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-1df4fd78-7106-4ff9-b955-e0a50710db18 req-06b8b69a-ef6a-4ad6-87ae-37250f05391d tempest-TestInstancesWithCinderVolumes-1289129289 None] Deleting attachment 4b9273b3-6184-42f8-aa90-e37a4bee4c93. {{(pid=87199) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 08:30:57 devstack sudo[102663]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-be5b40ff-9c22-41c4-9ce1-1c98fc70935a tempest-TestServerVolumeAttachmentScenario-1521268967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.673s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:57 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-be5b40ff-9c22-41c4-9ce1-1c98fc70935a tempest-TestServerVolumeAttachmentScenario-1521268967 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:30:57 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-be5b40ff-9c22-41c4-9ce1-1c98fc70935a tempest-TestServerVolumeAttachmentScenario-1521268967 None] Deleted volume successfully. Jul 07 08:30:57 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-be5b40ff-9c22-41c4-9ce1-1c98fc70935a tempest-TestServerVolumeAttachmentScenario-1521268967 None] Lock "cinder-a5629c26-d04e-41ff-80eb-8451dfd6d6b3-delete_volume" released by "delete_volume" :: held 2.368s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:30:59 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c6f5ecdc-85c5-4e78-9307-e1becf2537d9 tempest-TestInstancesWithCinderVolumes-1289129289 None] Acquiring lock "cinder-e5c67224-9967-4aef-832d-b4ba5bec1616-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:30:59 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c6f5ecdc-85c5-4e78-9307-e1becf2537d9 tempest-TestInstancesWithCinderVolumes-1289129289 None] Lock "cinder-e5c67224-9967-4aef-832d-b4ba5bec1616-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:30:59 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c6f5ecdc-85c5-4e78-9307-e1becf2537d9 tempest-TestInstancesWithCinderVolumes-1289129289 None] Acquiring lock "cinder-quobyte-e5c67224-9967-4aef-832d-b4ba5bec1616" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:30:59 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c6f5ecdc-85c5-4e78-9307-e1becf2537d9 tempest-TestInstancesWithCinderVolumes-1289129289 None] Lock "cinder-quobyte-e5c67224-9967-4aef-832d-b4ba5bec1616" acquired by "delete_volume" :: waited 0.027s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:30:59 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[e732a8fa-4859-48d0-a9a7-5719db037420]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:30:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c6f5ecdc-85c5-4e78-9307-e1becf2537d9 tempest-TestInstancesWithCinderVolumes-1289129289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-e5c67224-9967-4aef-832d-b4ba5bec1616 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:59 devstack sudo[102669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-e5c67224-9967-4aef-832d-b4ba5bec1616 Jul 07 08:30:59 devstack sudo[102669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:00 devstack sudo[102669]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c6f5ecdc-85c5-4e78-9307-e1becf2537d9 tempest-TestInstancesWithCinderVolumes-1289129289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-e5c67224-9967-4aef-832d-b4ba5bec1616" returned: 0 in 0.859s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c6f5ecdc-85c5-4e78-9307-e1becf2537d9 tempest-TestInstancesWithCinderVolumes-1289129289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-e5c67224-9967-4aef-832d-b4ba5bec1616 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:00 devstack sudo[102674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-e5c67224-9967-4aef-832d-b4ba5bec1616 Jul 07 08:31:00 devstack sudo[102674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:00 devstack sudo[102674]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c6f5ecdc-85c5-4e78-9307-e1becf2537d9 tempest-TestInstancesWithCinderVolumes-1289129289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-e5c67224-9967-4aef-832d-b4ba5bec1616" returned: 0 in 0.769s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:01 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c6f5ecdc-85c5-4e78-9307-e1becf2537d9 tempest-TestInstancesWithCinderVolumes-1289129289 None] Lock "cinder-quobyte-e5c67224-9967-4aef-832d-b4ba5bec1616" released by "delete_volume" :: held 1.722s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:31:01 devstack cinder-volume[87199]: WARNING cinder.quota [None req-c6f5ecdc-85c5-4e78-9307-e1becf2537d9 tempest-TestInstancesWithCinderVolumes-1289129289 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-613771551-321330373 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-613771551-321330373, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:31:01 devstack cinder-volume[87199]: WARNING cinder.quota [None req-c6f5ecdc-85c5-4e78-9307-e1becf2537d9 tempest-TestInstancesWithCinderVolumes-1289129289 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-613771551-321330373 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-613771551-321330373, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:31:01 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-c6f5ecdc-85c5-4e78-9307-e1becf2537d9 tempest-TestInstancesWithCinderVolumes-1289129289 None] Created reservations ['1c6289e3-166c-4bcf-9bb2-a8f7f089a376', '5e7c4e84-7d01-4818-a625-b0e2627c2084', '2ad69560-4bc9-49a3-840e-21f5d0c45eeb', '8b270440-66eb-40d6-927d-b2710edfbb6d'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:31:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c6f5ecdc-85c5-4e78-9307-e1becf2537d9 tempest-TestInstancesWithCinderVolumes-1289129289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:31:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c6f5ecdc-85c5-4e78-9307-e1becf2537d9 tempest-TestInstancesWithCinderVolumes-1289129289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:31:01 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c6f5ecdc-85c5-4e78-9307-e1becf2537d9 tempest-TestInstancesWithCinderVolumes-1289129289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:31:01 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c6f5ecdc-85c5-4e78-9307-e1becf2537d9 tempest-TestInstancesWithCinderVolumes-1289129289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:31:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c6f5ecdc-85c5-4e78-9307-e1becf2537d9 tempest-TestInstancesWithCinderVolumes-1289129289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:31:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c6f5ecdc-85c5-4e78-9307-e1becf2537d9 tempest-TestInstancesWithCinderVolumes-1289129289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:01 devstack sudo[102679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:31:01 devstack sudo[102679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:02 devstack sudo[102679]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c6f5ecdc-85c5-4e78-9307-e1becf2537d9 tempest-TestInstancesWithCinderVolumes-1289129289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.799s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:02 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-c6f5ecdc-85c5-4e78-9307-e1becf2537d9 tempest-TestInstancesWithCinderVolumes-1289129289 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:31:02 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-c6f5ecdc-85c5-4e78-9307-e1becf2537d9 tempest-TestInstancesWithCinderVolumes-1289129289 None] Deleted volume successfully. Jul 07 08:31:02 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c6f5ecdc-85c5-4e78-9307-e1becf2537d9 tempest-TestInstancesWithCinderVolumes-1289129289 None] Lock "cinder-e5c67224-9967-4aef-832d-b4ba5bec1616-delete_volume" released by "delete_volume" :: held 2.821s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:31:05 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:31:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:31:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:31:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:31:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:31:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:31:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:05 devstack sudo[102712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:31:05 devstack sudo[102712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:06 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-58538b21-0890-4561-83b3-29610bda4d54 req-b4855fbd-fc73-4e65-b14f-0c279b1a74ed tempest-TestInstancesWithCinderVolumes-1289129289 None] Terminate volume connection completed successfully. Jul 07 08:31:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-58538b21-0890-4561-83b3-29610bda4d54 req-b4855fbd-fc73-4e65-b14f-0c279b1a74ed tempest-TestInstancesWithCinderVolumes-1289129289 None] Deleting attachment 00f1881f-36a8-4283-b835-9fae55cca2b2. {{(pid=87199) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 08:31:06 devstack sudo[102712]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.704s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:06 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:31:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running periodic task VolumeManager._thread_info {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:31:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] thread count: 29 {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 08:31:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] thread info: [<_MainThread(MainThread, started 133056092332160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 08:31:10 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-886c2206-75da-4cca-aafd-3b7604814bba tempest-TestInstancesWithCinderVolumes-1289129289 None] Acquiring lock "cinder-3f17ccc6-cbf4-4cf5-a89b-db9a54b0d8dc-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:31:10 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-886c2206-75da-4cca-aafd-3b7604814bba tempest-TestInstancesWithCinderVolumes-1289129289 None] Lock "cinder-3f17ccc6-cbf4-4cf5-a89b-db9a54b0d8dc-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:31:10 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-886c2206-75da-4cca-aafd-3b7604814bba tempest-TestInstancesWithCinderVolumes-1289129289 None] Acquiring lock "cinder-quobyte-3f17ccc6-cbf4-4cf5-a89b-db9a54b0d8dc" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:31:10 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-886c2206-75da-4cca-aafd-3b7604814bba tempest-TestInstancesWithCinderVolumes-1289129289 None] Lock "cinder-quobyte-3f17ccc6-cbf4-4cf5-a89b-db9a54b0d8dc" acquired by "delete_volume" :: waited 0.018s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:31:10 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[8645e54d-cda8-46e0-b8ed-72b2ca8fb5ab]: (4, 'raw') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:31:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-886c2206-75da-4cca-aafd-3b7604814bba tempest-TestInstancesWithCinderVolumes-1289129289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3f17ccc6-cbf4-4cf5-a89b-db9a54b0d8dc {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:10 devstack sudo[102715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3f17ccc6-cbf4-4cf5-a89b-db9a54b0d8dc Jul 07 08:31:10 devstack sudo[102715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:10 devstack sudo[102715]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-886c2206-75da-4cca-aafd-3b7604814bba tempest-TestInstancesWithCinderVolumes-1289129289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3f17ccc6-cbf4-4cf5-a89b-db9a54b0d8dc" returned: 0 in 0.781s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-886c2206-75da-4cca-aafd-3b7604814bba tempest-TestInstancesWithCinderVolumes-1289129289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3f17ccc6-cbf4-4cf5-a89b-db9a54b0d8dc {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:11 devstack sudo[102719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3f17ccc6-cbf4-4cf5-a89b-db9a54b0d8dc Jul 07 08:31:11 devstack sudo[102719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:11 devstack sudo[102719]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-886c2206-75da-4cca-aafd-3b7604814bba tempest-TestInstancesWithCinderVolumes-1289129289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3f17ccc6-cbf4-4cf5-a89b-db9a54b0d8dc" returned: 1 in 0.749s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-886c2206-75da-4cca-aafd-3b7604814bba tempest-TestInstancesWithCinderVolumes-1289129289 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3f17ccc6-cbf4-4cf5-a89b-db9a54b0d8dc' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:31:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-886c2206-75da-4cca-aafd-3b7604814bba tempest-TestInstancesWithCinderVolumes-1289129289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3f17ccc6-cbf4-4cf5-a89b-db9a54b0d8dc {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:11 devstack sudo[102725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3f17ccc6-cbf4-4cf5-a89b-db9a54b0d8dc Jul 07 08:31:11 devstack sudo[102725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:12 devstack sudo[102725]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-886c2206-75da-4cca-aafd-3b7604814bba tempest-TestInstancesWithCinderVolumes-1289129289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3f17ccc6-cbf4-4cf5-a89b-db9a54b0d8dc" returned: 0 in 0.673s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:12 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-886c2206-75da-4cca-aafd-3b7604814bba tempest-TestInstancesWithCinderVolumes-1289129289 None] Lock "cinder-quobyte-3f17ccc6-cbf4-4cf5-a89b-db9a54b0d8dc" released by "delete_volume" :: held 2.266s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:31:12 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:UPDATE=67,cinder:DELETE=3,cinder:SELECT=59,cinder:INSERT=14 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:31:12 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=71,cinder:UPDATE=56,cinder:INSERT=14,cinder:DELETE=4 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:31:12 devstack cinder-volume[87199]: WARNING cinder.quota [None req-886c2206-75da-4cca-aafd-3b7604814bba tempest-TestInstancesWithCinderVolumes-1289129289 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1833859073-1982814372 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1833859073-1982814372, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:31:12 devstack cinder-volume[87199]: WARNING cinder.quota [None req-886c2206-75da-4cca-aafd-3b7604814bba tempest-TestInstancesWithCinderVolumes-1289129289 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1833859073-1982814372 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1833859073-1982814372, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:31:12 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-886c2206-75da-4cca-aafd-3b7604814bba tempest-TestInstancesWithCinderVolumes-1289129289 None] Created reservations ['33888d1e-d751-441e-800b-78964e5bc4d5', '68adce08-5cb4-4bfc-9111-fab8f67d4e72', 'e4680f3a-119d-4d49-8b26-c5abc3eedd9f', '1284142f-5cda-41a1-92c5-2b2a174242e7'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:31:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-886c2206-75da-4cca-aafd-3b7604814bba tempest-TestInstancesWithCinderVolumes-1289129289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:31:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-886c2206-75da-4cca-aafd-3b7604814bba tempest-TestInstancesWithCinderVolumes-1289129289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:31:12 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-886c2206-75da-4cca-aafd-3b7604814bba tempest-TestInstancesWithCinderVolumes-1289129289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:31:12 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-886c2206-75da-4cca-aafd-3b7604814bba tempest-TestInstancesWithCinderVolumes-1289129289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:31:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-886c2206-75da-4cca-aafd-3b7604814bba tempest-TestInstancesWithCinderVolumes-1289129289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:31:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-886c2206-75da-4cca-aafd-3b7604814bba tempest-TestInstancesWithCinderVolumes-1289129289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:12 devstack sudo[102728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:31:12 devstack sudo[102728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:13 devstack sudo[102728]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-886c2206-75da-4cca-aafd-3b7604814bba tempest-TestInstancesWithCinderVolumes-1289129289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.675s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:13 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-886c2206-75da-4cca-aafd-3b7604814bba tempest-TestInstancesWithCinderVolumes-1289129289 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:31:13 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-886c2206-75da-4cca-aafd-3b7604814bba tempest-TestInstancesWithCinderVolumes-1289129289 None] Deleted volume successfully. Jul 07 08:31:13 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-886c2206-75da-4cca-aafd-3b7604814bba tempest-TestInstancesWithCinderVolumes-1289129289 None] Lock "cinder-3f17ccc6-cbf4-4cf5-a89b-db9a54b0d8dc-delete_volume" released by "delete_volume" :: held 3.203s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:31:22 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=4,cinder:INSERT=4,cinder:UPDATE=8 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:31:23 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:UPDATE=7,cinder:SELECT=2,cinder:DELETE=1 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:31:26 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-17ed5463-5aa2-4d0d-b66e-a5a4351cfbe3 tempest-CreateVolumesFromSnapshotTest-573977501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:31:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-17ed5463-5aa2-4d0d-b66e-a5a4351cfbe3 tempest-CreateVolumesFromSnapshotTest-573977501 None] Flow 'volume_create_manager' (85648bf9-e18a-4886-89f5-abded65dcf6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:31:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-17ed5463-5aa2-4d0d-b66e-a5a4351cfbe3 tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a86b4909-0e52-456b-8c5f-64ba2e74f31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-17ed5463-5aa2-4d0d-b66e-a5a4351cfbe3 tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a86b4909-0e52-456b-8c5f-64ba2e74f31f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:31:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1141195661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fff03950-a6c1-41de-8360-d5c34f3977c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c2ccaec17844a4ab885dca8332b666b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:31:27Z,use_quota=True,user_id='558584fe87a44741b29ce6829625d9aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-17ed5463-5aa2-4d0d-b66e-a5a4351cfbe3 tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a602aef-8997-427d-963e-ac5951510a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-17ed5463-5aa2-4d0d-b66e-a5a4351cfbe3 tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a602aef-8997-427d-963e-ac5951510a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-17ed5463-5aa2-4d0d-b66e-a5a4351cfbe3 tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd48a508-6def-4053-9ef7-861bb66a2478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-17ed5463-5aa2-4d0d-b66e-a5a4351cfbe3 tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd48a508-6def-4053-9ef7-861bb66a2478) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fff03950-a6c1-41de-8360-d5c34f3977c6', 'volume_name': 'volume-fff03950-a6c1-41de-8360-d5c34f3977c6', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-17ed5463-5aa2-4d0d-b66e-a5a4351cfbe3 tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a43933c-6214-4309-a74b-34725fddf3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-17ed5463-5aa2-4d0d-b66e-a5a4351cfbe3 tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a43933c-6214-4309-a74b-34725fddf3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-17ed5463-5aa2-4d0d-b66e-a5a4351cfbe3 tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ad401b8-6dcb-4b0a-9cfc-1d246a77bd36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:26 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-17ed5463-5aa2-4d0d-b66e-a5a4351cfbe3 tempest-CreateVolumesFromSnapshotTest-573977501 None] Volume fff03950-a6c1-41de-8360-d5c34f3977c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fff03950-a6c1-41de-8360-d5c34f3977c6', 'volume_size': 1} Jul 07 08:31:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-17ed5463-5aa2-4d0d-b66e-a5a4351cfbe3 tempest-CreateVolumesFromSnapshotTest-573977501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:31:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-17ed5463-5aa2-4d0d-b66e-a5a4351cfbe3 tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:31:26 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-17ed5463-5aa2-4d0d-b66e-a5a4351cfbe3 tempest-CreateVolumesFromSnapshotTest-573977501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:31:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1141195661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fff03950-a6c1-41de-8360-d5c34f3977c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c2ccaec17844a4ab885dca8332b666b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:31:27Z,use_quota=True,user_id='558584fe87a44741b29ce6829625d9aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:31:26 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-17ed5463-5aa2-4d0d-b66e-a5a4351cfbe3 tempest-CreateVolumesFromSnapshotTest-573977501 None] Creating volume fff03950-a6c1-41de-8360-d5c34f3977c6 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:31:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-17ed5463-5aa2-4d0d-b66e-a5a4351cfbe3 tempest-CreateVolumesFromSnapshotTest-573977501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:31:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-17ed5463-5aa2-4d0d-b66e-a5a4351cfbe3 tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:31:26 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-17ed5463-5aa2-4d0d-b66e-a5a4351cfbe3 tempest-CreateVolumesFromSnapshotTest-573977501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:31:26 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-17ed5463-5aa2-4d0d-b66e-a5a4351cfbe3 tempest-CreateVolumesFromSnapshotTest-573977501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:31:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-17ed5463-5aa2-4d0d-b66e-a5a4351cfbe3 tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:31:26 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-17ed5463-5aa2-4d0d-b66e-a5a4351cfbe3 tempest-CreateVolumesFromSnapshotTest-573977501 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:31:26 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-17ed5463-5aa2-4d0d-b66e-a5a4351cfbe3 tempest-CreateVolumesFromSnapshotTest-573977501 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:31:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-17ed5463-5aa2-4d0d-b66e-a5a4351cfbe3 tempest-CreateVolumesFromSnapshotTest-573977501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fff03950-a6c1-41de-8360-d5c34f3977c6 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:26 devstack sudo[102736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fff03950-a6c1-41de-8360-d5c34f3977c6 1073741824 Jul 07 08:31:26 devstack sudo[102736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:27 devstack sudo[102736]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-17ed5463-5aa2-4d0d-b66e-a5a4351cfbe3 tempest-CreateVolumesFromSnapshotTest-573977501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fff03950-a6c1-41de-8360-d5c34f3977c6 1073741824" returned: 0 in 0.884s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-17ed5463-5aa2-4d0d-b66e-a5a4351cfbe3 tempest-CreateVolumesFromSnapshotTest-573977501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fff03950-a6c1-41de-8360-d5c34f3977c6 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:27 devstack sudo[102742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fff03950-a6c1-41de-8360-d5c34f3977c6 Jul 07 08:31:27 devstack sudo[102742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:28 devstack sudo[102742]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-17ed5463-5aa2-4d0d-b66e-a5a4351cfbe3 tempest-CreateVolumesFromSnapshotTest-573977501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fff03950-a6c1-41de-8360-d5c34f3977c6" returned: 0 in 0.672s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:28 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-17ed5463-5aa2-4d0d-b66e-a5a4351cfbe3 tempest-CreateVolumesFromSnapshotTest-573977501 None] <== create_volume: return (1597ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:31:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-17ed5463-5aa2-4d0d-b66e-a5a4351cfbe3 tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.600s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:31:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-17ed5463-5aa2-4d0d-b66e-a5a4351cfbe3 tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ad401b8-6dcb-4b0a-9cfc-1d246a77bd36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fff03950-a6c1-41de-8360-d5c34f3977c6', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-17ed5463-5aa2-4d0d-b66e-a5a4351cfbe3 tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (906e7077-d369-4a53-aca1-fbf1c26871b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:28 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-17ed5463-5aa2-4d0d-b66e-a5a4351cfbe3 tempest-CreateVolumesFromSnapshotTest-573977501 None] Volume volume-fff03950-a6c1-41de-8360-d5c34f3977c6 (fff03950-a6c1-41de-8360-d5c34f3977c6): created successfully Jul 07 08:31:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-17ed5463-5aa2-4d0d-b66e-a5a4351cfbe3 tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (906e7077-d369-4a53-aca1-fbf1c26871b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:28 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-17ed5463-5aa2-4d0d-b66e-a5a4351cfbe3 tempest-CreateVolumesFromSnapshotTest-573977501 None] Flow 'volume_create_manager' (85648bf9-e18a-4886-89f5-abded65dcf6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:31:28 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-17ed5463-5aa2-4d0d-b66e-a5a4351cfbe3 tempest-CreateVolumesFromSnapshotTest-573977501 None] Created volume successfully. Jul 07 08:31:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-2387fcf4-a39c-47fb-ad4b-0333025e1c01 tempest-CreateVolumesFromSnapshotTest-573977501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:31:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-2387fcf4-a39c-47fb-ad4b-0333025e1c01 tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:31:28 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-2387fcf4-a39c-47fb-ad4b-0333025e1c01 tempest-CreateVolumesFromSnapshotTest-573977501 None] Creating offline snapshot 83316f41-88cf-4e42-b6bd-ec62ac6c0fb8 of volume fff03950-a6c1-41de-8360-d5c34f3977c6 {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:31:28 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00492bd-bb23-4940-8fb4-c0453c32d45f]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:31:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-2387fcf4-a39c-47fb-ad4b-0333025e1c01 tempest-CreateVolumesFromSnapshotTest-573977501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fff03950-a6c1-41de-8360-d5c34f3977c6 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:29 devstack sudo[102745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fff03950-a6c1-41de-8360-d5c34f3977c6 Jul 07 08:31:29 devstack sudo[102745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:29 devstack sudo[102745]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-2387fcf4-a39c-47fb-ad4b-0333025e1c01 tempest-CreateVolumesFromSnapshotTest-573977501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fff03950-a6c1-41de-8360-d5c34f3977c6" returned: 0 in 0.883s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-2387fcf4-a39c-47fb-ad4b-0333025e1c01 tempest-CreateVolumesFromSnapshotTest-573977501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fff03950-a6c1-41de-8360-d5c34f3977c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fff03950-a6c1-41de-8360-d5c34f3977c6.83316f41-88cf-4e42-b6bd-ec62ac6c0fb8 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:29 devstack sudo[102750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fff03950-a6c1-41de-8360-d5c34f3977c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fff03950-a6c1-41de-8360-d5c34f3977c6.83316f41-88cf-4e42-b6bd-ec62ac6c0fb8 1G Jul 07 08:31:29 devstack sudo[102750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:30 devstack sudo[102750]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-2387fcf4-a39c-47fb-ad4b-0333025e1c01 tempest-CreateVolumesFromSnapshotTest-573977501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fff03950-a6c1-41de-8360-d5c34f3977c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fff03950-a6c1-41de-8360-d5c34f3977c6.83316f41-88cf-4e42-b6bd-ec62ac6c0fb8 1G" returned: 0 in 0.820s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-2387fcf4-a39c-47fb-ad4b-0333025e1c01 tempest-CreateVolumesFromSnapshotTest-573977501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fff03950-a6c1-41de-8360-d5c34f3977c6 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fff03950-a6c1-41de-8360-d5c34f3977c6.83316f41-88cf-4e42-b6bd-ec62ac6c0fb8 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:30 devstack sudo[102756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fff03950-a6c1-41de-8360-d5c34f3977c6 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fff03950-a6c1-41de-8360-d5c34f3977c6.83316f41-88cf-4e42-b6bd-ec62ac6c0fb8 Jul 07 08:31:30 devstack sudo[102756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:31 devstack sudo[102756]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-2387fcf4-a39c-47fb-ad4b-0333025e1c01 tempest-CreateVolumesFromSnapshotTest-573977501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fff03950-a6c1-41de-8360-d5c34f3977c6 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fff03950-a6c1-41de-8360-d5c34f3977c6.83316f41-88cf-4e42-b6bd-ec62ac6c0fb8" returned: 0 in 0.728s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:31 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-2387fcf4-a39c-47fb-ad4b-0333025e1c01 tempest-CreateVolumesFromSnapshotTest-573977501 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fff03950-a6c1-41de-8360-d5c34f3977c6.83316f41-88cf-4e42-b6bd-ec62ac6c0fb8 is being set with open permissions: ugo+rw Jul 07 08:31:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-2387fcf4-a39c-47fb-ad4b-0333025e1c01 tempest-CreateVolumesFromSnapshotTest-573977501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fff03950-a6c1-41de-8360-d5c34f3977c6.83316f41-88cf-4e42-b6bd-ec62ac6c0fb8 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:31 devstack sudo[102762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fff03950-a6c1-41de-8360-d5c34f3977c6.83316f41-88cf-4e42-b6bd-ec62ac6c0fb8 Jul 07 08:31:31 devstack sudo[102762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:32 devstack sudo[102762]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-2387fcf4-a39c-47fb-ad4b-0333025e1c01 tempest-CreateVolumesFromSnapshotTest-573977501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fff03950-a6c1-41de-8360-d5c34f3977c6.83316f41-88cf-4e42-b6bd-ec62ac6c0fb8" returned: 0 in 0.671s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-2387fcf4-a39c-47fb-ad4b-0333025e1c01 tempest-CreateVolumesFromSnapshotTest-573977501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fff03950-a6c1-41de-8360-d5c34f3977c6.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:32 devstack sudo[102765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fff03950-a6c1-41de-8360-d5c34f3977c6.info Jul 07 08:31:32 devstack sudo[102765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:32 devstack sudo[102765]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-2387fcf4-a39c-47fb-ad4b-0333025e1c01 tempest-CreateVolumesFromSnapshotTest-573977501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fff03950-a6c1-41de-8360-d5c34f3977c6.info" returned: 0 in 0.714s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:32 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-2387fcf4-a39c-47fb-ad4b-0333025e1c01 tempest-CreateVolumesFromSnapshotTest-573977501 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fff03950-a6c1-41de-8360-d5c34f3977c6.info is being set with open permissions: ugo+rw Jul 07 08:31:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-2387fcf4-a39c-47fb-ad4b-0333025e1c01 tempest-CreateVolumesFromSnapshotTest-573977501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fff03950-a6c1-41de-8360-d5c34f3977c6.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:32 devstack sudo[102768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fff03950-a6c1-41de-8360-d5c34f3977c6.info Jul 07 08:31:32 devstack sudo[102768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:33 devstack sudo[102768]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-2387fcf4-a39c-47fb-ad4b-0333025e1c01 tempest-CreateVolumesFromSnapshotTest-573977501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fff03950-a6c1-41de-8360-d5c34f3977c6.info" returned: 0 in 0.687s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-2387fcf4-a39c-47fb-ad4b-0333025e1c01 tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.627s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:31:33 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-2387fcf4-a39c-47fb-ad4b-0333025e1c01 tempest-CreateVolumesFromSnapshotTest-573977501 None] Create snapshot completed successfully Jul 07 08:31:33 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:31:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] Flow 'volume_create_manager' (271543a1-2462-481f-b59c-890920e5578d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:31:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b235678-3a79-46c0-b2ed-801537848f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b235678-3a79-46c0-b2ed-801537848f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:31:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1676672645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='594d3ec461f341dbaf56ca0e8531f2d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:31:34Z,use_quota=True,user_id='28e8f64c98234a9baa3d1f61236a6ed7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dde51897-ab32-4d02-815c-6035ec93cb20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dde51897-ab32-4d02-815c-6035ec93cb20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41c0ec30-d047-45ed-bb8e-7be6a072e93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:33 devstack cinder-volume[87199]: DEBUG cinder.image.glance [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] Creating Keystone auth plugin from conf {{(pid=87199) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 08:31:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41c0ec30-d047-45ed-bb8e-7be6a072e93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599', 'volume_name': 'volume-1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599', 'volume_size': 1, 'image_id': '276bad5d-feb0-4ba2-a219-18ecf721ff14', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/276bad5d-feb0-4ba2-a219-18ecf721ff14', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '616624e32aa447818ca627e0bb0985c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '276bad5d-feb0-4ba2-a219-18ecf721ff14', 'created_at': datetime.datetime(2026, 7, 7, 6, 6, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 6, 6, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/276bad5d-feb0-4ba2-a219-18ecf721ff14/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (888d794f-2718-4f4e-90bd-ba30b00b6f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (888d794f-2718-4f4e-90bd-ba30b00b6f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85acda6f-cfb1-433f-bbdb-857a7646408c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:34 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] Volume 1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599', 'volume_size': 1, 'image_id': '276bad5d-feb0-4ba2-a219-18ecf721ff14', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/276bad5d-feb0-4ba2-a219-18ecf721ff14', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '616624e32aa447818ca627e0bb0985c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '276bad5d-feb0-4ba2-a219-18ecf721ff14', 'created_at': datetime.datetime(2026, 7, 7, 6, 6, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 6, 6, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/276bad5d-feb0-4ba2-a219-18ecf721ff14/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 07 08:31:34 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] Trying to clone 1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599 from image 276bad5d-feb0-4ba2-a219-18ecf721ff14 at location (None, [{'url': 'file:///opt/stack/data/glance/images/276bad5d-feb0-4ba2-a219-18ecf721ff14', 'metadata': {}}]). {{(pid=87199) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 08:31:34 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_276bad5d-feb0-4ba2-a219-18ecf721ff14_msp087b1devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87199) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 08:31:34 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] Image download 20.69 MB at 20.69 MB/s Jul 07 08:31:34 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1aca05-d9c5-4c36-b234-da4ee78afe7a]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:31:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_276bad5d-feb0-4ba2-a219-18ecf721ff14_msp087b1devstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:34 devstack sudo[102772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_276bad5d-feb0-4ba2-a219-18ecf721ff14_msp087b1devstack@QuobyteHD Jul 07 08:31:34 devstack sudo[102772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:34 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c7262cc-6224-4a21-af25-cf2fe91f91ab tempest-CreateVolumesFromSnapshotTest-573977501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:31:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-0c7262cc-6224-4a21-af25-cf2fe91f91ab tempest-CreateVolumesFromSnapshotTest-573977501 None] Flow 'volume_create_manager' (2c971620-595d-424a-81cd-780c938d50b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:31:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-0c7262cc-6224-4a21-af25-cf2fe91f91ab tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32ed47c5-4d33-4404-8b20-68a5a48d7a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-0c7262cc-6224-4a21-af25-cf2fe91f91ab tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32ed47c5-4d33-4404-8b20-68a5a48d7a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:31:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1099265777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8a65121-dc2d-40a2-ba6f-f4df5482455e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c2ccaec17844a4ab885dca8332b666b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:31:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:31:35Z,use_quota=True,user_id='558584fe87a44741b29ce6829625d9aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-0c7262cc-6224-4a21-af25-cf2fe91f91ab tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2eb987b-8bd7-441d-9aef-d9f25b9224e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-0c7262cc-6224-4a21-af25-cf2fe91f91ab tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2eb987b-8bd7-441d-9aef-d9f25b9224e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-0c7262cc-6224-4a21-af25-cf2fe91f91ab tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35b39da0-bf9d-4751-b39b-f929dc0f2bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-0c7262cc-6224-4a21-af25-cf2fe91f91ab tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35b39da0-bf9d-4751-b39b-f929dc0f2bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8a65121-dc2d-40a2-ba6f-f4df5482455e', 'volume_name': 'volume-c8a65121-dc2d-40a2-ba6f-f4df5482455e', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-0c7262cc-6224-4a21-af25-cf2fe91f91ab tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7961fb5a-5d8b-49fb-abaa-6951e8ed8d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-0c7262cc-6224-4a21-af25-cf2fe91f91ab tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7961fb5a-5d8b-49fb-abaa-6951e8ed8d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-0c7262cc-6224-4a21-af25-cf2fe91f91ab tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f11a92b5-071d-4fa2-91c2-9568458e60b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:34 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-0c7262cc-6224-4a21-af25-cf2fe91f91ab tempest-CreateVolumesFromSnapshotTest-573977501 None] Volume c8a65121-dc2d-40a2-ba6f-f4df5482455e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8a65121-dc2d-40a2-ba6f-f4df5482455e', 'volume_size': 1} Jul 07 08:31:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0c7262cc-6224-4a21-af25-cf2fe91f91ab tempest-CreateVolumesFromSnapshotTest-573977501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:31:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0c7262cc-6224-4a21-af25-cf2fe91f91ab tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:31:34 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-0c7262cc-6224-4a21-af25-cf2fe91f91ab tempest-CreateVolumesFromSnapshotTest-573977501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:31:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1099265777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8a65121-dc2d-40a2-ba6f-f4df5482455e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c2ccaec17844a4ab885dca8332b666b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:31:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:31:35Z,use_quota=True,user_id='558584fe87a44741b29ce6829625d9aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:31:34 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-0c7262cc-6224-4a21-af25-cf2fe91f91ab tempest-CreateVolumesFromSnapshotTest-573977501 None] Creating volume c8a65121-dc2d-40a2-ba6f-f4df5482455e {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:31:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0c7262cc-6224-4a21-af25-cf2fe91f91ab tempest-CreateVolumesFromSnapshotTest-573977501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:31:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0c7262cc-6224-4a21-af25-cf2fe91f91ab tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:31:34 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-0c7262cc-6224-4a21-af25-cf2fe91f91ab tempest-CreateVolumesFromSnapshotTest-573977501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:31:34 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-0c7262cc-6224-4a21-af25-cf2fe91f91ab tempest-CreateVolumesFromSnapshotTest-573977501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:31:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0c7262cc-6224-4a21-af25-cf2fe91f91ab tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:31:34 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-0c7262cc-6224-4a21-af25-cf2fe91f91ab tempest-CreateVolumesFromSnapshotTest-573977501 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:31:34 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-0c7262cc-6224-4a21-af25-cf2fe91f91ab tempest-CreateVolumesFromSnapshotTest-573977501 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:31:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0c7262cc-6224-4a21-af25-cf2fe91f91ab tempest-CreateVolumesFromSnapshotTest-573977501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c8a65121-dc2d-40a2-ba6f-f4df5482455e 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:34 devstack sudo[102808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c8a65121-dc2d-40a2-ba6f-f4df5482455e 1073741824 Jul 07 08:31:34 devstack sudo[102808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:35 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-93978b63-e77e-4011-b8b3-c5aa41888692 tempest-CreateVolumesFromSnapshotTest-573977501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:31:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-93978b63-e77e-4011-b8b3-c5aa41888692 tempest-CreateVolumesFromSnapshotTest-573977501 None] Flow 'volume_create_manager' (ee31b38f-0146-4eb5-a53a-b45fddf43418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:31:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-93978b63-e77e-4011-b8b3-c5aa41888692 tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31279b8a-6a79-48b6-bc44-aed617fddca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-93978b63-e77e-4011-b8b3-c5aa41888692 tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31279b8a-6a79-48b6-bc44-aed617fddca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1966943912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d92807a-6165-434f-95f7-c7b176f32e89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c2ccaec17844a4ab885dca8332b666b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:31:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:31:35Z,use_quota=True,user_id='558584fe87a44741b29ce6829625d9aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-93978b63-e77e-4011-b8b3-c5aa41888692 tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58fa32b8-e1ba-4254-924b-55b955d08111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-93978b63-e77e-4011-b8b3-c5aa41888692 tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58fa32b8-e1ba-4254-924b-55b955d08111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-93978b63-e77e-4011-b8b3-c5aa41888692 tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (626e11b2-631e-442e-92b3-b06a3cef8e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-93978b63-e77e-4011-b8b3-c5aa41888692 tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (626e11b2-631e-442e-92b3-b06a3cef8e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d92807a-6165-434f-95f7-c7b176f32e89', 'volume_name': 'volume-7d92807a-6165-434f-95f7-c7b176f32e89', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-93978b63-e77e-4011-b8b3-c5aa41888692 tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d36fc58a-d7e6-4cd5-8609-155e13851ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-93978b63-e77e-4011-b8b3-c5aa41888692 tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d36fc58a-d7e6-4cd5-8609-155e13851ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:35 devstack sudo[102772]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-93978b63-e77e-4011-b8b3-c5aa41888692 tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00603bec-1d96-4f79-a7ac-f1b2beb29ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:35 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-93978b63-e77e-4011-b8b3-c5aa41888692 tempest-CreateVolumesFromSnapshotTest-573977501 None] Volume 7d92807a-6165-434f-95f7-c7b176f32e89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d92807a-6165-434f-95f7-c7b176f32e89', 'volume_size': 1} Jul 07 08:31:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-93978b63-e77e-4011-b8b3-c5aa41888692 tempest-CreateVolumesFromSnapshotTest-573977501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:31:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_276bad5d-feb0-4ba2-a219-18ecf721ff14_msp087b1devstack@QuobyteHD" returned: 0 in 0.995s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:35 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] Temporary image 276bad5d-feb0-4ba2-a219-18ecf721ff14 is fetched for user 28e8f64c98234a9baa3d1f61236a6ed7. {{(pid=87199) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 08:31:35 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[099a4d83-63b3-438e-8cdb-45be911068f1]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:31:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_276bad5d-feb0-4ba2-a219-18ecf721ff14_msp087b1devstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:35 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-59b3eb9e-ffad-4600-a4cd-e680fc5fba27 tempest-CreateVolumesFromSnapshotTest-573977501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:31:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-59b3eb9e-ffad-4600-a4cd-e680fc5fba27 tempest-CreateVolumesFromSnapshotTest-573977501 None] Flow 'volume_create_manager' (f041948f-3ec0-4af2-81cf-75480806270c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:31:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-59b3eb9e-ffad-4600-a4cd-e680fc5fba27 tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fc58cf2-a324-4b06-880e-ea7e0660fc30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:35 devstack sudo[102818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_276bad5d-feb0-4ba2-a219-18ecf721ff14_msp087b1devstack@QuobyteHD Jul 07 08:31:35 devstack sudo[102818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-59b3eb9e-ffad-4600-a4cd-e680fc5fba27 tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fc58cf2-a324-4b06-880e-ea7e0660fc30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-857763419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a064d54-1249-402e-943c-d8bcd90e0324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c2ccaec17844a4ab885dca8332b666b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:31:36Z,use_quota=True,user_id='558584fe87a44741b29ce6829625d9aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-59b3eb9e-ffad-4600-a4cd-e680fc5fba27 tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (215b3e0d-e8ad-4146-b8a8-5c67ca63a848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-59b3eb9e-ffad-4600-a4cd-e680fc5fba27 tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (215b3e0d-e8ad-4146-b8a8-5c67ca63a848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-59b3eb9e-ffad-4600-a4cd-e680fc5fba27 tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20b3caae-326a-4bfe-bbbc-a492eaeb40ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-59b3eb9e-ffad-4600-a4cd-e680fc5fba27 tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20b3caae-326a-4bfe-bbbc-a492eaeb40ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a064d54-1249-402e-943c-d8bcd90e0324', 'volume_name': 'volume-9a064d54-1249-402e-943c-d8bcd90e0324', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-59b3eb9e-ffad-4600-a4cd-e680fc5fba27 tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57232743-fb85-478a-8b71-8cb3854bf6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-59b3eb9e-ffad-4600-a4cd-e680fc5fba27 tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57232743-fb85-478a-8b71-8cb3854bf6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-59b3eb9e-ffad-4600-a4cd-e680fc5fba27 tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf2b0f35-8022-4b8e-876f-f845ce84fa74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:35 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-59b3eb9e-ffad-4600-a4cd-e680fc5fba27 tempest-CreateVolumesFromSnapshotTest-573977501 None] Volume 9a064d54-1249-402e-943c-d8bcd90e0324: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a064d54-1249-402e-943c-d8bcd90e0324', 'volume_size': 1} Jul 07 08:31:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-59b3eb9e-ffad-4600-a4cd-e680fc5fba27 tempest-CreateVolumesFromSnapshotTest-573977501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:31:35 devstack sudo[102808]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0c7262cc-6224-4a21-af25-cf2fe91f91ab tempest-CreateVolumesFromSnapshotTest-573977501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c8a65121-dc2d-40a2-ba6f-f4df5482455e 1073741824" returned: 0 in 1.083s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0c7262cc-6224-4a21-af25-cf2fe91f91ab tempest-CreateVolumesFromSnapshotTest-573977501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c8a65121-dc2d-40a2-ba6f-f4df5482455e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:35 devstack sudo[102821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c8a65121-dc2d-40a2-ba6f-f4df5482455e Jul 07 08:31:35 devstack sudo[102821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:36 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ce4b2e9-a98b-42e3-b1ae-eeffca14ba00 tempest-CreateVolumesFromSnapshotTest-573977501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:31:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2ce4b2e9-a98b-42e3-b1ae-eeffca14ba00 tempest-CreateVolumesFromSnapshotTest-573977501 None] Flow 'volume_create_manager' (8ca5f73c-cc22-4df7-8901-774366b1c901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:31:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2ce4b2e9-a98b-42e3-b1ae-eeffca14ba00 tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c8f04e8-dce4-47db-ab9b-6ea20bf2b6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2ce4b2e9-a98b-42e3-b1ae-eeffca14ba00 tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c8f04e8-dce4-47db-ab9b-6ea20bf2b6fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:31:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-608442372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f69b90b6-0e73-44ac-8d3d-755768231797,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c2ccaec17844a4ab885dca8332b666b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:31:36Z,use_quota=True,user_id='558584fe87a44741b29ce6829625d9aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2ce4b2e9-a98b-42e3-b1ae-eeffca14ba00 tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea8ac8c2-b00e-4f04-9581-394230b9c4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2ce4b2e9-a98b-42e3-b1ae-eeffca14ba00 tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea8ac8c2-b00e-4f04-9581-394230b9c4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2ce4b2e9-a98b-42e3-b1ae-eeffca14ba00 tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cb58dbf-1bf9-4ce0-bbb5-31d795cb3dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2ce4b2e9-a98b-42e3-b1ae-eeffca14ba00 tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cb58dbf-1bf9-4ce0-bbb5-31d795cb3dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f69b90b6-0e73-44ac-8d3d-755768231797', 'volume_name': 'volume-f69b90b6-0e73-44ac-8d3d-755768231797', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2ce4b2e9-a98b-42e3-b1ae-eeffca14ba00 tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7d137c5-f9e7-4c9d-8316-bf1886835d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2ce4b2e9-a98b-42e3-b1ae-eeffca14ba00 tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7d137c5-f9e7-4c9d-8316-bf1886835d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2ce4b2e9-a98b-42e3-b1ae-eeffca14ba00 tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4546f0a3-7765-426a-be60-7d0680e19f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:36 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-2ce4b2e9-a98b-42e3-b1ae-eeffca14ba00 tempest-CreateVolumesFromSnapshotTest-573977501 None] Volume f69b90b6-0e73-44ac-8d3d-755768231797: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f69b90b6-0e73-44ac-8d3d-755768231797', 'volume_size': 1} Jul 07 08:31:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-2ce4b2e9-a98b-42e3-b1ae-eeffca14ba00 tempest-CreateVolumesFromSnapshotTest-573977501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:31:36 devstack sudo[102818]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_276bad5d-feb0-4ba2-a219-18ecf721ff14_msp087b1devstack@QuobyteHD" returned: 0 in 1.066s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:31:36 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-30c3bc98-1c22-4470-9e6e-557dbb9ece27 tempest-CreateVolumesFromSnapshotTest-573977501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:31:36 devstack sudo[102821]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-30c3bc98-1c22-4470-9e6e-557dbb9ece27 tempest-CreateVolumesFromSnapshotTest-573977501 None] Flow 'volume_create_manager' (d02cb283-5fe1-4026-b547-80ee75b48507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:31:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-30c3bc98-1c22-4470-9e6e-557dbb9ece27 tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbb1c7f4-3e09-4b12-a8db-59f270a04ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0c7262cc-6224-4a21-af25-cf2fe91f91ab tempest-CreateVolumesFromSnapshotTest-573977501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c8a65121-dc2d-40a2-ba6f-f4df5482455e" returned: 0 in 0.765s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-0c7262cc-6224-4a21-af25-cf2fe91f91ab tempest-CreateVolumesFromSnapshotTest-573977501 None] <== create_volume: return (1900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:31:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0c7262cc-6224-4a21-af25-cf2fe91f91ab tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.903s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:31:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-93978b63-e77e-4011-b8b3-c5aa41888692 tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.263s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:31:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-93978b63-e77e-4011-b8b3-c5aa41888692 tempest-CreateVolumesFromSnapshotTest-573977501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1966943912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d92807a-6165-434f-95f7-c7b176f32e89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c2ccaec17844a4ab885dca8332b666b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:31:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:31:35Z,use_quota=True,user_id='558584fe87a44741b29ce6829625d9aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:31:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-93978b63-e77e-4011-b8b3-c5aa41888692 tempest-CreateVolumesFromSnapshotTest-573977501 None] Creating volume 7d92807a-6165-434f-95f7-c7b176f32e89 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:31:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-93978b63-e77e-4011-b8b3-c5aa41888692 tempest-CreateVolumesFromSnapshotTest-573977501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:31:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-93978b63-e77e-4011-b8b3-c5aa41888692 tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:31:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-93978b63-e77e-4011-b8b3-c5aa41888692 tempest-CreateVolumesFromSnapshotTest-573977501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:31:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-93978b63-e77e-4011-b8b3-c5aa41888692 tempest-CreateVolumesFromSnapshotTest-573977501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:31:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-93978b63-e77e-4011-b8b3-c5aa41888692 tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:31:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-93978b63-e77e-4011-b8b3-c5aa41888692 tempest-CreateVolumesFromSnapshotTest-573977501 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:31:36 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-93978b63-e77e-4011-b8b3-c5aa41888692 tempest-CreateVolumesFromSnapshotTest-573977501 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:31:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-93978b63-e77e-4011-b8b3-c5aa41888692 tempest-CreateVolumesFromSnapshotTest-573977501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7d92807a-6165-434f-95f7-c7b176f32e89 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-30c3bc98-1c22-4470-9e6e-557dbb9ece27 tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbb1c7f4-3e09-4b12-a8db-59f270a04ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:31:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-883674202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8192fab9-35b2-4eb2-8ea2-1b6a625f91ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c2ccaec17844a4ab885dca8332b666b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:31:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:31:37Z,use_quota=True,user_id='558584fe87a44741b29ce6829625d9aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-30c3bc98-1c22-4470-9e6e-557dbb9ece27 tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (892a59a5-56a8-4990-a7d6-5ab25fc0c202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:36 devstack sudo[102829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7d92807a-6165-434f-95f7-c7b176f32e89 1073741824 Jul 07 08:31:36 devstack sudo[102829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-30c3bc98-1c22-4470-9e6e-557dbb9ece27 tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (892a59a5-56a8-4990-a7d6-5ab25fc0c202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-30c3bc98-1c22-4470-9e6e-557dbb9ece27 tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ba2cff7-fff5-46ba-a59f-aeb53c65ea65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-30c3bc98-1c22-4470-9e6e-557dbb9ece27 tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ba2cff7-fff5-46ba-a59f-aeb53c65ea65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8192fab9-35b2-4eb2-8ea2-1b6a625f91ec', 'volume_name': 'volume-8192fab9-35b2-4eb2-8ea2-1b6a625f91ec', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-30c3bc98-1c22-4470-9e6e-557dbb9ece27 tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb05f751-406f-491a-8bc2-40ab1bba7755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-30c3bc98-1c22-4470-9e6e-557dbb9ece27 tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb05f751-406f-491a-8bc2-40ab1bba7755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-30c3bc98-1c22-4470-9e6e-557dbb9ece27 tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63320c3d-fe53-4e55-86c8-f9d9a4e41ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:36 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-30c3bc98-1c22-4470-9e6e-557dbb9ece27 tempest-CreateVolumesFromSnapshotTest-573977501 None] Volume 8192fab9-35b2-4eb2-8ea2-1b6a625f91ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8192fab9-35b2-4eb2-8ea2-1b6a625f91ec', 'volume_size': 1} Jul 07 08:31:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-30c3bc98-1c22-4470-9e6e-557dbb9ece27 tempest-CreateVolumesFromSnapshotTest-573977501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:31:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-0c7262cc-6224-4a21-af25-cf2fe91f91ab tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f11a92b5-071d-4fa2-91c2-9568458e60b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8a65121-dc2d-40a2-ba6f-f4df5482455e', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-0c7262cc-6224-4a21-af25-cf2fe91f91ab tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d270a76-20d5-47f0-ab2f-719c8f55f3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:36 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-0c7262cc-6224-4a21-af25-cf2fe91f91ab tempest-CreateVolumesFromSnapshotTest-573977501 None] Volume volume-c8a65121-dc2d-40a2-ba6f-f4df5482455e (c8a65121-dc2d-40a2-ba6f-f4df5482455e): created successfully Jul 07 08:31:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-0c7262cc-6224-4a21-af25-cf2fe91f91ab tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d270a76-20d5-47f0-ab2f-719c8f55f3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:36 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-0c7262cc-6224-4a21-af25-cf2fe91f91ab tempest-CreateVolumesFromSnapshotTest-573977501 None] Flow 'volume_create_manager' (2c971620-595d-424a-81cd-780c938d50b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:31:36 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-0c7262cc-6224-4a21-af25-cf2fe91f91ab tempest-CreateVolumesFromSnapshotTest-573977501 None] Created volume successfully. Jul 07 08:31:37 devstack sudo[102829]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-93978b63-e77e-4011-b8b3-c5aa41888692 tempest-CreateVolumesFromSnapshotTest-573977501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7d92807a-6165-434f-95f7-c7b176f32e89 1073741824" returned: 0 in 0.830s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-93978b63-e77e-4011-b8b3-c5aa41888692 tempest-CreateVolumesFromSnapshotTest-573977501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7d92807a-6165-434f-95f7-c7b176f32e89 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:37 devstack sudo[102835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7d92807a-6165-434f-95f7-c7b176f32e89 Jul 07 08:31:37 devstack sudo[102835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:38 devstack sudo[102835]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-93978b63-e77e-4011-b8b3-c5aa41888692 tempest-CreateVolumesFromSnapshotTest-573977501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7d92807a-6165-434f-95f7-c7b176f32e89" returned: 0 in 0.618s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:38 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-93978b63-e77e-4011-b8b3-c5aa41888692 tempest-CreateVolumesFromSnapshotTest-573977501 None] <== create_volume: return (1492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:31:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-93978b63-e77e-4011-b8b3-c5aa41888692 tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:31:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-59b3eb9e-ffad-4600-a4cd-e680fc5fba27 tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.353s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:31:38 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-59b3eb9e-ffad-4600-a4cd-e680fc5fba27 tempest-CreateVolumesFromSnapshotTest-573977501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-857763419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a064d54-1249-402e-943c-d8bcd90e0324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c2ccaec17844a4ab885dca8332b666b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:31:36Z,use_quota=True,user_id='558584fe87a44741b29ce6829625d9aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:31:38 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-59b3eb9e-ffad-4600-a4cd-e680fc5fba27 tempest-CreateVolumesFromSnapshotTest-573977501 None] Creating volume 9a064d54-1249-402e-943c-d8bcd90e0324 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:31:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-59b3eb9e-ffad-4600-a4cd-e680fc5fba27 tempest-CreateVolumesFromSnapshotTest-573977501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:31:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-59b3eb9e-ffad-4600-a4cd-e680fc5fba27 tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:31:38 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-59b3eb9e-ffad-4600-a4cd-e680fc5fba27 tempest-CreateVolumesFromSnapshotTest-573977501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:31:38 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-59b3eb9e-ffad-4600-a4cd-e680fc5fba27 tempest-CreateVolumesFromSnapshotTest-573977501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:31:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-59b3eb9e-ffad-4600-a4cd-e680fc5fba27 tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:31:38 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-59b3eb9e-ffad-4600-a4cd-e680fc5fba27 tempest-CreateVolumesFromSnapshotTest-573977501 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:31:38 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-59b3eb9e-ffad-4600-a4cd-e680fc5fba27 tempest-CreateVolumesFromSnapshotTest-573977501 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:31:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-59b3eb9e-ffad-4600-a4cd-e680fc5fba27 tempest-CreateVolumesFromSnapshotTest-573977501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-9a064d54-1249-402e-943c-d8bcd90e0324 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:38 devstack sudo[102838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-9a064d54-1249-402e-943c-d8bcd90e0324 1073741824 Jul 07 08:31:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-93978b63-e77e-4011-b8b3-c5aa41888692 tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00603bec-1d96-4f79-a7ac-f1b2beb29ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d92807a-6165-434f-95f7-c7b176f32e89', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:38 devstack sudo[102838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-93978b63-e77e-4011-b8b3-c5aa41888692 tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7f2fcf1-0ee6-4bfd-9bad-dd6eea87a715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:38 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-93978b63-e77e-4011-b8b3-c5aa41888692 tempest-CreateVolumesFromSnapshotTest-573977501 None] Volume volume-7d92807a-6165-434f-95f7-c7b176f32e89 (7d92807a-6165-434f-95f7-c7b176f32e89): created successfully Jul 07 08:31:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-93978b63-e77e-4011-b8b3-c5aa41888692 tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7f2fcf1-0ee6-4bfd-9bad-dd6eea87a715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-93978b63-e77e-4011-b8b3-c5aa41888692 tempest-CreateVolumesFromSnapshotTest-573977501 None] Flow 'volume_create_manager' (ee31b38f-0146-4eb5-a53a-b45fddf43418) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:31:38 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-93978b63-e77e-4011-b8b3-c5aa41888692 tempest-CreateVolumesFromSnapshotTest-573977501 None] Created volume successfully. Jul 07 08:31:38 devstack sudo[102838]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-59b3eb9e-ffad-4600-a4cd-e680fc5fba27 tempest-CreateVolumesFromSnapshotTest-573977501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-9a064d54-1249-402e-943c-d8bcd90e0324 1073741824" returned: 0 in 0.794s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-59b3eb9e-ffad-4600-a4cd-e680fc5fba27 tempest-CreateVolumesFromSnapshotTest-573977501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-9a064d54-1249-402e-943c-d8bcd90e0324 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:39 devstack sudo[102843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-9a064d54-1249-402e-943c-d8bcd90e0324 Jul 07 08:31:39 devstack sudo[102843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:39 devstack sudo[102843]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-59b3eb9e-ffad-4600-a4cd-e680fc5fba27 tempest-CreateVolumesFromSnapshotTest-573977501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-9a064d54-1249-402e-943c-d8bcd90e0324" returned: 0 in 0.660s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:39 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-59b3eb9e-ffad-4600-a4cd-e680fc5fba27 tempest-CreateVolumesFromSnapshotTest-573977501 None] <== create_volume: return (1494ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:31:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-59b3eb9e-ffad-4600-a4cd-e680fc5fba27 tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:31:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-2ce4b2e9-a98b-42e3-b1ae-eeffca14ba00 tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.371s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:31:39 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-2ce4b2e9-a98b-42e3-b1ae-eeffca14ba00 tempest-CreateVolumesFromSnapshotTest-573977501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:31:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-608442372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f69b90b6-0e73-44ac-8d3d-755768231797,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c2ccaec17844a4ab885dca8332b666b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:31:36Z,use_quota=True,user_id='558584fe87a44741b29ce6829625d9aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:31:39 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-2ce4b2e9-a98b-42e3-b1ae-eeffca14ba00 tempest-CreateVolumesFromSnapshotTest-573977501 None] Creating volume f69b90b6-0e73-44ac-8d3d-755768231797 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:31:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-2ce4b2e9-a98b-42e3-b1ae-eeffca14ba00 tempest-CreateVolumesFromSnapshotTest-573977501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:31:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-2ce4b2e9-a98b-42e3-b1ae-eeffca14ba00 tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:31:39 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-2ce4b2e9-a98b-42e3-b1ae-eeffca14ba00 tempest-CreateVolumesFromSnapshotTest-573977501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:31:39 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-2ce4b2e9-a98b-42e3-b1ae-eeffca14ba00 tempest-CreateVolumesFromSnapshotTest-573977501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:31:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-2ce4b2e9-a98b-42e3-b1ae-eeffca14ba00 tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:31:39 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-2ce4b2e9-a98b-42e3-b1ae-eeffca14ba00 tempest-CreateVolumesFromSnapshotTest-573977501 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:31:39 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-2ce4b2e9-a98b-42e3-b1ae-eeffca14ba00 tempest-CreateVolumesFromSnapshotTest-573977501 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:31:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-2ce4b2e9-a98b-42e3-b1ae-eeffca14ba00 tempest-CreateVolumesFromSnapshotTest-573977501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f69b90b6-0e73-44ac-8d3d-755768231797 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:39 devstack sudo[102846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f69b90b6-0e73-44ac-8d3d-755768231797 1073741824 Jul 07 08:31:39 devstack sudo[102846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-59b3eb9e-ffad-4600-a4cd-e680fc5fba27 tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf2b0f35-8022-4b8e-876f-f845ce84fa74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a064d54-1249-402e-943c-d8bcd90e0324', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-59b3eb9e-ffad-4600-a4cd-e680fc5fba27 tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0df81b2-42d8-4929-81f2-972680d700bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:39 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-59b3eb9e-ffad-4600-a4cd-e680fc5fba27 tempest-CreateVolumesFromSnapshotTest-573977501 None] Volume volume-9a064d54-1249-402e-943c-d8bcd90e0324 (9a064d54-1249-402e-943c-d8bcd90e0324): created successfully Jul 07 08:31:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-59b3eb9e-ffad-4600-a4cd-e680fc5fba27 tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0df81b2-42d8-4929-81f2-972680d700bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:39 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-59b3eb9e-ffad-4600-a4cd-e680fc5fba27 tempest-CreateVolumesFromSnapshotTest-573977501 None] Flow 'volume_create_manager' (f041948f-3ec0-4af2-81cf-75480806270c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:31:39 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-59b3eb9e-ffad-4600-a4cd-e680fc5fba27 tempest-CreateVolumesFromSnapshotTest-573977501 None] Created volume successfully. Jul 07 08:31:40 devstack sudo[102846]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-2ce4b2e9-a98b-42e3-b1ae-eeffca14ba00 tempest-CreateVolumesFromSnapshotTest-573977501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f69b90b6-0e73-44ac-8d3d-755768231797 1073741824" returned: 0 in 0.786s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-2ce4b2e9-a98b-42e3-b1ae-eeffca14ba00 tempest-CreateVolumesFromSnapshotTest-573977501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f69b90b6-0e73-44ac-8d3d-755768231797 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:40 devstack sudo[102851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f69b90b6-0e73-44ac-8d3d-755768231797 Jul 07 08:31:40 devstack sudo[102851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:41 devstack sudo[102851]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-2ce4b2e9-a98b-42e3-b1ae-eeffca14ba00 tempest-CreateVolumesFromSnapshotTest-573977501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f69b90b6-0e73-44ac-8d3d-755768231797" returned: 0 in 0.669s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:41 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-2ce4b2e9-a98b-42e3-b1ae-eeffca14ba00 tempest-CreateVolumesFromSnapshotTest-573977501 None] <== create_volume: return (1496ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:31:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-2ce4b2e9-a98b-42e3-b1ae-eeffca14ba00 tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.499s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:31:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.571s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:31:41 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:31:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1676672645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='594d3ec461f341dbaf56ca0e8531f2d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:31:34Z,use_quota=True,user_id='28e8f64c98234a9baa3d1f61236a6ed7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:31:41 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] Creating volume 1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:31:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:31:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:31:41 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:31:41 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:31:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:31:41 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:31:41 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:31:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:41 devstack sudo[102855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599 1073741824 Jul 07 08:31:41 devstack sudo[102855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2ce4b2e9-a98b-42e3-b1ae-eeffca14ba00 tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4546f0a3-7765-426a-be60-7d0680e19f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f69b90b6-0e73-44ac-8d3d-755768231797', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2ce4b2e9-a98b-42e3-b1ae-eeffca14ba00 tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80d3ecf9-385c-4577-9bc6-a47868ca7a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:41 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-2ce4b2e9-a98b-42e3-b1ae-eeffca14ba00 tempest-CreateVolumesFromSnapshotTest-573977501 None] Volume volume-f69b90b6-0e73-44ac-8d3d-755768231797 (f69b90b6-0e73-44ac-8d3d-755768231797): created successfully Jul 07 08:31:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2ce4b2e9-a98b-42e3-b1ae-eeffca14ba00 tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80d3ecf9-385c-4577-9bc6-a47868ca7a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-2ce4b2e9-a98b-42e3-b1ae-eeffca14ba00 tempest-CreateVolumesFromSnapshotTest-573977501 None] Flow 'volume_create_manager' (8ca5f73c-cc22-4df7-8901-774366b1c901) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:31:41 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-2ce4b2e9-a98b-42e3-b1ae-eeffca14ba00 tempest-CreateVolumesFromSnapshotTest-573977501 None] Created volume successfully. Jul 07 08:31:42 devstack sudo[102855]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599 1073741824" returned: 0 in 0.839s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:42 devstack sudo[102860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599 Jul 07 08:31:42 devstack sudo[102860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:42 devstack sudo[102860]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599" returned: 0 in 0.635s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] <== create_volume: return (1515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:31:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.518s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:31:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-30c3bc98-1c22-4470-9e6e-557dbb9ece27 tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.943s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:31:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-30c3bc98-1c22-4470-9e6e-557dbb9ece27 tempest-CreateVolumesFromSnapshotTest-573977501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:31:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-883674202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8192fab9-35b2-4eb2-8ea2-1b6a625f91ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c2ccaec17844a4ab885dca8332b666b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:31:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:31:37Z,use_quota=True,user_id='558584fe87a44741b29ce6829625d9aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:31:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-30c3bc98-1c22-4470-9e6e-557dbb9ece27 tempest-CreateVolumesFromSnapshotTest-573977501 None] Creating volume 8192fab9-35b2-4eb2-8ea2-1b6a625f91ec {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:31:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-30c3bc98-1c22-4470-9e6e-557dbb9ece27 tempest-CreateVolumesFromSnapshotTest-573977501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:31:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-30c3bc98-1c22-4470-9e6e-557dbb9ece27 tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:31:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-30c3bc98-1c22-4470-9e6e-557dbb9ece27 tempest-CreateVolumesFromSnapshotTest-573977501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:31:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-30c3bc98-1c22-4470-9e6e-557dbb9ece27 tempest-CreateVolumesFromSnapshotTest-573977501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:31:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-30c3bc98-1c22-4470-9e6e-557dbb9ece27 tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:31:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-30c3bc98-1c22-4470-9e6e-557dbb9ece27 tempest-CreateVolumesFromSnapshotTest-573977501 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:31:42 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-30c3bc98-1c22-4470-9e6e-557dbb9ece27 tempest-CreateVolumesFromSnapshotTest-573977501 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:31:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-30c3bc98-1c22-4470-9e6e-557dbb9ece27 tempest-CreateVolumesFromSnapshotTest-573977501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8192fab9-35b2-4eb2-8ea2-1b6a625f91ec 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:42 devstack sudo[102863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8192fab9-35b2-4eb2-8ea2-1b6a625f91ec 1073741824 Jul 07 08:31:42 devstack sudo[102863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:42 devstack cinder-volume[87199]: DEBUG cinder.volume.volume_utils [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] Attempting download of 276bad5d-feb0-4ba2-a219-18ecf721ff14 ((None, [{'url': 'file:///opt/stack/data/glance/images/276bad5d-feb0-4ba2-a219-18ecf721ff14', 'metadata': {}}])) to volume 1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599. {{(pid=87199) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 08:31:42 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[71de77e9-0b20-44f4-a93e-6b85ffc7fa3b]: (4, 'raw') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:31:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_276bad5d-feb0-4ba2-a219-18ecf721ff14_mvf7ab0p {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:42 devstack sudo[102865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_276bad5d-feb0-4ba2-a219-18ecf721ff14_mvf7ab0p Jul 07 08:31:42 devstack sudo[102865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:43 devstack sudo[102863]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-30c3bc98-1c22-4470-9e6e-557dbb9ece27 tempest-CreateVolumesFromSnapshotTest-573977501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8192fab9-35b2-4eb2-8ea2-1b6a625f91ec 1073741824" returned: 0 in 0.823s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:43 devstack sudo[102865]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_276bad5d-feb0-4ba2-a219-18ecf721ff14_mvf7ab0p" returned: 0 in 0.758s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_276bad5d-feb0-4ba2-a219-18ecf721ff14_mvf7ab0p {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-30c3bc98-1c22-4470-9e6e-557dbb9ece27 tempest-CreateVolumesFromSnapshotTest-573977501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8192fab9-35b2-4eb2-8ea2-1b6a625f91ec {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:43 devstack sudo[102873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8192fab9-35b2-4eb2-8ea2-1b6a625f91ec Jul 07 08:31:43 devstack sudo[102873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:43 devstack sudo[102872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_276bad5d-feb0-4ba2-a219-18ecf721ff14_mvf7ab0p Jul 07 08:31:43 devstack sudo[102872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:44 devstack sudo[102873]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-30c3bc98-1c22-4470-9e6e-557dbb9ece27 tempest-CreateVolumesFromSnapshotTest-573977501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8192fab9-35b2-4eb2-8ea2-1b6a625f91ec" returned: 0 in 0.664s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-30c3bc98-1c22-4470-9e6e-557dbb9ece27 tempest-CreateVolumesFromSnapshotTest-573977501 None] <== create_volume: return (1544ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:31:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-30c3bc98-1c22-4470-9e6e-557dbb9ece27 tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.547s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:31:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-30c3bc98-1c22-4470-9e6e-557dbb9ece27 tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63320c3d-fe53-4e55-86c8-f9d9a4e41ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8192fab9-35b2-4eb2-8ea2-1b6a625f91ec', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-30c3bc98-1c22-4470-9e6e-557dbb9ece27 tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (390131ce-da51-4781-88c9-5f269d3401cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:44 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-30c3bc98-1c22-4470-9e6e-557dbb9ece27 tempest-CreateVolumesFromSnapshotTest-573977501 None] Volume volume-8192fab9-35b2-4eb2-8ea2-1b6a625f91ec (8192fab9-35b2-4eb2-8ea2-1b6a625f91ec): created successfully Jul 07 08:31:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-30c3bc98-1c22-4470-9e6e-557dbb9ece27 tempest-CreateVolumesFromSnapshotTest-573977501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (390131ce-da51-4781-88c9-5f269d3401cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-30c3bc98-1c22-4470-9e6e-557dbb9ece27 tempest-CreateVolumesFromSnapshotTest-573977501 None] Flow 'volume_create_manager' (d02cb283-5fe1-4026-b547-80ee75b48507) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:31:44 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-30c3bc98-1c22-4470-9e6e-557dbb9ece27 tempest-CreateVolumesFromSnapshotTest-573977501 None] Created volume successfully. Jul 07 08:31:44 devstack sudo[102872]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_276bad5d-feb0-4ba2-a219-18ecf721ff14_mvf7ab0p" returned: 1 in 0.762s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_276bad5d-feb0-4ba2-a219-18ecf721ff14_mvf7ab0p' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:31:44 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e37fc5-be41-4a41-b3c2-f8d92b89ab18]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:31:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_276bad5d-feb0-4ba2-a219-18ecf721ff14_msp087b1devstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:44 devstack sudo[102879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_276bad5d-feb0-4ba2-a219-18ecf721ff14_msp087b1devstack@QuobyteHD Jul 07 08:31:44 devstack sudo[102879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:45 devstack sudo[102879]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_276bad5d-feb0-4ba2-a219-18ecf721ff14_msp087b1devstack@QuobyteHD" returned: 0 in 0.695s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:45 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] 276bad5d-feb0-4ba2-a219-18ecf721ff14 was qcow2, converting to raw {{(pid=87199) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 08:31:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_276bad5d-feb0-4ba2-a219-18ecf721ff14_msp087b1devstack@QuobyteHD /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:45 devstack sudo[102885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_276bad5d-feb0-4ba2-a219-18ecf721ff14_msp087b1devstack@QuobyteHD /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599 Jul 07 08:31:45 devstack sudo[102885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0f9199f2-66e1-4414-b459-2313ae6ac528 tempest-CreateVolumesFromSnapshotTest-573977501 None] Acquiring lock "cinder-8192fab9-35b2-4eb2-8ea2-1b6a625f91ec-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:31:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0f9199f2-66e1-4414-b459-2313ae6ac528 tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "cinder-8192fab9-35b2-4eb2-8ea2-1b6a625f91ec-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:31:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0f9199f2-66e1-4414-b459-2313ae6ac528 tempest-CreateVolumesFromSnapshotTest-573977501 None] Acquiring lock "cinder-quobyte-8192fab9-35b2-4eb2-8ea2-1b6a625f91ec" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:31:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0f9199f2-66e1-4414-b459-2313ae6ac528 tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "cinder-quobyte-8192fab9-35b2-4eb2-8ea2-1b6a625f91ec" acquired by "delete_volume" :: waited 0.016s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:31:45 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80f1b64-b924-4e84-9ff7-63240e91a166]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:31:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0f9199f2-66e1-4414-b459-2313ae6ac528 tempest-CreateVolumesFromSnapshotTest-573977501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8192fab9-35b2-4eb2-8ea2-1b6a625f91ec {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:45 devstack sudo[102887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8192fab9-35b2-4eb2-8ea2-1b6a625f91ec Jul 07 08:31:45 devstack sudo[102887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:46 devstack sudo[102887]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0f9199f2-66e1-4414-b459-2313ae6ac528 tempest-CreateVolumesFromSnapshotTest-573977501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8192fab9-35b2-4eb2-8ea2-1b6a625f91ec" returned: 0 in 0.870s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0f9199f2-66e1-4414-b459-2313ae6ac528 tempest-CreateVolumesFromSnapshotTest-573977501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8192fab9-35b2-4eb2-8ea2-1b6a625f91ec {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:46 devstack sudo[102897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8192fab9-35b2-4eb2-8ea2-1b6a625f91ec Jul 07 08:31:46 devstack sudo[102897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:46 devstack sudo[102885]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_276bad5d-feb0-4ba2-a219-18ecf721ff14_msp087b1devstack@QuobyteHD /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599" returned: 0 in 1.854s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:46 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_276bad5d-feb0-4ba2-a219-18ecf721ff14_msp087b1devstack@QuobyteHD, size 112.00 MB, duration 1.85 sec, destination /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599 {{(pid=87199) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 08:31:46 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] Converted 112.00 MB image at 60.38 MB/s Jul 07 08:31:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:46 devstack sudo[102899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599 1G Jul 07 08:31:46 devstack sudo[102899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:47 devstack sudo[102897]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0f9199f2-66e1-4414-b459-2313ae6ac528 tempest-CreateVolumesFromSnapshotTest-573977501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8192fab9-35b2-4eb2-8ea2-1b6a625f91ec" returned: 0 in 0.747s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:47 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0f9199f2-66e1-4414-b459-2313ae6ac528 tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "cinder-quobyte-8192fab9-35b2-4eb2-8ea2-1b6a625f91ec" released by "delete_volume" :: held 1.665s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:31:47 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-0f9199f2-66e1-4414-b459-2313ae6ac528 tempest-CreateVolumesFromSnapshotTest-573977501 None] Created reservations ['1707bb3c-8b9f-4f5d-a905-e069ce061170', '1828dc66-9b27-4aeb-9bb9-c13ee09989df', '90938948-ed1b-45bb-9d53-8dea0b83eff2', '703ff53b-e19a-4eef-aeb0-a2a5879b6b82'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:31:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0f9199f2-66e1-4414-b459-2313ae6ac528 tempest-CreateVolumesFromSnapshotTest-573977501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:31:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0f9199f2-66e1-4414-b459-2313ae6ac528 tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:31:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-0f9199f2-66e1-4414-b459-2313ae6ac528 tempest-CreateVolumesFromSnapshotTest-573977501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:31:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-0f9199f2-66e1-4414-b459-2313ae6ac528 tempest-CreateVolumesFromSnapshotTest-573977501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:31:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0f9199f2-66e1-4414-b459-2313ae6ac528 tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:31:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0f9199f2-66e1-4414-b459-2313ae6ac528 tempest-CreateVolumesFromSnapshotTest-573977501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:47 devstack sudo[102905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:31:47 devstack sudo[102905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:47 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-950be7f5-dec8-4044-908e-2ef2c616f4fa tempest-CreateVolumesFromSnapshotTest-573977501 None] Acquiring lock "cinder-f69b90b6-0e73-44ac-8d3d-755768231797-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:31:47 devstack sudo[102899]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599 1G" returned: 0 in 0.750s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:47 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-950be7f5-dec8-4044-908e-2ef2c616f4fa tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "cinder-f69b90b6-0e73-44ac-8d3d-755768231797-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:31:47 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe7a185-fed6-4f5f-ada2-0204465709c9]: (4, 'raw') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:31:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:47 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-950be7f5-dec8-4044-908e-2ef2c616f4fa tempest-CreateVolumesFromSnapshotTest-573977501 None] Acquiring lock "cinder-quobyte-f69b90b6-0e73-44ac-8d3d-755768231797" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:31:47 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-950be7f5-dec8-4044-908e-2ef2c616f4fa tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "cinder-quobyte-f69b90b6-0e73-44ac-8d3d-755768231797" acquired by "delete_volume" :: waited 0.021s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:31:47 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[18093249-04cc-4766-a3ef-3edfb29fc51c]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:31:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-950be7f5-dec8-4044-908e-2ef2c616f4fa tempest-CreateVolumesFromSnapshotTest-573977501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f69b90b6-0e73-44ac-8d3d-755768231797 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:47 devstack sudo[102913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599 Jul 07 08:31:47 devstack sudo[102913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:47 devstack sudo[102914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f69b90b6-0e73-44ac-8d3d-755768231797 Jul 07 08:31:47 devstack sudo[102914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:47 devstack sudo[102905]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0f9199f2-66e1-4414-b459-2313ae6ac528 tempest-CreateVolumesFromSnapshotTest-573977501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.678s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:47 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-0f9199f2-66e1-4414-b459-2313ae6ac528 tempest-CreateVolumesFromSnapshotTest-573977501 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:31:47 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-0f9199f2-66e1-4414-b459-2313ae6ac528 tempest-CreateVolumesFromSnapshotTest-573977501 None] Deleted volume successfully. Jul 07 08:31:47 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0f9199f2-66e1-4414-b459-2313ae6ac528 tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "cinder-8192fab9-35b2-4eb2-8ea2-1b6a625f91ec-delete_volume" released by "delete_volume" :: held 2.602s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:31:48 devstack sudo[102913]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599" returned: 0 in 0.792s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:48 devstack sudo[102914]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-950be7f5-dec8-4044-908e-2ef2c616f4fa tempest-CreateVolumesFromSnapshotTest-573977501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f69b90b6-0e73-44ac-8d3d-755768231797" returned: 0 in 0.750s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-950be7f5-dec8-4044-908e-2ef2c616f4fa tempest-CreateVolumesFromSnapshotTest-573977501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f69b90b6-0e73-44ac-8d3d-755768231797 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:48 devstack sudo[102924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f69b90b6-0e73-44ac-8d3d-755768231797 Jul 07 08:31:48 devstack sudo[102924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:48 devstack sudo[102923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599 Jul 07 08:31:48 devstack sudo[102923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:49 devstack sudo[102924]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-950be7f5-dec8-4044-908e-2ef2c616f4fa tempest-CreateVolumesFromSnapshotTest-573977501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-f69b90b6-0e73-44ac-8d3d-755768231797" returned: 0 in 0.630s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:49 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-950be7f5-dec8-4044-908e-2ef2c616f4fa tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "cinder-quobyte-f69b90b6-0e73-44ac-8d3d-755768231797" released by "delete_volume" :: held 1.426s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:31:49 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-950be7f5-dec8-4044-908e-2ef2c616f4fa tempest-CreateVolumesFromSnapshotTest-573977501 None] Created reservations ['63ad4e5f-a585-4150-af8f-c6e74e4ae706', '0236c1e4-8e6b-4f74-97c9-85fd5afd01e7', 'f84cc59e-9517-4d1d-b0c9-2f531bf5b695', 'bd0b32f0-4f7d-45aa-8348-7c445b8757ed'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:31:49 devstack sudo[102923]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599" returned: 1 in 0.735s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:31:49 devstack cinder-volume[87199]: DEBUG cinder.volume.volume_utils [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] Downloaded image 276bad5d-feb0-4ba2-a219-18ecf721ff14 ((None, [{'url': 'file:///opt/stack/data/glance/images/276bad5d-feb0-4ba2-a219-18ecf721ff14', 'metadata': {}}])) to volume 1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599 successfully. {{(pid=87199) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 08:31:49 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] Temporary image 276bad5d-feb0-4ba2-a219-18ecf721ff14 for user 28e8f64c98234a9baa3d1f61236a6ed7 is deleted. {{(pid=87199) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 08:31:49 devstack cinder-volume[87199]: DEBUG cinder.volume.volume_utils [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] Marking volume 1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599 as bootable. {{(pid=87199) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 08:31:49 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] Copying metadata from image 276bad5d-feb0-4ba2-a219-18ecf721ff14 to 1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599. {{(pid=87199) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 08:31:49 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] Creating volume glance metadata for volume 1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599 backed by image 276bad5d-feb0-4ba2-a219-18ecf721ff14 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '276bad5d-feb0-4ba2-a219-18ecf721ff14', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87199) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 08:31:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-950be7f5-dec8-4044-908e-2ef2c616f4fa tempest-CreateVolumesFromSnapshotTest-573977501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:31:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-950be7f5-dec8-4044-908e-2ef2c616f4fa tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:31:49 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-950be7f5-dec8-4044-908e-2ef2c616f4fa tempest-CreateVolumesFromSnapshotTest-573977501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:31:49 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-950be7f5-dec8-4044-908e-2ef2c616f4fa tempest-CreateVolumesFromSnapshotTest-573977501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:31:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-950be7f5-dec8-4044-908e-2ef2c616f4fa tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:31:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-950be7f5-dec8-4044-908e-2ef2c616f4fa tempest-CreateVolumesFromSnapshotTest-573977501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:49 devstack sudo[102931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:31:49 devstack sudo[102931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:49 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85acda6f-cfb1-433f-bbdb-857a7646408c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599', 'volume_size': 1, 'image_id': '276bad5d-feb0-4ba2-a219-18ecf721ff14', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/276bad5d-feb0-4ba2-a219-18ecf721ff14', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '616624e32aa447818ca627e0bb0985c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '276bad5d-feb0-4ba2-a219-18ecf721ff14', 'created_at': datetime.datetime(2026, 7, 7, 6, 6, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 6, 6, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/276bad5d-feb0-4ba2-a219-18ecf721ff14/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:49 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d28895f-487d-45d6-8ced-990348cacd41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:49 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] Volume volume-1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599 (1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599): created successfully Jul 07 08:31:49 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d28895f-487d-45d6-8ced-990348cacd41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:49 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] Flow 'volume_create_manager' (271543a1-2462-481f-b59c-890920e5578d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:31:49 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-79f713c0-15b4-43d3-8887-852163c89252 tempest-TestShelveInstance-1302202911 None] Created volume successfully. Jul 07 08:31:49 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fc089090-1e8f-47ad-9788-46279e8fed09 tempest-CreateVolumesFromSnapshotTest-573977501 None] Acquiring lock "cinder-9a064d54-1249-402e-943c-d8bcd90e0324-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:31:49 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fc089090-1e8f-47ad-9788-46279e8fed09 tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "cinder-9a064d54-1249-402e-943c-d8bcd90e0324-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:31:49 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fc089090-1e8f-47ad-9788-46279e8fed09 tempest-CreateVolumesFromSnapshotTest-573977501 None] Acquiring lock "cinder-quobyte-9a064d54-1249-402e-943c-d8bcd90e0324" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:31:49 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fc089090-1e8f-47ad-9788-46279e8fed09 tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "cinder-quobyte-9a064d54-1249-402e-943c-d8bcd90e0324" acquired by "delete_volume" :: waited 0.019s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:31:49 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[48eecfb6-1b83-4ea4-a573-aea429d2fe77]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:31:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fc089090-1e8f-47ad-9788-46279e8fed09 tempest-CreateVolumesFromSnapshotTest-573977501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-9a064d54-1249-402e-943c-d8bcd90e0324 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:50 devstack sudo[102931]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-950be7f5-dec8-4044-908e-2ef2c616f4fa tempest-CreateVolumesFromSnapshotTest-573977501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.722s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:50 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-950be7f5-dec8-4044-908e-2ef2c616f4fa tempest-CreateVolumesFromSnapshotTest-573977501 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:31:50 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-950be7f5-dec8-4044-908e-2ef2c616f4fa tempest-CreateVolumesFromSnapshotTest-573977501 None] Deleted volume successfully. Jul 07 08:31:50 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-950be7f5-dec8-4044-908e-2ef2c616f4fa tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "cinder-f69b90b6-0e73-44ac-8d3d-755768231797-delete_volume" released by "delete_volume" :: held 2.415s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:31:50 devstack sudo[102934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-9a064d54-1249-402e-943c-d8bcd90e0324 Jul 07 08:31:50 devstack sudo[102934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:50 devstack sudo[102934]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fc089090-1e8f-47ad-9788-46279e8fed09 tempest-CreateVolumesFromSnapshotTest-573977501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-9a064d54-1249-402e-943c-d8bcd90e0324" returned: 0 in 0.791s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fc089090-1e8f-47ad-9788-46279e8fed09 tempest-CreateVolumesFromSnapshotTest-573977501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-9a064d54-1249-402e-943c-d8bcd90e0324 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:50 devstack sudo[102942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-9a064d54-1249-402e-943c-d8bcd90e0324 Jul 07 08:31:50 devstack sudo[102942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:51 devstack sudo[102942]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fc089090-1e8f-47ad-9788-46279e8fed09 tempest-CreateVolumesFromSnapshotTest-573977501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-9a064d54-1249-402e-943c-d8bcd90e0324" returned: 0 in 0.677s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:51 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fc089090-1e8f-47ad-9788-46279e8fed09 tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "cinder-quobyte-9a064d54-1249-402e-943c-d8bcd90e0324" released by "delete_volume" :: held 1.515s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:31:51 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-fc089090-1e8f-47ad-9788-46279e8fed09 tempest-CreateVolumesFromSnapshotTest-573977501 None] Created reservations ['c578c159-7a91-4897-ba44-38a2784f7603', '6c6cc57f-ddd7-4fd6-bd51-e522fd0bc477', '3041ac57-6d75-4d43-b0a7-1124fe80762b', 'db7bf0bb-c259-4380-b46c-59d0b3a052f1'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:31:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-fc089090-1e8f-47ad-9788-46279e8fed09 tempest-CreateVolumesFromSnapshotTest-573977501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:31:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-fc089090-1e8f-47ad-9788-46279e8fed09 tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:31:51 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-fc089090-1e8f-47ad-9788-46279e8fed09 tempest-CreateVolumesFromSnapshotTest-573977501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:31:51 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-fc089090-1e8f-47ad-9788-46279e8fed09 tempest-CreateVolumesFromSnapshotTest-573977501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:31:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-fc089090-1e8f-47ad-9788-46279e8fed09 tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:31:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fc089090-1e8f-47ad-9788-46279e8fed09 tempest-CreateVolumesFromSnapshotTest-573977501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:51 devstack sudo[102946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:31:51 devstack sudo[102946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-50a62880-1da0-4fcc-8182-2acd6a8d55bf tempest-CreateVolumesFromSnapshotTest-573977501 None] Acquiring lock "cinder-7d92807a-6165-434f-95f7-c7b176f32e89-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:31:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-50a62880-1da0-4fcc-8182-2acd6a8d55bf tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "cinder-7d92807a-6165-434f-95f7-c7b176f32e89-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:31:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-50a62880-1da0-4fcc-8182-2acd6a8d55bf tempest-CreateVolumesFromSnapshotTest-573977501 None] Acquiring lock "cinder-quobyte-7d92807a-6165-434f-95f7-c7b176f32e89" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:31:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-50a62880-1da0-4fcc-8182-2acd6a8d55bf tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "cinder-quobyte-7d92807a-6165-434f-95f7-c7b176f32e89" acquired by "delete_volume" :: waited 0.020s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:31:52 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34fd405-98c8-406b-b569-895eaf98b18e]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:31:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-50a62880-1da0-4fcc-8182-2acd6a8d55bf tempest-CreateVolumesFromSnapshotTest-573977501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7d92807a-6165-434f-95f7-c7b176f32e89 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:52 devstack sudo[102946]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fc089090-1e8f-47ad-9788-46279e8fed09 tempest-CreateVolumesFromSnapshotTest-573977501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.717s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:52 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-fc089090-1e8f-47ad-9788-46279e8fed09 tempest-CreateVolumesFromSnapshotTest-573977501 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:31:52 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-fc089090-1e8f-47ad-9788-46279e8fed09 tempest-CreateVolumesFromSnapshotTest-573977501 None] Deleted volume successfully. Jul 07 08:31:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-fc089090-1e8f-47ad-9788-46279e8fed09 tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "cinder-9a064d54-1249-402e-943c-d8bcd90e0324-delete_volume" released by "delete_volume" :: held 2.462s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:31:52 devstack sudo[102949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7d92807a-6165-434f-95f7-c7b176f32e89 Jul 07 08:31:52 devstack sudo[102949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:53 devstack sudo[102949]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-50a62880-1da0-4fcc-8182-2acd6a8d55bf tempest-CreateVolumesFromSnapshotTest-573977501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7d92807a-6165-434f-95f7-c7b176f32e89" returned: 0 in 0.774s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-50a62880-1da0-4fcc-8182-2acd6a8d55bf tempest-CreateVolumesFromSnapshotTest-573977501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7d92807a-6165-434f-95f7-c7b176f32e89 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:53 devstack sudo[102954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7d92807a-6165-434f-95f7-c7b176f32e89 Jul 07 08:31:53 devstack sudo[102954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:53 devstack sudo[102954]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-50a62880-1da0-4fcc-8182-2acd6a8d55bf tempest-CreateVolumesFromSnapshotTest-573977501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7d92807a-6165-434f-95f7-c7b176f32e89" returned: 0 in 0.670s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:53 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-50a62880-1da0-4fcc-8182-2acd6a8d55bf tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "cinder-quobyte-7d92807a-6165-434f-95f7-c7b176f32e89" released by "delete_volume" :: held 1.493s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:31:53 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-50a62880-1da0-4fcc-8182-2acd6a8d55bf tempest-CreateVolumesFromSnapshotTest-573977501 None] Created reservations ['c755a9f9-c05e-43aa-8466-4f6bf6ea6705', '39754394-9f44-4972-84ac-0305a38e7478', '3c96cf13-09b5-4baf-b872-c5d68074aafa', '1fbbc16e-c190-4865-b6ad-0848a06ef4c4'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:31:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-50a62880-1da0-4fcc-8182-2acd6a8d55bf tempest-CreateVolumesFromSnapshotTest-573977501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:31:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-50a62880-1da0-4fcc-8182-2acd6a8d55bf tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:31:53 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-50a62880-1da0-4fcc-8182-2acd6a8d55bf tempest-CreateVolumesFromSnapshotTest-573977501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:31:53 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-50a62880-1da0-4fcc-8182-2acd6a8d55bf tempest-CreateVolumesFromSnapshotTest-573977501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:31:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-50a62880-1da0-4fcc-8182-2acd6a8d55bf tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:31:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-50a62880-1da0-4fcc-8182-2acd6a8d55bf tempest-CreateVolumesFromSnapshotTest-573977501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:53 devstack sudo[102957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:31:53 devstack sudo[102957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:54 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b2f16c26-a1bf-47e0-889a-38fb62564dbb tempest-CreateVolumesFromSnapshotTest-573977501 None] Acquiring lock "cinder-c8a65121-dc2d-40a2-ba6f-f4df5482455e-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:31:54 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b2f16c26-a1bf-47e0-889a-38fb62564dbb tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "cinder-c8a65121-dc2d-40a2-ba6f-f4df5482455e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:31:54 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b2f16c26-a1bf-47e0-889a-38fb62564dbb tempest-CreateVolumesFromSnapshotTest-573977501 None] Acquiring lock "cinder-quobyte-c8a65121-dc2d-40a2-ba6f-f4df5482455e" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:31:54 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b2f16c26-a1bf-47e0-889a-38fb62564dbb tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "cinder-quobyte-c8a65121-dc2d-40a2-ba6f-f4df5482455e" acquired by "delete_volume" :: waited 0.018s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:31:54 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e771a8-39dc-416a-b5dd-a308974c6485]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:31:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b2f16c26-a1bf-47e0-889a-38fb62564dbb tempest-CreateVolumesFromSnapshotTest-573977501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c8a65121-dc2d-40a2-ba6f-f4df5482455e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:54 devstack sudo[102957]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-50a62880-1da0-4fcc-8182-2acd6a8d55bf tempest-CreateVolumesFromSnapshotTest-573977501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.699s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:54 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-50a62880-1da0-4fcc-8182-2acd6a8d55bf tempest-CreateVolumesFromSnapshotTest-573977501 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:31:54 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-50a62880-1da0-4fcc-8182-2acd6a8d55bf tempest-CreateVolumesFromSnapshotTest-573977501 None] Deleted volume successfully. Jul 07 08:31:54 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-50a62880-1da0-4fcc-8182-2acd6a8d55bf tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "cinder-7d92807a-6165-434f-95f7-c7b176f32e89-delete_volume" released by "delete_volume" :: held 2.414s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:31:54 devstack sudo[102960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c8a65121-dc2d-40a2-ba6f-f4df5482455e Jul 07 08:31:54 devstack sudo[102960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:55 devstack sudo[102960]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b2f16c26-a1bf-47e0-889a-38fb62564dbb tempest-CreateVolumesFromSnapshotTest-573977501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c8a65121-dc2d-40a2-ba6f-f4df5482455e" returned: 0 in 0.793s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b2f16c26-a1bf-47e0-889a-38fb62564dbb tempest-CreateVolumesFromSnapshotTest-573977501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c8a65121-dc2d-40a2-ba6f-f4df5482455e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:55 devstack sudo[102965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c8a65121-dc2d-40a2-ba6f-f4df5482455e Jul 07 08:31:55 devstack sudo[102965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:55 devstack sudo[102965]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b2f16c26-a1bf-47e0-889a-38fb62564dbb tempest-CreateVolumesFromSnapshotTest-573977501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c8a65121-dc2d-40a2-ba6f-f4df5482455e" returned: 0 in 0.652s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:55 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b2f16c26-a1bf-47e0-889a-38fb62564dbb tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "cinder-quobyte-c8a65121-dc2d-40a2-ba6f-f4df5482455e" released by "delete_volume" :: held 1.499s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:31:56 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-b2f16c26-a1bf-47e0-889a-38fb62564dbb tempest-CreateVolumesFromSnapshotTest-573977501 None] Created reservations ['185f807b-4296-44c5-989b-446a0ea96443', '5b9dc152-0862-4e5d-b9c3-86e33995dd7d', '7e85c9f2-529b-4a8a-aee1-6dbcd2bd68ce', '6bb30c8d-7ce4-4ba4-a03f-dd11185cc16b'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:31:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b2f16c26-a1bf-47e0-889a-38fb62564dbb tempest-CreateVolumesFromSnapshotTest-573977501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:31:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b2f16c26-a1bf-47e0-889a-38fb62564dbb tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:31:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b2f16c26-a1bf-47e0-889a-38fb62564dbb tempest-CreateVolumesFromSnapshotTest-573977501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:31:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b2f16c26-a1bf-47e0-889a-38fb62564dbb tempest-CreateVolumesFromSnapshotTest-573977501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:31:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b2f16c26-a1bf-47e0-889a-38fb62564dbb tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:31:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b2f16c26-a1bf-47e0-889a-38fb62564dbb tempest-CreateVolumesFromSnapshotTest-573977501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:56 devstack sudo[102968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:31:56 devstack sudo[102968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-dd992669-4ec6-4d2f-ae6b-c68fd0ca49ad tempest-CreateVolumesFromSnapshotTest-573977501 None] Acquiring lock "cinder-83316f41-88cf-4e42-b6bd-ec62ac6c0fb8-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:31:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-dd992669-4ec6-4d2f-ae6b-c68fd0ca49ad tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "cinder-83316f41-88cf-4e42-b6bd-ec62ac6c0fb8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:31:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-dd992669-4ec6-4d2f-ae6b-c68fd0ca49ad tempest-CreateVolumesFromSnapshotTest-573977501 None] Acquiring lock "cinder-quobyte-fff03950-a6c1-41de-8360-d5c34f3977c6" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:31:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-dd992669-4ec6-4d2f-ae6b-c68fd0ca49ad tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "cinder-quobyte-fff03950-a6c1-41de-8360-d5c34f3977c6" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:31:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-dd992669-4ec6-4d2f-ae6b-c68fd0ca49ad tempest-CreateVolumesFromSnapshotTest-573977501 None] Acquiring lock "cinder-quobyte-83316f41-88cf-4e42-b6bd-ec62ac6c0fb8" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:31:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-dd992669-4ec6-4d2f-ae6b-c68fd0ca49ad tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "cinder-quobyte-83316f41-88cf-4e42-b6bd-ec62ac6c0fb8" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:31:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-dd992669-4ec6-4d2f-ae6b-c68fd0ca49ad tempest-CreateVolumesFromSnapshotTest-573977501 None] Deleting offline snapshot 83316f41-88cf-4e42-b6bd-ec62ac6c0fb8 of volume fff03950-a6c1-41de-8360-d5c34f3977c6 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:31:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-dd992669-4ec6-4d2f-ae6b-c68fd0ca49ad tempest-CreateVolumesFromSnapshotTest-573977501 None] snapshot_file for this snap is: volume-fff03950-a6c1-41de-8360-d5c34f3977c6.83316f41-88cf-4e42-b6bd-ec62ac6c0fb8 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:31:56 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb52c0a7-fab7-464a-86ff-4541ddefb02c]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:31:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-dd992669-4ec6-4d2f-ae6b-c68fd0ca49ad tempest-CreateVolumesFromSnapshotTest-573977501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fff03950-a6c1-41de-8360-d5c34f3977c6.83316f41-88cf-4e42-b6bd-ec62ac6c0fb8 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:56 devstack sudo[102974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fff03950-a6c1-41de-8360-d5c34f3977c6.83316f41-88cf-4e42-b6bd-ec62ac6c0fb8 Jul 07 08:31:56 devstack sudo[102974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:56 devstack sudo[102968]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b2f16c26-a1bf-47e0-889a-38fb62564dbb tempest-CreateVolumesFromSnapshotTest-573977501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.828s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:56 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-b2f16c26-a1bf-47e0-889a-38fb62564dbb tempest-CreateVolumesFromSnapshotTest-573977501 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:31:56 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-b2f16c26-a1bf-47e0-889a-38fb62564dbb tempest-CreateVolumesFromSnapshotTest-573977501 None] Deleted volume successfully. Jul 07 08:31:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b2f16c26-a1bf-47e0-889a-38fb62564dbb tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "cinder-c8a65121-dc2d-40a2-ba6f-f4df5482455e-delete_volume" released by "delete_volume" :: held 2.591s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:31:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-792cd0ae-7d02-4f9e-8bb9-70260334ca2d req-36dfa254-82df-4980-b48f-26391ddaaa05 tempest-TestShelveInstance-1302202911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:31:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-792cd0ae-7d02-4f9e-8bb9-70260334ca2d req-36dfa254-82df-4980-b48f-26391ddaaa05 tempest-TestShelveInstance-1302202911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:31:57 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb939b9-a547-44cc-99a2-cd93a5d80780]: (4, 'raw') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:31:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-792cd0ae-7d02-4f9e-8bb9-70260334ca2d req-36dfa254-82df-4980-b48f-26391ddaaa05 tempest-TestShelveInstance-1302202911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:57 devstack sudo[102982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599 Jul 07 08:31:57 devstack sudo[102982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:57 devstack sudo[102974]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-dd992669-4ec6-4d2f-ae6b-c68fd0ca49ad tempest-CreateVolumesFromSnapshotTest-573977501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fff03950-a6c1-41de-8360-d5c34f3977c6.83316f41-88cf-4e42-b6bd-ec62ac6c0fb8" returned: 0 in 0.846s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-dd992669-4ec6-4d2f-ae6b-c68fd0ca49ad tempest-CreateVolumesFromSnapshotTest-573977501 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fff03950-a6c1-41de-8360-d5c34f3977c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:31:57 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[17156c60-32dc-4ffe-b7f2-6cc273ff5093]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:31:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-dd992669-4ec6-4d2f-ae6b-c68fd0ca49ad tempest-CreateVolumesFromSnapshotTest-573977501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fff03950-a6c1-41de-8360-d5c34f3977c6 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:57 devstack sudo[102988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fff03950-a6c1-41de-8360-d5c34f3977c6 Jul 07 08:31:57 devstack sudo[102988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:57 devstack sudo[102982]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-792cd0ae-7d02-4f9e-8bb9-70260334ca2d req-36dfa254-82df-4980-b48f-26391ddaaa05 tempest-TestShelveInstance-1302202911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599" returned: 0 in 0.808s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-792cd0ae-7d02-4f9e-8bb9-70260334ca2d req-36dfa254-82df-4980-b48f-26391ddaaa05 tempest-TestShelveInstance-1302202911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:57 devstack sudo[102992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599 Jul 07 08:31:57 devstack sudo[102992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:58 devstack sudo[102988]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-dd992669-4ec6-4d2f-ae6b-c68fd0ca49ad tempest-CreateVolumesFromSnapshotTest-573977501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fff03950-a6c1-41de-8360-d5c34f3977c6" returned: 0 in 0.825s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-dd992669-4ec6-4d2f-ae6b-c68fd0ca49ad tempest-CreateVolumesFromSnapshotTest-573977501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fff03950-a6c1-41de-8360-d5c34f3977c6.83316f41-88cf-4e42-b6bd-ec62ac6c0fb8 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:58 devstack sudo[102997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fff03950-a6c1-41de-8360-d5c34f3977c6.83316f41-88cf-4e42-b6bd-ec62ac6c0fb8 Jul 07 08:31:58 devstack sudo[102997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:58 devstack sudo[102992]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-792cd0ae-7d02-4f9e-8bb9-70260334ca2d req-36dfa254-82df-4980-b48f-26391ddaaa05 tempest-TestShelveInstance-1302202911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599" returned: 1 in 0.753s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-792cd0ae-7d02-4f9e-8bb9-70260334ca2d req-36dfa254-82df-4980-b48f-26391ddaaa05 tempest-TestShelveInstance-1302202911 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:31:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-792cd0ae-7d02-4f9e-8bb9-70260334ca2d req-36dfa254-82df-4980-b48f-26391ddaaa05 tempest-TestShelveInstance-1302202911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.603s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:31:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-792cd0ae-7d02-4f9e-8bb9-70260334ca2d req-36dfa254-82df-4980-b48f-26391ddaaa05 tempest-TestShelveInstance-1302202911 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b', 'name': 'volume-1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '21d3851e-7913-4932-83e0-da1b5dfae88f', 'enforce_multipath': True} {{(pid=87199) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 08:31:58 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-792cd0ae-7d02-4f9e-8bb9-70260334ca2d req-36dfa254-82df-4980-b48f-26391ddaaa05 tempest-TestShelveInstance-1302202911 None] attachment_update completed successfully. Jul 07 08:31:59 devstack sudo[102997]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-dd992669-4ec6-4d2f-ae6b-c68fd0ca49ad tempest-CreateVolumesFromSnapshotTest-573977501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fff03950-a6c1-41de-8360-d5c34f3977c6.83316f41-88cf-4e42-b6bd-ec62ac6c0fb8" returned: 0 in 0.798s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-dd992669-4ec6-4d2f-ae6b-c68fd0ca49ad tempest-CreateVolumesFromSnapshotTest-573977501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fff03950-a6c1-41de-8360-d5c34f3977c6.83316f41-88cf-4e42-b6bd-ec62ac6c0fb8 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:59 devstack sudo[103006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fff03950-a6c1-41de-8360-d5c34f3977c6.83316f41-88cf-4e42-b6bd-ec62ac6c0fb8 Jul 07 08:31:59 devstack sudo[103006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:59 devstack sudo[103006]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-dd992669-4ec6-4d2f-ae6b-c68fd0ca49ad tempest-CreateVolumesFromSnapshotTest-573977501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fff03950-a6c1-41de-8360-d5c34f3977c6.83316f41-88cf-4e42-b6bd-ec62ac6c0fb8" returned: 0 in 0.697s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:00 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-dd992669-4ec6-4d2f-ae6b-c68fd0ca49ad tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "cinder-quobyte-83316f41-88cf-4e42-b6bd-ec62ac6c0fb8" released by "_delete_snapshot" :: held 3.280s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:32:00 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-dd992669-4ec6-4d2f-ae6b-c68fd0ca49ad tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "cinder-quobyte-fff03950-a6c1-41de-8360-d5c34f3977c6" released by "delete_snapshot" :: held 3.305s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:32:00 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-dd992669-4ec6-4d2f-ae6b-c68fd0ca49ad tempest-CreateVolumesFromSnapshotTest-573977501 None] Created reservations ['ed05299d-1362-4773-a701-57d0c7e1851a', '4028e654-97ce-467f-84e7-59b84488ee9a', 'e31b327f-99c2-43a7-a34e-3d6610f465f1', '0a6d93ad-860a-4d77-9075-91dc6987f059'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:32:00 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-dd992669-4ec6-4d2f-ae6b-c68fd0ca49ad tempest-CreateVolumesFromSnapshotTest-573977501 None] Delete snapshot completed successfully. Jul 07 08:32:00 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-dd992669-4ec6-4d2f-ae6b-c68fd0ca49ad tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "cinder-83316f41-88cf-4e42-b6bd-ec62ac6c0fb8-delete_snapshot" released by "delete_snapshot" :: held 3.437s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:32:00 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d5c10c97-d4af-45b7-9ba8-40a0fcd38458 tempest-CreateVolumesFromSnapshotTest-573977501 None] Acquiring lock "cinder-fff03950-a6c1-41de-8360-d5c34f3977c6-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:32:00 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d5c10c97-d4af-45b7-9ba8-40a0fcd38458 tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "cinder-fff03950-a6c1-41de-8360-d5c34f3977c6-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:32:00 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d5c10c97-d4af-45b7-9ba8-40a0fcd38458 tempest-CreateVolumesFromSnapshotTest-573977501 None] Acquiring lock "cinder-quobyte-fff03950-a6c1-41de-8360-d5c34f3977c6" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:32:00 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d5c10c97-d4af-45b7-9ba8-40a0fcd38458 tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "cinder-quobyte-fff03950-a6c1-41de-8360-d5c34f3977c6" acquired by "delete_volume" :: waited 0.016s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:32:00 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c54b9d-5096-44ef-a2ca-bf9e78920696]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:32:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d5c10c97-d4af-45b7-9ba8-40a0fcd38458 tempest-CreateVolumesFromSnapshotTest-573977501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fff03950-a6c1-41de-8360-d5c34f3977c6 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:01 devstack sudo[103076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fff03950-a6c1-41de-8360-d5c34f3977c6 Jul 07 08:32:01 devstack sudo[103076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:01 devstack sudo[103076]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d5c10c97-d4af-45b7-9ba8-40a0fcd38458 tempest-CreateVolumesFromSnapshotTest-573977501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fff03950-a6c1-41de-8360-d5c34f3977c6" returned: 0 in 0.786s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d5c10c97-d4af-45b7-9ba8-40a0fcd38458 tempest-CreateVolumesFromSnapshotTest-573977501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fff03950-a6c1-41de-8360-d5c34f3977c6 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:01 devstack sudo[103084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fff03950-a6c1-41de-8360-d5c34f3977c6 Jul 07 08:32:01 devstack sudo[103084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:02 devstack sudo[103084]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d5c10c97-d4af-45b7-9ba8-40a0fcd38458 tempest-CreateVolumesFromSnapshotTest-573977501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fff03950-a6c1-41de-8360-d5c34f3977c6" returned: 0 in 0.777s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:02 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d5c10c97-d4af-45b7-9ba8-40a0fcd38458 tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "cinder-quobyte-fff03950-a6c1-41de-8360-d5c34f3977c6" released by "delete_volume" :: held 1.628s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:32:02 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-d5c10c97-d4af-45b7-9ba8-40a0fcd38458 tempest-CreateVolumesFromSnapshotTest-573977501 None] Created reservations ['e525e458-fa23-4ead-be83-4a9a2e2ffa1c', 'a6fe80f1-b7ac-4222-80b9-8e1d46d167d6', '06c3a40a-c104-41bb-a06e-b9f5e9e2b7f0', '5f36e6c1-d701-4c09-9815-b391662ef2d5'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:32:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d5c10c97-d4af-45b7-9ba8-40a0fcd38458 tempest-CreateVolumesFromSnapshotTest-573977501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:32:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d5c10c97-d4af-45b7-9ba8-40a0fcd38458 tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:32:02 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d5c10c97-d4af-45b7-9ba8-40a0fcd38458 tempest-CreateVolumesFromSnapshotTest-573977501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:32:02 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d5c10c97-d4af-45b7-9ba8-40a0fcd38458 tempest-CreateVolumesFromSnapshotTest-573977501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:32:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d5c10c97-d4af-45b7-9ba8-40a0fcd38458 tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:32:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d5c10c97-d4af-45b7-9ba8-40a0fcd38458 tempest-CreateVolumesFromSnapshotTest-573977501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:02 devstack sudo[103130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:32:02 devstack sudo[103130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:03 devstack sudo[103130]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d5c10c97-d4af-45b7-9ba8-40a0fcd38458 tempest-CreateVolumesFromSnapshotTest-573977501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.662s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:03 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-d5c10c97-d4af-45b7-9ba8-40a0fcd38458 tempest-CreateVolumesFromSnapshotTest-573977501 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:32:03 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-d5c10c97-d4af-45b7-9ba8-40a0fcd38458 tempest-CreateVolumesFromSnapshotTest-573977501 None] Deleted volume successfully. Jul 07 08:32:03 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d5c10c97-d4af-45b7-9ba8-40a0fcd38458 tempest-CreateVolumesFromSnapshotTest-573977501 None] Lock "cinder-fff03950-a6c1-41de-8360-d5c34f3977c6-delete_volume" released by "delete_volume" :: held 2.572s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:32:05 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:32:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:32:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:32:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:32:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:32:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:32:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:05 devstack sudo[103467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:32:05 devstack sudo[103467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:06 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec94e5dd-bb41-4b9a-80c1-3464d5ae95c6 tempest-VolumeDependencyTests-1464435528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:32:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ec94e5dd-bb41-4b9a-80c1-3464d5ae95c6 tempest-VolumeDependencyTests-1464435528 None] Flow 'volume_create_manager' (631a4475-5a84-41b1-b7fe-03645ebb3ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:32:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ec94e5dd-bb41-4b9a-80c1-3464d5ae95c6 tempest-VolumeDependencyTests-1464435528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6587f65f-14ca-4393-a2a0-1d08e081cfaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:32:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ec94e5dd-bb41-4b9a-80c1-3464d5ae95c6 tempest-VolumeDependencyTests-1464435528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6587f65f-14ca-4393-a2a0-1d08e081cfaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-834290398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0390ead1-cc22-4185-91b8-ff6db2e43013,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5840d8d5d2a4446b933394574ca80b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:32:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:32:06Z,use_quota=True,user_id='4d3261a1382a4f258a5b5796954d2086',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:32:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ec94e5dd-bb41-4b9a-80c1-3464d5ae95c6 tempest-VolumeDependencyTests-1464435528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01a8cd13-6347-412f-a1fb-fa0021bb4358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:32:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ec94e5dd-bb41-4b9a-80c1-3464d5ae95c6 tempest-VolumeDependencyTests-1464435528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01a8cd13-6347-412f-a1fb-fa0021bb4358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:32:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ec94e5dd-bb41-4b9a-80c1-3464d5ae95c6 tempest-VolumeDependencyTests-1464435528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0046bc9-16e2-4356-a7f0-d82d3770bf84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:32:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ec94e5dd-bb41-4b9a-80c1-3464d5ae95c6 tempest-VolumeDependencyTests-1464435528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0046bc9-16e2-4356-a7f0-d82d3770bf84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0390ead1-cc22-4185-91b8-ff6db2e43013', 'volume_name': 'volume-0390ead1-cc22-4185-91b8-ff6db2e43013', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:32:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ec94e5dd-bb41-4b9a-80c1-3464d5ae95c6 tempest-VolumeDependencyTests-1464435528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a40da89-530e-49b6-b5c8-3917a8edef30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:32:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ec94e5dd-bb41-4b9a-80c1-3464d5ae95c6 tempest-VolumeDependencyTests-1464435528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a40da89-530e-49b6-b5c8-3917a8edef30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:32:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ec94e5dd-bb41-4b9a-80c1-3464d5ae95c6 tempest-VolumeDependencyTests-1464435528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6b24230-5bf1-4ef9-b06b-1455ae500d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:32:06 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-ec94e5dd-bb41-4b9a-80c1-3464d5ae95c6 tempest-VolumeDependencyTests-1464435528 None] Volume 0390ead1-cc22-4185-91b8-ff6db2e43013: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0390ead1-cc22-4185-91b8-ff6db2e43013', 'volume_size': 1} Jul 07 08:32:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ec94e5dd-bb41-4b9a-80c1-3464d5ae95c6 tempest-VolumeDependencyTests-1464435528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:32:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ec94e5dd-bb41-4b9a-80c1-3464d5ae95c6 tempest-VolumeDependencyTests-1464435528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:32:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ec94e5dd-bb41-4b9a-80c1-3464d5ae95c6 tempest-VolumeDependencyTests-1464435528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-834290398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0390ead1-cc22-4185-91b8-ff6db2e43013,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5840d8d5d2a4446b933394574ca80b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:32:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:32:06Z,use_quota=True,user_id='4d3261a1382a4f258a5b5796954d2086',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:32:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-ec94e5dd-bb41-4b9a-80c1-3464d5ae95c6 tempest-VolumeDependencyTests-1464435528 None] Creating volume 0390ead1-cc22-4185-91b8-ff6db2e43013 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:32:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ec94e5dd-bb41-4b9a-80c1-3464d5ae95c6 tempest-VolumeDependencyTests-1464435528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:32:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ec94e5dd-bb41-4b9a-80c1-3464d5ae95c6 tempest-VolumeDependencyTests-1464435528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:32:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ec94e5dd-bb41-4b9a-80c1-3464d5ae95c6 tempest-VolumeDependencyTests-1464435528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:32:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ec94e5dd-bb41-4b9a-80c1-3464d5ae95c6 tempest-VolumeDependencyTests-1464435528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:32:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ec94e5dd-bb41-4b9a-80c1-3464d5ae95c6 tempest-VolumeDependencyTests-1464435528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:32:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ec94e5dd-bb41-4b9a-80c1-3464d5ae95c6 tempest-VolumeDependencyTests-1464435528 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:32:06 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-ec94e5dd-bb41-4b9a-80c1-3464d5ae95c6 tempest-VolumeDependencyTests-1464435528 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:32:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ec94e5dd-bb41-4b9a-80c1-3464d5ae95c6 tempest-VolumeDependencyTests-1464435528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0390ead1-cc22-4185-91b8-ff6db2e43013 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:06 devstack sudo[103469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0390ead1-cc22-4185-91b8-ff6db2e43013 1073741824 Jul 07 08:32:06 devstack sudo[103469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:06 devstack sudo[103467]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.883s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:06 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:32:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running periodic task VolumeManager._thread_info {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:32:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] thread count: 29 {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 08:32:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] thread info: [<_MainThread(MainThread, started 133056092332160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 08:32:07 devstack sudo[103469]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ec94e5dd-bb41-4b9a-80c1-3464d5ae95c6 tempest-VolumeDependencyTests-1464435528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0390ead1-cc22-4185-91b8-ff6db2e43013 1073741824" returned: 0 in 1.026s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ec94e5dd-bb41-4b9a-80c1-3464d5ae95c6 tempest-VolumeDependencyTests-1464435528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0390ead1-cc22-4185-91b8-ff6db2e43013 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:07 devstack sudo[103476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0390ead1-cc22-4185-91b8-ff6db2e43013 Jul 07 08:32:07 devstack sudo[103476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:08 devstack sudo[103476]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ec94e5dd-bb41-4b9a-80c1-3464d5ae95c6 tempest-VolumeDependencyTests-1464435528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0390ead1-cc22-4185-91b8-ff6db2e43013" returned: 0 in 0.720s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:08 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ec94e5dd-bb41-4b9a-80c1-3464d5ae95c6 tempest-VolumeDependencyTests-1464435528 None] <== create_volume: return (1795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:32:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ec94e5dd-bb41-4b9a-80c1-3464d5ae95c6 tempest-VolumeDependencyTests-1464435528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.798s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:32:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ec94e5dd-bb41-4b9a-80c1-3464d5ae95c6 tempest-VolumeDependencyTests-1464435528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6b24230-5bf1-4ef9-b06b-1455ae500d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0390ead1-cc22-4185-91b8-ff6db2e43013', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:32:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ec94e5dd-bb41-4b9a-80c1-3464d5ae95c6 tempest-VolumeDependencyTests-1464435528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4958d144-55b7-4f26-8ea6-cea289ce5533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:32:08 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-ec94e5dd-bb41-4b9a-80c1-3464d5ae95c6 tempest-VolumeDependencyTests-1464435528 None] Volume volume-0390ead1-cc22-4185-91b8-ff6db2e43013 (0390ead1-cc22-4185-91b8-ff6db2e43013): created successfully Jul 07 08:32:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ec94e5dd-bb41-4b9a-80c1-3464d5ae95c6 tempest-VolumeDependencyTests-1464435528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4958d144-55b7-4f26-8ea6-cea289ce5533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:32:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ec94e5dd-bb41-4b9a-80c1-3464d5ae95c6 tempest-VolumeDependencyTests-1464435528 None] Flow 'volume_create_manager' (631a4475-5a84-41b1-b7fe-03645ebb3ac4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:32:08 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-ec94e5dd-bb41-4b9a-80c1-3464d5ae95c6 tempest-VolumeDependencyTests-1464435528 None] Created volume successfully. Jul 07 08:32:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d7e584e8-8efa-49e8-afbd-a775f0b00705 tempest-VolumeDependencyTests-1464435528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:32:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d7e584e8-8efa-49e8-afbd-a775f0b00705 tempest-VolumeDependencyTests-1464435528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:32:09 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-d7e584e8-8efa-49e8-afbd-a775f0b00705 tempest-VolumeDependencyTests-1464435528 None] Creating offline snapshot 0f50658c-ab66-4c88-9b79-9feba04931ee of volume 0390ead1-cc22-4185-91b8-ff6db2e43013 {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:32:09 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4032aa2-6140-4733-9cbd-eb4922b08b86]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:32:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d7e584e8-8efa-49e8-afbd-a775f0b00705 tempest-VolumeDependencyTests-1464435528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0390ead1-cc22-4185-91b8-ff6db2e43013 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:10 devstack sudo[103481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0390ead1-cc22-4185-91b8-ff6db2e43013 Jul 07 08:32:10 devstack sudo[103481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:10 devstack sudo[103481]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d7e584e8-8efa-49e8-afbd-a775f0b00705 tempest-VolumeDependencyTests-1464435528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0390ead1-cc22-4185-91b8-ff6db2e43013" returned: 0 in 0.848s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d7e584e8-8efa-49e8-afbd-a775f0b00705 tempest-VolumeDependencyTests-1464435528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0390ead1-cc22-4185-91b8-ff6db2e43013,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0390ead1-cc22-4185-91b8-ff6db2e43013.0f50658c-ab66-4c88-9b79-9feba04931ee 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:10 devstack sudo[103487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0390ead1-cc22-4185-91b8-ff6db2e43013,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0390ead1-cc22-4185-91b8-ff6db2e43013.0f50658c-ab66-4c88-9b79-9feba04931ee 1G Jul 07 08:32:10 devstack sudo[103487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:11 devstack sudo[103487]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d7e584e8-8efa-49e8-afbd-a775f0b00705 tempest-VolumeDependencyTests-1464435528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0390ead1-cc22-4185-91b8-ff6db2e43013,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0390ead1-cc22-4185-91b8-ff6db2e43013.0f50658c-ab66-4c88-9b79-9feba04931ee 1G" returned: 0 in 0.830s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d7e584e8-8efa-49e8-afbd-a775f0b00705 tempest-VolumeDependencyTests-1464435528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0390ead1-cc22-4185-91b8-ff6db2e43013 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0390ead1-cc22-4185-91b8-ff6db2e43013.0f50658c-ab66-4c88-9b79-9feba04931ee {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:11 devstack sudo[103493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0390ead1-cc22-4185-91b8-ff6db2e43013 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0390ead1-cc22-4185-91b8-ff6db2e43013.0f50658c-ab66-4c88-9b79-9feba04931ee Jul 07 08:32:11 devstack sudo[103493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:12 devstack sudo[103493]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d7e584e8-8efa-49e8-afbd-a775f0b00705 tempest-VolumeDependencyTests-1464435528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0390ead1-cc22-4185-91b8-ff6db2e43013 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0390ead1-cc22-4185-91b8-ff6db2e43013.0f50658c-ab66-4c88-9b79-9feba04931ee" returned: 0 in 0.690s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:12 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-d7e584e8-8efa-49e8-afbd-a775f0b00705 tempest-VolumeDependencyTests-1464435528 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0390ead1-cc22-4185-91b8-ff6db2e43013.0f50658c-ab66-4c88-9b79-9feba04931ee is being set with open permissions: ugo+rw Jul 07 08:32:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d7e584e8-8efa-49e8-afbd-a775f0b00705 tempest-VolumeDependencyTests-1464435528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0390ead1-cc22-4185-91b8-ff6db2e43013.0f50658c-ab66-4c88-9b79-9feba04931ee {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:12 devstack sudo[103498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0390ead1-cc22-4185-91b8-ff6db2e43013.0f50658c-ab66-4c88-9b79-9feba04931ee Jul 07 08:32:12 devstack sudo[103498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:13 devstack sudo[103498]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d7e584e8-8efa-49e8-afbd-a775f0b00705 tempest-VolumeDependencyTests-1464435528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0390ead1-cc22-4185-91b8-ff6db2e43013.0f50658c-ab66-4c88-9b79-9feba04931ee" returned: 0 in 0.682s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d7e584e8-8efa-49e8-afbd-a775f0b00705 tempest-VolumeDependencyTests-1464435528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0390ead1-cc22-4185-91b8-ff6db2e43013.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:13 devstack sudo[103501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0390ead1-cc22-4185-91b8-ff6db2e43013.info Jul 07 08:32:13 devstack sudo[103501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:13 devstack sudo[103501]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d7e584e8-8efa-49e8-afbd-a775f0b00705 tempest-VolumeDependencyTests-1464435528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0390ead1-cc22-4185-91b8-ff6db2e43013.info" returned: 0 in 0.671s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:13 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-d7e584e8-8efa-49e8-afbd-a775f0b00705 tempest-VolumeDependencyTests-1464435528 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0390ead1-cc22-4185-91b8-ff6db2e43013.info is being set with open permissions: ugo+rw Jul 07 08:32:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d7e584e8-8efa-49e8-afbd-a775f0b00705 tempest-VolumeDependencyTests-1464435528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0390ead1-cc22-4185-91b8-ff6db2e43013.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:13 devstack sudo[103504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0390ead1-cc22-4185-91b8-ff6db2e43013.info Jul 07 08:32:13 devstack sudo[103504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:14 devstack sudo[103504]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d7e584e8-8efa-49e8-afbd-a775f0b00705 tempest-VolumeDependencyTests-1464435528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0390ead1-cc22-4185-91b8-ff6db2e43013.info" returned: 0 in 0.658s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d7e584e8-8efa-49e8-afbd-a775f0b00705 tempest-VolumeDependencyTests-1464435528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.519s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:32:14 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-d7e584e8-8efa-49e8-afbd-a775f0b00705 tempest-VolumeDependencyTests-1464435528 None] Create snapshot completed successfully Jul 07 08:32:15 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bcef305-7458-41b3-b1a3-e37954722164 tempest-VolumeDependencyTests-1464435528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:32:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8bcef305-7458-41b3-b1a3-e37954722164 tempest-VolumeDependencyTests-1464435528 None] Flow 'volume_create_manager' (0c02b095-055f-436a-9f0b-b04f8f0aaff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:32:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8bcef305-7458-41b3-b1a3-e37954722164 tempest-VolumeDependencyTests-1464435528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (211286af-4e6e-4f6f-a6b5-dbbeae513f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:32:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8bcef305-7458-41b3-b1a3-e37954722164 tempest-VolumeDependencyTests-1464435528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (211286af-4e6e-4f6f-a6b5-dbbeae513f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:32:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-916439440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7de5a92-89e9-413a-bceb-8662b638876b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5840d8d5d2a4446b933394574ca80b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0f50658c-ab66-4c88-9b79-9feba04931ee,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:32:16Z,use_quota=True,user_id='4d3261a1382a4f258a5b5796954d2086',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:32:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8bcef305-7458-41b3-b1a3-e37954722164 tempest-VolumeDependencyTests-1464435528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56afd306-8d92-46e8-b708-3f4be2b910ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:32:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8bcef305-7458-41b3-b1a3-e37954722164 tempest-VolumeDependencyTests-1464435528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56afd306-8d92-46e8-b708-3f4be2b910ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:32:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8bcef305-7458-41b3-b1a3-e37954722164 tempest-VolumeDependencyTests-1464435528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1487c63a-3e00-4afa-a6d8-b0bcde4f78d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:32:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8bcef305-7458-41b3-b1a3-e37954722164 tempest-VolumeDependencyTests-1464435528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1487c63a-3e00-4afa-a6d8-b0bcde4f78d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c7de5a92-89e9-413a-bceb-8662b638876b', 'volume_name': 'volume-c7de5a92-89e9-413a-bceb-8662b638876b', 'volume_size': 1, 'snapshot_id': '0f50658c-ab66-4c88-9b79-9feba04931ee'}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:32:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8bcef305-7458-41b3-b1a3-e37954722164 tempest-VolumeDependencyTests-1464435528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4909dd3-f1d1-4a9a-8035-33755875e49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:32:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8bcef305-7458-41b3-b1a3-e37954722164 tempest-VolumeDependencyTests-1464435528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4909dd3-f1d1-4a9a-8035-33755875e49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:32:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8bcef305-7458-41b3-b1a3-e37954722164 tempest-VolumeDependencyTests-1464435528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7908205e-553c-446f-9f9d-a20e3e9f4609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:32:15 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-8bcef305-7458-41b3-b1a3-e37954722164 tempest-VolumeDependencyTests-1464435528 None] Volume c7de5a92-89e9-413a-bceb-8662b638876b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c7de5a92-89e9-413a-bceb-8662b638876b', 'volume_size': 1, 'snapshot_id': '0f50658c-ab66-4c88-9b79-9feba04931ee'} Jul 07 08:32:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8bcef305-7458-41b3-b1a3-e37954722164 tempest-VolumeDependencyTests-1464435528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:32:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8bcef305-7458-41b3-b1a3-e37954722164 tempest-VolumeDependencyTests-1464435528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:32:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8bcef305-7458-41b3-b1a3-e37954722164 tempest-VolumeDependencyTests-1464435528 None] Acquiring lock "cinder-quobyte-0f50658c-ab66-4c88-9b79-9feba04931ee-c7de5a92-89e9-413a-bceb-8662b638876b" by "_create_volume_from_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:32:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8bcef305-7458-41b3-b1a3-e37954722164 tempest-VolumeDependencyTests-1464435528 None] Lock "cinder-quobyte-0f50658c-ab66-4c88-9b79-9feba04931ee-c7de5a92-89e9-413a-bceb-8662b638876b" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:32:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8bcef305-7458-41b3-b1a3-e37954722164 tempest-VolumeDependencyTests-1464435528 None] Creating volume c7de5a92-89e9-413a-bceb-8662b638876b from snapshot 0f50658c-ab66-4c88-9b79-9feba04931ee {{(pid=87199) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 08:32:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8bcef305-7458-41b3-b1a3-e37954722164 tempest-VolumeDependencyTests-1464435528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:32:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8bcef305-7458-41b3-b1a3-e37954722164 tempest-VolumeDependencyTests-1464435528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:32:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8bcef305-7458-41b3-b1a3-e37954722164 tempest-VolumeDependencyTests-1464435528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:32:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8bcef305-7458-41b3-b1a3-e37954722164 tempest-VolumeDependencyTests-1464435528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:32:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8bcef305-7458-41b3-b1a3-e37954722164 tempest-VolumeDependencyTests-1464435528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:32:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8bcef305-7458-41b3-b1a3-e37954722164 tempest-VolumeDependencyTests-1464435528 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:32:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8bcef305-7458-41b3-b1a3-e37954722164 tempest-VolumeDependencyTests-1464435528 None] Acquiring lock "cinder-quobyte-c7de5a92-89e9-413a-bceb-8662b638876b" by "_copy_volume_from_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:32:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8bcef305-7458-41b3-b1a3-e37954722164 tempest-VolumeDependencyTests-1464435528 None] Lock "cinder-quobyte-c7de5a92-89e9-413a-bceb-8662b638876b" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:32:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8bcef305-7458-41b3-b1a3-e37954722164 tempest-VolumeDependencyTests-1464435528 None] snapshot: 0f50658c-ab66-4c88-9b79-9feba04931ee, volume: c7de5a92-89e9-413a-bceb-8662b638876b, {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 08:32:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8bcef305-7458-41b3-b1a3-e37954722164 tempest-VolumeDependencyTests-1464435528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:32:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8bcef305-7458-41b3-b1a3-e37954722164 tempest-VolumeDependencyTests-1464435528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:32:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8bcef305-7458-41b3-b1a3-e37954722164 tempest-VolumeDependencyTests-1464435528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:32:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8bcef305-7458-41b3-b1a3-e37954722164 tempest-VolumeDependencyTests-1464435528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:32:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8bcef305-7458-41b3-b1a3-e37954722164 tempest-VolumeDependencyTests-1464435528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:32:15 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f4eb03-4f55-46b4-843a-e8d6b400bc3f]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:32:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8bcef305-7458-41b3-b1a3-e37954722164 tempest-VolumeDependencyTests-1464435528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0390ead1-cc22-4185-91b8-ff6db2e43013.0f50658c-ab66-4c88-9b79-9feba04931ee {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:15 devstack sudo[103507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0390ead1-cc22-4185-91b8-ff6db2e43013.0f50658c-ab66-4c88-9b79-9feba04931ee Jul 07 08:32:15 devstack sudo[103507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:16 devstack sudo[103507]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8bcef305-7458-41b3-b1a3-e37954722164 tempest-VolumeDependencyTests-1464435528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0390ead1-cc22-4185-91b8-ff6db2e43013.0f50658c-ab66-4c88-9b79-9feba04931ee" returned: 0 in 0.834s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:16 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-8bcef305-7458-41b3-b1a3-e37954722164 tempest-VolumeDependencyTests-1464435528 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0390ead1-cc22-4185-91b8-ff6db2e43013(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:32:16 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8bcef305-7458-41b3-b1a3-e37954722164 tempest-VolumeDependencyTests-1464435528 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0390ead1-cc22-4185-91b8-ff6db2e43013 {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 08:32:16 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8bcef305-7458-41b3-b1a3-e37954722164 tempest-VolumeDependencyTests-1464435528 None] Creating direct copy from snapshot {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 08:32:16 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[29aab4e0-4ff7-47b4-9193-f16110be9b83]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:32:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8bcef305-7458-41b3-b1a3-e37954722164 tempest-VolumeDependencyTests-1464435528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0390ead1-cc22-4185-91b8-ff6db2e43013 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:16 devstack sudo[103512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0390ead1-cc22-4185-91b8-ff6db2e43013 Jul 07 08:32:16 devstack sudo[103512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:17 devstack sudo[103512]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8bcef305-7458-41b3-b1a3-e37954722164 tempest-VolumeDependencyTests-1464435528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0390ead1-cc22-4185-91b8-ff6db2e43013" returned: 0 in 0.748s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:17 devstack cinder-volume[87199]: DEBUG cinder.utils [None req-8bcef305-7458-41b3-b1a3-e37954722164 tempest-VolumeDependencyTests-1464435528 None] Path /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c7de5a92-89e9-413a-bceb-8662b638876b not found in is_blk_device check {{(pid=87199) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 08:32:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8bcef305-7458-41b3-b1a3-e37954722164 tempest-VolumeDependencyTests-1464435528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0390ead1-cc22-4185-91b8-ff6db2e43013 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c7de5a92-89e9-413a-bceb-8662b638876b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:17 devstack sudo[103517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0390ead1-cc22-4185-91b8-ff6db2e43013 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c7de5a92-89e9-413a-bceb-8662b638876b Jul 07 08:32:17 devstack sudo[103517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:22 devstack sudo[103517]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8bcef305-7458-41b3-b1a3-e37954722164 tempest-VolumeDependencyTests-1464435528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0390ead1-cc22-4185-91b8-ff6db2e43013 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c7de5a92-89e9-413a-bceb-8662b638876b" returned: 0 in 5.018s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:22 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6fc448-b9a3-42b0-858f-1bd59994a552]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:32:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8bcef305-7458-41b3-b1a3-e37954722164 tempest-VolumeDependencyTests-1464435528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0390ead1-cc22-4185-91b8-ff6db2e43013 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:22 devstack sudo[103638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0390ead1-cc22-4185-91b8-ff6db2e43013 Jul 07 08:32:22 devstack sudo[103638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:23 devstack sudo[103638]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8bcef305-7458-41b3-b1a3-e37954722164 tempest-VolumeDependencyTests-1464435528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0390ead1-cc22-4185-91b8-ff6db2e43013" returned: 0 in 0.903s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:23 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-8bcef305-7458-41b3-b1a3-e37954722164 tempest-VolumeDependencyTests-1464435528 None] Image conversion details: src /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0390ead1-cc22-4185-91b8-ff6db2e43013, size 1024.00 MB, duration 5.02 sec, destination /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c7de5a92-89e9-413a-bceb-8662b638876b {{(pid=87199) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 08:32:23 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-8bcef305-7458-41b3-b1a3-e37954722164 tempest-VolumeDependencyTests-1464435528 None] Converted 1024.00 MB image at 204.03 MB/s Jul 07 08:32:23 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-8bcef305-7458-41b3-b1a3-e37954722164 tempest-VolumeDependencyTests-1464435528 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c7de5a92-89e9-413a-bceb-8662b638876b is being set with open permissions: ugo+rw Jul 07 08:32:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8bcef305-7458-41b3-b1a3-e37954722164 tempest-VolumeDependencyTests-1464435528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c7de5a92-89e9-413a-bceb-8662b638876b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:23 devstack sudo[103643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c7de5a92-89e9-413a-bceb-8662b638876b Jul 07 08:32:23 devstack sudo[103643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:24 devstack sudo[103643]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8bcef305-7458-41b3-b1a3-e37954722164 tempest-VolumeDependencyTests-1464435528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c7de5a92-89e9-413a-bceb-8662b638876b" returned: 0 in 0.664s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8bcef305-7458-41b3-b1a3-e37954722164 tempest-VolumeDependencyTests-1464435528 None] Lock "cinder-quobyte-c7de5a92-89e9-413a-bceb-8662b638876b" released by "_copy_volume_from_snapshot" :: held 8.254s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:32:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8bcef305-7458-41b3-b1a3-e37954722164 tempest-VolumeDependencyTests-1464435528 None] Lock "cinder-quobyte-0f50658c-ab66-4c88-9b79-9feba04931ee-c7de5a92-89e9-413a-bceb-8662b638876b" released by "_create_volume_from_snapshot" :: held 8.289s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:32:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8bcef305-7458-41b3-b1a3-e37954722164 tempest-VolumeDependencyTests-1464435528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.306s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:32:24 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:UPDATE=95,cinder:SELECT=69,cinder:INSERT=21,cinder:DELETE=10 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:32:24 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=80,cinder:UPDATE=75,cinder:INSERT=30,cinder:DELETE=6 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:32:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8bcef305-7458-41b3-b1a3-e37954722164 tempest-VolumeDependencyTests-1464435528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7908205e-553c-446f-9f9d-a20e3e9f4609) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7de5a92-89e9-413a-bceb-8662b638876b', 'volume_size': 1, 'snapshot_id': '0f50658c-ab66-4c88-9b79-9feba04931ee'}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:32:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8bcef305-7458-41b3-b1a3-e37954722164 tempest-VolumeDependencyTests-1464435528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3079ce43-7aa5-465c-a292-2ac86fe61fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:32:24 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-8bcef305-7458-41b3-b1a3-e37954722164 tempest-VolumeDependencyTests-1464435528 None] Volume volume-c7de5a92-89e9-413a-bceb-8662b638876b (c7de5a92-89e9-413a-bceb-8662b638876b): created successfully Jul 07 08:32:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8bcef305-7458-41b3-b1a3-e37954722164 tempest-VolumeDependencyTests-1464435528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3079ce43-7aa5-465c-a292-2ac86fe61fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:32:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8bcef305-7458-41b3-b1a3-e37954722164 tempest-VolumeDependencyTests-1464435528 None] Flow 'volume_create_manager' (0c02b095-055f-436a-9f0b-b04f8f0aaff0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:32:24 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-8bcef305-7458-41b3-b1a3-e37954722164 tempest-VolumeDependencyTests-1464435528 None] Created volume successfully. Jul 07 08:32:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5b806d74-6904-4646-922c-c8b1a11909e8 tempest-VolumeDependencyTests-1464435528 None] Acquiring lock "cinder-0f50658c-ab66-4c88-9b79-9feba04931ee-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:32:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5b806d74-6904-4646-922c-c8b1a11909e8 tempest-VolumeDependencyTests-1464435528 None] Lock "cinder-0f50658c-ab66-4c88-9b79-9feba04931ee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:32:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5b806d74-6904-4646-922c-c8b1a11909e8 tempest-VolumeDependencyTests-1464435528 None] Acquiring lock "cinder-quobyte-0390ead1-cc22-4185-91b8-ff6db2e43013" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:32:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5b806d74-6904-4646-922c-c8b1a11909e8 tempest-VolumeDependencyTests-1464435528 None] Lock "cinder-quobyte-0390ead1-cc22-4185-91b8-ff6db2e43013" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:32:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5b806d74-6904-4646-922c-c8b1a11909e8 tempest-VolumeDependencyTests-1464435528 None] Acquiring lock "cinder-quobyte-0f50658c-ab66-4c88-9b79-9feba04931ee" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:32:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5b806d74-6904-4646-922c-c8b1a11909e8 tempest-VolumeDependencyTests-1464435528 None] Lock "cinder-quobyte-0f50658c-ab66-4c88-9b79-9feba04931ee" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:32:24 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-5b806d74-6904-4646-922c-c8b1a11909e8 tempest-VolumeDependencyTests-1464435528 None] Deleting offline snapshot 0f50658c-ab66-4c88-9b79-9feba04931ee of volume 0390ead1-cc22-4185-91b8-ff6db2e43013 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:32:24 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-5b806d74-6904-4646-922c-c8b1a11909e8 tempest-VolumeDependencyTests-1464435528 None] snapshot_file for this snap is: volume-0390ead1-cc22-4185-91b8-ff6db2e43013.0f50658c-ab66-4c88-9b79-9feba04931ee {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:32:24 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b7644d-a37f-42d4-b794-f5c88f7e18d7]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:32:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5b806d74-6904-4646-922c-c8b1a11909e8 tempest-VolumeDependencyTests-1464435528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0390ead1-cc22-4185-91b8-ff6db2e43013.0f50658c-ab66-4c88-9b79-9feba04931ee {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:24 devstack sudo[103646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0390ead1-cc22-4185-91b8-ff6db2e43013.0f50658c-ab66-4c88-9b79-9feba04931ee Jul 07 08:32:24 devstack sudo[103646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:25 devstack sudo[103646]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5b806d74-6904-4646-922c-c8b1a11909e8 tempest-VolumeDependencyTests-1464435528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0390ead1-cc22-4185-91b8-ff6db2e43013.0f50658c-ab66-4c88-9b79-9feba04931ee" returned: 0 in 0.737s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:25 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-5b806d74-6904-4646-922c-c8b1a11909e8 tempest-VolumeDependencyTests-1464435528 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0390ead1-cc22-4185-91b8-ff6db2e43013(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:32:25 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[839f7295-90b6-4fa1-bca7-6341c0768874]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:32:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5b806d74-6904-4646-922c-c8b1a11909e8 tempest-VolumeDependencyTests-1464435528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0390ead1-cc22-4185-91b8-ff6db2e43013 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:25 devstack sudo[103651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0390ead1-cc22-4185-91b8-ff6db2e43013 Jul 07 08:32:25 devstack sudo[103651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:26 devstack sudo[103651]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5b806d74-6904-4646-922c-c8b1a11909e8 tempest-VolumeDependencyTests-1464435528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0390ead1-cc22-4185-91b8-ff6db2e43013" returned: 0 in 0.754s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5b806d74-6904-4646-922c-c8b1a11909e8 tempest-VolumeDependencyTests-1464435528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0390ead1-cc22-4185-91b8-ff6db2e43013.0f50658c-ab66-4c88-9b79-9feba04931ee {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:26 devstack sudo[103656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0390ead1-cc22-4185-91b8-ff6db2e43013.0f50658c-ab66-4c88-9b79-9feba04931ee Jul 07 08:32:26 devstack sudo[103656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:26 devstack sudo[103656]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5b806d74-6904-4646-922c-c8b1a11909e8 tempest-VolumeDependencyTests-1464435528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0390ead1-cc22-4185-91b8-ff6db2e43013.0f50658c-ab66-4c88-9b79-9feba04931ee" returned: 0 in 0.716s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5b806d74-6904-4646-922c-c8b1a11909e8 tempest-VolumeDependencyTests-1464435528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0390ead1-cc22-4185-91b8-ff6db2e43013.0f50658c-ab66-4c88-9b79-9feba04931ee {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:26 devstack sudo[103661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0390ead1-cc22-4185-91b8-ff6db2e43013.0f50658c-ab66-4c88-9b79-9feba04931ee Jul 07 08:32:26 devstack sudo[103661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:27 devstack sudo[103661]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5b806d74-6904-4646-922c-c8b1a11909e8 tempest-VolumeDependencyTests-1464435528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0390ead1-cc22-4185-91b8-ff6db2e43013.0f50658c-ab66-4c88-9b79-9feba04931ee" returned: 0 in 0.637s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:27 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5b806d74-6904-4646-922c-c8b1a11909e8 tempest-VolumeDependencyTests-1464435528 None] Lock "cinder-quobyte-0f50658c-ab66-4c88-9b79-9feba04931ee" released by "_delete_snapshot" :: held 2.933s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:32:27 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5b806d74-6904-4646-922c-c8b1a11909e8 tempest-VolumeDependencyTests-1464435528 None] Lock "cinder-quobyte-0390ead1-cc22-4185-91b8-ff6db2e43013" released by "delete_snapshot" :: held 2.956s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:32:27 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-5b806d74-6904-4646-922c-c8b1a11909e8 tempest-VolumeDependencyTests-1464435528 None] Created reservations ['ac6362b5-7e7e-4ff7-b0c4-0363142e677f', 'fc5d65d8-95e9-4184-95d6-f0a7dc47655a', 'beddc0c7-5119-4834-9464-a85396fb666b', 'a159a0f7-cbd0-4e60-a565-137ce2a1786c'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:32:27 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-5b806d74-6904-4646-922c-c8b1a11909e8 tempest-VolumeDependencyTests-1464435528 None] Delete snapshot completed successfully. Jul 07 08:32:27 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5b806d74-6904-4646-922c-c8b1a11909e8 tempest-VolumeDependencyTests-1464435528 None] Lock "cinder-0f50658c-ab66-4c88-9b79-9feba04931ee-delete_snapshot" released by "delete_snapshot" :: held 3.083s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:32:27 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cabdd68d-c65f-4ca4-abd9-c5d0e6c54967 tempest-VolumeDependencyTests-1464435528 None] Acquiring lock "cinder-0390ead1-cc22-4185-91b8-ff6db2e43013-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:32:27 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cabdd68d-c65f-4ca4-abd9-c5d0e6c54967 tempest-VolumeDependencyTests-1464435528 None] Lock "cinder-0390ead1-cc22-4185-91b8-ff6db2e43013-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:32:27 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cabdd68d-c65f-4ca4-abd9-c5d0e6c54967 tempest-VolumeDependencyTests-1464435528 None] Acquiring lock "cinder-quobyte-0390ead1-cc22-4185-91b8-ff6db2e43013" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:32:27 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cabdd68d-c65f-4ca4-abd9-c5d0e6c54967 tempest-VolumeDependencyTests-1464435528 None] Lock "cinder-quobyte-0390ead1-cc22-4185-91b8-ff6db2e43013" acquired by "delete_volume" :: waited 0.019s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:32:27 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd88f028-3a96-4689-8643-914a83782af8]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:32:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cabdd68d-c65f-4ca4-abd9-c5d0e6c54967 tempest-VolumeDependencyTests-1464435528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0390ead1-cc22-4185-91b8-ff6db2e43013 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:28 devstack sudo[103664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0390ead1-cc22-4185-91b8-ff6db2e43013 Jul 07 08:32:28 devstack sudo[103664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:28 devstack sudo[103664]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cabdd68d-c65f-4ca4-abd9-c5d0e6c54967 tempest-VolumeDependencyTests-1464435528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0390ead1-cc22-4185-91b8-ff6db2e43013" returned: 0 in 0.791s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cabdd68d-c65f-4ca4-abd9-c5d0e6c54967 tempest-VolumeDependencyTests-1464435528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0390ead1-cc22-4185-91b8-ff6db2e43013 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:28 devstack sudo[103670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0390ead1-cc22-4185-91b8-ff6db2e43013 Jul 07 08:32:28 devstack sudo[103670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:29 devstack sudo[103670]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cabdd68d-c65f-4ca4-abd9-c5d0e6c54967 tempest-VolumeDependencyTests-1464435528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-0390ead1-cc22-4185-91b8-ff6db2e43013" returned: 0 in 0.645s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:29 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cabdd68d-c65f-4ca4-abd9-c5d0e6c54967 tempest-VolumeDependencyTests-1464435528 None] Lock "cinder-quobyte-0390ead1-cc22-4185-91b8-ff6db2e43013" released by "delete_volume" :: held 1.513s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:32:29 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-cabdd68d-c65f-4ca4-abd9-c5d0e6c54967 tempest-VolumeDependencyTests-1464435528 None] Created reservations ['a592d76a-8169-478b-a031-5af0b9f1b6d0', '84bc8e93-15f8-4a6c-952b-56d359e8967d', '5e861b2a-6044-4e13-8131-dc2e183f21ef', '65b41eb1-f425-4e7d-825b-9ca893a04b20'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:32:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cabdd68d-c65f-4ca4-abd9-c5d0e6c54967 tempest-VolumeDependencyTests-1464435528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:32:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cabdd68d-c65f-4ca4-abd9-c5d0e6c54967 tempest-VolumeDependencyTests-1464435528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:32:29 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-cabdd68d-c65f-4ca4-abd9-c5d0e6c54967 tempest-VolumeDependencyTests-1464435528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:32:29 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-cabdd68d-c65f-4ca4-abd9-c5d0e6c54967 tempest-VolumeDependencyTests-1464435528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:32:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cabdd68d-c65f-4ca4-abd9-c5d0e6c54967 tempest-VolumeDependencyTests-1464435528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:32:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cabdd68d-c65f-4ca4-abd9-c5d0e6c54967 tempest-VolumeDependencyTests-1464435528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:29 devstack sudo[103673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:32:29 devstack sudo[103673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:30 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a6962dc9-3bf8-4998-aada-bd298a470c91 tempest-VolumeDependencyTests-1464435528 None] Acquiring lock "cinder-c7de5a92-89e9-413a-bceb-8662b638876b-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:32:30 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a6962dc9-3bf8-4998-aada-bd298a470c91 tempest-VolumeDependencyTests-1464435528 None] Lock "cinder-c7de5a92-89e9-413a-bceb-8662b638876b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:32:30 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a6962dc9-3bf8-4998-aada-bd298a470c91 tempest-VolumeDependencyTests-1464435528 None] Acquiring lock "cinder-quobyte-c7de5a92-89e9-413a-bceb-8662b638876b" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:32:30 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a6962dc9-3bf8-4998-aada-bd298a470c91 tempest-VolumeDependencyTests-1464435528 None] Lock "cinder-quobyte-c7de5a92-89e9-413a-bceb-8662b638876b" acquired by "delete_volume" :: waited 0.018s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:32:30 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7d95e3-77ef-49fe-b222-67ac41dea0df]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:32:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a6962dc9-3bf8-4998-aada-bd298a470c91 tempest-VolumeDependencyTests-1464435528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c7de5a92-89e9-413a-bceb-8662b638876b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:30 devstack sudo[103673]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cabdd68d-c65f-4ca4-abd9-c5d0e6c54967 tempest-VolumeDependencyTests-1464435528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.735s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:30 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-cabdd68d-c65f-4ca4-abd9-c5d0e6c54967 tempest-VolumeDependencyTests-1464435528 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:32:30 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-cabdd68d-c65f-4ca4-abd9-c5d0e6c54967 tempest-VolumeDependencyTests-1464435528 None] Deleted volume successfully. Jul 07 08:32:30 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cabdd68d-c65f-4ca4-abd9-c5d0e6c54967 tempest-VolumeDependencyTests-1464435528 None] Lock "cinder-0390ead1-cc22-4185-91b8-ff6db2e43013-delete_volume" released by "delete_volume" :: held 2.448s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:32:30 devstack sudo[103676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c7de5a92-89e9-413a-bceb-8662b638876b Jul 07 08:32:30 devstack sudo[103676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:30 devstack sudo[103676]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a6962dc9-3bf8-4998-aada-bd298a470c91 tempest-VolumeDependencyTests-1464435528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c7de5a92-89e9-413a-bceb-8662b638876b" returned: 0 in 0.800s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a6962dc9-3bf8-4998-aada-bd298a470c91 tempest-VolumeDependencyTests-1464435528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c7de5a92-89e9-413a-bceb-8662b638876b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:30 devstack sudo[103682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c7de5a92-89e9-413a-bceb-8662b638876b Jul 07 08:32:30 devstack sudo[103682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:31 devstack sudo[103682]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a6962dc9-3bf8-4998-aada-bd298a470c91 tempest-VolumeDependencyTests-1464435528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c7de5a92-89e9-413a-bceb-8662b638876b" returned: 0 in 0.630s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:31 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a6962dc9-3bf8-4998-aada-bd298a470c91 tempest-VolumeDependencyTests-1464435528 None] Lock "cinder-quobyte-c7de5a92-89e9-413a-bceb-8662b638876b" released by "delete_volume" :: held 1.477s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:32:31 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-a6962dc9-3bf8-4998-aada-bd298a470c91 tempest-VolumeDependencyTests-1464435528 None] Created reservations ['881e00a2-5753-4659-b668-8c7723051b90', 'dfca334c-6dd7-4a10-9d9c-53718b8422f0', 'e8985daa-75db-4371-8764-8ccf69bfcbce', 'bf25b87e-3da6-426b-a08b-903377dba0ce'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:32:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a6962dc9-3bf8-4998-aada-bd298a470c91 tempest-VolumeDependencyTests-1464435528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:32:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a6962dc9-3bf8-4998-aada-bd298a470c91 tempest-VolumeDependencyTests-1464435528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:32:31 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a6962dc9-3bf8-4998-aada-bd298a470c91 tempest-VolumeDependencyTests-1464435528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:32:31 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a6962dc9-3bf8-4998-aada-bd298a470c91 tempest-VolumeDependencyTests-1464435528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:32:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a6962dc9-3bf8-4998-aada-bd298a470c91 tempest-VolumeDependencyTests-1464435528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:32:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a6962dc9-3bf8-4998-aada-bd298a470c91 tempest-VolumeDependencyTests-1464435528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:31 devstack sudo[103686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:32:31 devstack sudo[103686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:32 devstack sudo[103686]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a6962dc9-3bf8-4998-aada-bd298a470c91 tempest-VolumeDependencyTests-1464435528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.652s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:32 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-a6962dc9-3bf8-4998-aada-bd298a470c91 tempest-VolumeDependencyTests-1464435528 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:32:32 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-a6962dc9-3bf8-4998-aada-bd298a470c91 tempest-VolumeDependencyTests-1464435528 None] Deleted volume successfully. Jul 07 08:32:32 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-a6962dc9-3bf8-4998-aada-bd298a470c91 tempest-VolumeDependencyTests-1464435528 None] Lock "cinder-c7de5a92-89e9-413a-bceb-8662b638876b-delete_volume" released by "delete_volume" :: held 2.331s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:32:38 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-e78dc06d-c837-4745-b42a-935e6ca49408 req-165efba2-70e7-4cb7-b869-a399239a74a4 tempest-TestShelveInstance-1302202911 None] Terminate volume connection completed successfully. Jul 07 08:32:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-e78dc06d-c837-4745-b42a-935e6ca49408 req-165efba2-70e7-4cb7-b869-a399239a74a4 tempest-TestShelveInstance-1302202911 None] Deleting attachment 21d3851e-7913-4932-83e0-da1b5dfae88f. {{(pid=87199) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 08:32:42 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:UPDATE=24,cinder:DELETE=2,cinder:SELECT=12,cinder:INSERT=8 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:32:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-0809d4a9-7786-486a-b59b-3ff6efc89133 req-2691843d-1334-4199-b115-bc00f8533e29 tempest-TestShelveInstance-1302202911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:32:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-0809d4a9-7786-486a-b59b-3ff6efc89133 req-2691843d-1334-4199-b115-bc00f8533e29 tempest-TestShelveInstance-1302202911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:32:43 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7df89a-bfd9-45f2-9a23-bbabbfba2738]: (4, 'raw') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:32:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-0809d4a9-7786-486a-b59b-3ff6efc89133 req-2691843d-1334-4199-b115-bc00f8533e29 tempest-TestShelveInstance-1302202911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:43 devstack sudo[103770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599 Jul 07 08:32:43 devstack sudo[103770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:44 devstack sudo[103770]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-0809d4a9-7786-486a-b59b-3ff6efc89133 req-2691843d-1334-4199-b115-bc00f8533e29 tempest-TestShelveInstance-1302202911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599" returned: 0 in 0.741s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-0809d4a9-7786-486a-b59b-3ff6efc89133 req-2691843d-1334-4199-b115-bc00f8533e29 tempest-TestShelveInstance-1302202911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:44 devstack sudo[103774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599 Jul 07 08:32:44 devstack sudo[103774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:45 devstack sudo[103774]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-0809d4a9-7786-486a-b59b-3ff6efc89133 req-2691843d-1334-4199-b115-bc00f8533e29 tempest-TestShelveInstance-1302202911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599" returned: 1 in 0.785s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-0809d4a9-7786-486a-b59b-3ff6efc89133 req-2691843d-1334-4199-b115-bc00f8533e29 tempest-TestShelveInstance-1302202911 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:32:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-0809d4a9-7786-486a-b59b-3ff6efc89133 req-2691843d-1334-4199-b115-bc00f8533e29 tempest-TestShelveInstance-1302202911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.562s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:32:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-0809d4a9-7786-486a-b59b-3ff6efc89133 req-2691843d-1334-4199-b115-bc00f8533e29 tempest-TestShelveInstance-1302202911 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b', 'name': 'volume-1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0ab99f14-fdf6-47cd-89a1-aa87c7c15543', 'enforce_multipath': True} {{(pid=87199) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 08:32:45 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-0809d4a9-7786-486a-b59b-3ff6efc89133 req-2691843d-1334-4199-b115-bc00f8533e29 tempest-TestShelveInstance-1302202911 None] attachment_update completed successfully. Jul 07 08:32:55 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=28,cinder:INSERT=4,cinder:UPDATE=22,cinder:DELETE=1 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:32:55 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:33:05 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:33:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:33:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:33:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:33:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:33:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:33:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:33:05 devstack sudo[104237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:33:05 devstack sudo[104237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:33:06 devstack sudo[104237]: pam_unix(sudo:session): session closed for user root Jul 07 08:33:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.692s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:33:06 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:33:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running periodic task VolumeManager._thread_info {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:33:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] thread count: 29 {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 08:33:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] thread info: [<_MainThread(MainThread, started 133056092332160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 08:33:24 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-d3615679-4d03-4165-b3af-7198ad4d60ce req-8976c880-c282-408d-927c-b1e6cfdc891a tempest-TestShelveInstance-1302202911 None] Terminate volume connection completed successfully. Jul 07 08:33:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [req-d3615679-4d03-4165-b3af-7198ad4d60ce req-8976c880-c282-408d-927c-b1e6cfdc891a tempest-TestShelveInstance-1302202911 None] Deleting attachment 0ab99f14-fdf6-47cd-89a1-aa87c7c15543. {{(pid=87199) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 08:33:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [req-d3615679-4d03-4165-b3af-7198ad4d60ce req-2f30127c-ce8f-467d-a56a-3a755bfaec49 tempest-TestShelveInstance-1302202911 None] Acquiring lock "cinder-1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:33:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [req-d3615679-4d03-4165-b3af-7198ad4d60ce req-2f30127c-ce8f-467d-a56a-3a755bfaec49 tempest-TestShelveInstance-1302202911 None] Lock "cinder-1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:33:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [req-d3615679-4d03-4165-b3af-7198ad4d60ce req-2f30127c-ce8f-467d-a56a-3a755bfaec49 tempest-TestShelveInstance-1302202911 None] Acquiring lock "cinder-quobyte-1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:33:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [req-d3615679-4d03-4165-b3af-7198ad4d60ce req-2f30127c-ce8f-467d-a56a-3a755bfaec49 tempest-TestShelveInstance-1302202911 None] Lock "cinder-quobyte-1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599" acquired by "delete_volume" :: waited 0.014s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:33:24 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad3f4fa-cdd1-4c21-adc4-c7e9b9d6e368]: (4, 'raw') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:33:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-d3615679-4d03-4165-b3af-7198ad4d60ce req-2f30127c-ce8f-467d-a56a-3a755bfaec49 tempest-TestShelveInstance-1302202911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:33:24 devstack sudo[104305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599 Jul 07 08:33:24 devstack sudo[104305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:33:25 devstack sudo[104305]: pam_unix(sudo:session): session closed for user root Jul 07 08:33:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-d3615679-4d03-4165-b3af-7198ad4d60ce req-2f30127c-ce8f-467d-a56a-3a755bfaec49 tempest-TestShelveInstance-1302202911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599" returned: 0 in 0.754s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:33:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-d3615679-4d03-4165-b3af-7198ad4d60ce req-2f30127c-ce8f-467d-a56a-3a755bfaec49 tempest-TestShelveInstance-1302202911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:33:25 devstack sudo[104309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599 Jul 07 08:33:25 devstack sudo[104309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:33:26 devstack sudo[104309]: pam_unix(sudo:session): session closed for user root Jul 07 08:33:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-d3615679-4d03-4165-b3af-7198ad4d60ce req-2f30127c-ce8f-467d-a56a-3a755bfaec49 tempest-TestShelveInstance-1302202911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599" returned: 1 in 0.746s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:33:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-d3615679-4d03-4165-b3af-7198ad4d60ce req-2f30127c-ce8f-467d-a56a-3a755bfaec49 tempest-TestShelveInstance-1302202911 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:33:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-d3615679-4d03-4165-b3af-7198ad4d60ce req-2f30127c-ce8f-467d-a56a-3a755bfaec49 tempest-TestShelveInstance-1302202911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:33:26 devstack sudo[104314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599 Jul 07 08:33:26 devstack sudo[104314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:33:26 devstack sudo[104314]: pam_unix(sudo:session): session closed for user root Jul 07 08:33:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-d3615679-4d03-4165-b3af-7198ad4d60ce req-2f30127c-ce8f-467d-a56a-3a755bfaec49 tempest-TestShelveInstance-1302202911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599" returned: 0 in 0.639s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:33:27 devstack cinder-volume[87199]: DEBUG cinder.coordination [req-d3615679-4d03-4165-b3af-7198ad4d60ce req-2f30127c-ce8f-467d-a56a-3a755bfaec49 tempest-TestShelveInstance-1302202911 None] Lock "cinder-quobyte-1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599" released by "delete_volume" :: held 2.200s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:33:27 devstack cinder-volume[87199]: DEBUG cinder.quota [req-d3615679-4d03-4165-b3af-7198ad4d60ce req-2f30127c-ce8f-467d-a56a-3a755bfaec49 tempest-TestShelveInstance-1302202911 None] Created reservations ['725d4de6-c630-4f7d-91ce-c291d93ac7b2', '0054e443-53ce-40bb-aa8d-b08378970d8a', '45751864-536e-4320-97c0-f6071af60eb4', 'a4756e9e-82b4-4e00-b4fe-126287c0f442'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:33:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-d3615679-4d03-4165-b3af-7198ad4d60ce req-2f30127c-ce8f-467d-a56a-3a755bfaec49 tempest-TestShelveInstance-1302202911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:33:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-d3615679-4d03-4165-b3af-7198ad4d60ce req-2f30127c-ce8f-467d-a56a-3a755bfaec49 tempest-TestShelveInstance-1302202911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:33:27 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [req-d3615679-4d03-4165-b3af-7198ad4d60ce req-2f30127c-ce8f-467d-a56a-3a755bfaec49 tempest-TestShelveInstance-1302202911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:33:27 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [req-d3615679-4d03-4165-b3af-7198ad4d60ce req-2f30127c-ce8f-467d-a56a-3a755bfaec49 tempest-TestShelveInstance-1302202911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:33:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [req-d3615679-4d03-4165-b3af-7198ad4d60ce req-2f30127c-ce8f-467d-a56a-3a755bfaec49 tempest-TestShelveInstance-1302202911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:33:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-d3615679-4d03-4165-b3af-7198ad4d60ce req-2f30127c-ce8f-467d-a56a-3a755bfaec49 tempest-TestShelveInstance-1302202911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:33:27 devstack sudo[104317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:33:27 devstack sudo[104317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:33:27 devstack sudo[104317]: pam_unix(sudo:session): session closed for user root Jul 07 08:33:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [req-d3615679-4d03-4165-b3af-7198ad4d60ce req-2f30127c-ce8f-467d-a56a-3a755bfaec49 tempest-TestShelveInstance-1302202911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.665s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:33:27 devstack cinder-volume[87199]: DEBUG cinder.manager [req-d3615679-4d03-4165-b3af-7198ad4d60ce req-2f30127c-ce8f-467d-a56a-3a755bfaec49 tempest-TestShelveInstance-1302202911 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:33:27 devstack cinder-volume[87199]: INFO cinder.volume.manager [req-d3615679-4d03-4165-b3af-7198ad4d60ce req-2f30127c-ce8f-467d-a56a-3a755bfaec49 tempest-TestShelveInstance-1302202911 None] Deleted volume successfully. Jul 07 08:33:27 devstack cinder-volume[87199]: DEBUG cinder.coordination [req-d3615679-4d03-4165-b3af-7198ad4d60ce req-2f30127c-ce8f-467d-a56a-3a755bfaec49 tempest-TestShelveInstance-1302202911 None] Lock "cinder-1a0e42c4-e200-4ec4-9a2d-a9c46cb5b599-delete_volume" released by "delete_volume" :: held 3.061s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:33:37 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=8,cinder:UPDATE=9,cinder:INSERT=2 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:33:37 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=5,cinder:UPDATE=8,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:33:40 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:33:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Flow 'volume_create_manager' (efea56e5-bea7-4d3c-94f4-8baa0a136c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:33:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd00024d-6de9-43a4-a27d-56f64e0ed509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:33:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd00024d-6de9-43a4-a27d-56f64e0ed509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e24e712-2e2c-40d5-ab73-de32a25ae18a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c890596a22874b0e8deffd900a957c0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:33:41Z,use_quota=True,user_id='55013eb6ac2349118ed6c72c8deae5fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f4769f2e-1166-4a6c-ab0a-102b02964bcc),volume_type_id=f4769f2e-1166-4a6c-ab0a-102b02964bcc)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:33:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bdfee47-48e2-418f-b7d5-d2e5947f798e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:33:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bdfee47-48e2-418f-b7d5-d2e5947f798e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:33:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (381d4d6d-bfaa-4d98-b013-2a0769ad6005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:33:40 devstack cinder-volume[87199]: DEBUG cinder.image.glance [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Creating Keystone auth plugin from conf {{(pid=87199) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 08:33:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (381d4d6d-bfaa-4d98-b013-2a0769ad6005) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9e24e712-2e2c-40d5-ab73-de32a25ae18a', 'volume_name': 'volume-9e24e712-2e2c-40d5-ab73-de32a25ae18a', 'volume_size': 1, 'image_id': '993f0fc2-293b-4fab-bcb2-e3d446094b45', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/993f0fc2-293b-4fab-bcb2-e3d446094b45', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3b1911e10b4ec74e9750aab8dbb4702f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c890596a22874b0e8deffd900a957c0a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '05f2250dd6117e249a84dc507a68208f6e09a093ca544040d059cf861ed1693fbcf746ebe618d9a0c37a13f7015a948824b50c968d420edd87d9da262289ff5b', 'id': '993f0fc2-293b-4fab-bcb2-e3d446094b45', 'created_at': datetime.datetime(2026, 7, 7, 6, 33, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 6, 33, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/993f0fc2-293b-4fab-bcb2-e3d446094b45/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:33:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0f42b53-f335-4ff3-a1f3-8b1f5e37b152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:33:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0f42b53-f335-4ff3-a1f3-8b1f5e37b152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:33:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea9506c9-37db-48a1-87b5-84e9f4bfd8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:33:40 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Volume 9e24e712-2e2c-40d5-ab73-de32a25ae18a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9e24e712-2e2c-40d5-ab73-de32a25ae18a', 'volume_size': 1, 'image_id': '993f0fc2-293b-4fab-bcb2-e3d446094b45', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/993f0fc2-293b-4fab-bcb2-e3d446094b45', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3b1911e10b4ec74e9750aab8dbb4702f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c890596a22874b0e8deffd900a957c0a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '05f2250dd6117e249a84dc507a68208f6e09a093ca544040d059cf861ed1693fbcf746ebe618d9a0c37a13f7015a948824b50c968d420edd87d9da262289ff5b', 'id': '993f0fc2-293b-4fab-bcb2-e3d446094b45', 'created_at': datetime.datetime(2026, 7, 7, 6, 33, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 6, 33, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/993f0fc2-293b-4fab-bcb2-e3d446094b45/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 07 08:33:40 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Trying to clone 9e24e712-2e2c-40d5-ab73-de32a25ae18a from image 993f0fc2-293b-4fab-bcb2-e3d446094b45 at location (None, [{'url': 'file:///opt/stack/data/glance/images/993f0fc2-293b-4fab-bcb2-e3d446094b45', 'metadata': {}}]). {{(pid=87199) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 08:33:40 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_993f0fc2-293b-4fab-bcb2-e3d446094b45_a_ut6nmvdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87199) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 08:33:40 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Image download 0.00 MB at 0.00 MB/s Jul 07 08:33:41 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d42d1c-032c-42dd-a787-3c03e8f5872d]: (4, 'raw') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:33:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_993f0fc2-293b-4fab-bcb2-e3d446094b45_a_ut6nmvdevstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:33:41 devstack sudo[104363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_993f0fc2-293b-4fab-bcb2-e3d446094b45_a_ut6nmvdevstack@QuobyteHD Jul 07 08:33:41 devstack sudo[104363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:33:41 devstack sudo[104363]: pam_unix(sudo:session): session closed for user root Jul 07 08:33:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_993f0fc2-293b-4fab-bcb2-e3d446094b45_a_ut6nmvdevstack@QuobyteHD" returned: 0 in 0.712s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:33:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_993f0fc2-293b-4fab-bcb2-e3d446094b45_a_ut6nmvdevstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:33:41 devstack sudo[104368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_993f0fc2-293b-4fab-bcb2-e3d446094b45_a_ut6nmvdevstack@QuobyteHD Jul 07 08:33:41 devstack sudo[104368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:33:42 devstack sudo[104368]: pam_unix(sudo:session): session closed for user root Jul 07 08:33:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_993f0fc2-293b-4fab-bcb2-e3d446094b45_a_ut6nmvdevstack@QuobyteHD" returned: 1 in 0.695s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:33:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_993f0fc2-293b-4fab-bcb2-e3d446094b45_a_ut6nmvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:33:42 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Temporary image 993f0fc2-293b-4fab-bcb2-e3d446094b45 is fetched for user 55013eb6ac2349118ed6c72c8deae5fb. {{(pid=87199) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 08:33:42 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d783bd9-a7e5-4134-99a9-b1016cd53bbb]: (4, 'raw') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:33:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_993f0fc2-293b-4fab-bcb2-e3d446094b45_a_ut6nmvdevstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:33:42 devstack sudo[104373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_993f0fc2-293b-4fab-bcb2-e3d446094b45_a_ut6nmvdevstack@QuobyteHD Jul 07 08:33:42 devstack sudo[104373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:33:43 devstack sudo[104373]: pam_unix(sudo:session): session closed for user root Jul 07 08:33:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_993f0fc2-293b-4fab-bcb2-e3d446094b45_a_ut6nmvdevstack@QuobyteHD" returned: 0 in 0.695s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:33:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_993f0fc2-293b-4fab-bcb2-e3d446094b45_a_ut6nmvdevstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:33:43 devstack sudo[104377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_993f0fc2-293b-4fab-bcb2-e3d446094b45_a_ut6nmvdevstack@QuobyteHD Jul 07 08:33:43 devstack sudo[104377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:33:43 devstack sudo[104377]: pam_unix(sudo:session): session closed for user root Jul 07 08:33:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_993f0fc2-293b-4fab-bcb2-e3d446094b45_a_ut6nmvdevstack@QuobyteHD" returned: 1 in 0.701s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:33:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_993f0fc2-293b-4fab-bcb2-e3d446094b45_a_ut6nmvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:33:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:33:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:33:43 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e24e712-2e2c-40d5-ab73-de32a25ae18a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c890596a22874b0e8deffd900a957c0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:33:41Z,use_quota=True,user_id='55013eb6ac2349118ed6c72c8deae5fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f4769f2e-1166-4a6c-ab0a-102b02964bcc),volume_type_id=f4769f2e-1166-4a6c-ab0a-102b02964bcc)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:33:43 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Creating volume 9e24e712-2e2c-40d5-ab73-de32a25ae18a {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:33:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:33:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:33:43 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:33:43 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:33:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:33:43 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:33:43 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:33:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-9e24e712-2e2c-40d5-ab73-de32a25ae18a 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:33:43 devstack sudo[104382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-9e24e712-2e2c-40d5-ab73-de32a25ae18a 1073741824 Jul 07 08:33:43 devstack sudo[104382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:33:44 devstack sudo[104382]: pam_unix(sudo:session): session closed for user root Jul 07 08:33:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-9e24e712-2e2c-40d5-ab73-de32a25ae18a 1073741824" returned: 0 in 0.803s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:33:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-9e24e712-2e2c-40d5-ab73-de32a25ae18a {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:33:44 devstack sudo[104388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-9e24e712-2e2c-40d5-ab73-de32a25ae18a Jul 07 08:33:44 devstack sudo[104388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:33:45 devstack sudo[104388]: pam_unix(sudo:session): session closed for user root Jul 07 08:33:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-9e24e712-2e2c-40d5-ab73-de32a25ae18a" returned: 0 in 0.645s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:33:45 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] <== create_volume: return (1490ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:33:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.493s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:33:45 devstack cinder-volume[87199]: DEBUG cinder.volume.volume_utils [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Attempting download of 993f0fc2-293b-4fab-bcb2-e3d446094b45 ((None, [{'url': 'file:///opt/stack/data/glance/images/993f0fc2-293b-4fab-bcb2-e3d446094b45', 'metadata': {}}])) to volume 9e24e712-2e2c-40d5-ab73-de32a25ae18a. {{(pid=87199) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 08:33:45 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e7818d-3e61-4e08-bca5-6c4652d6e281]: (4, 'raw') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:33:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_993f0fc2-293b-4fab-bcb2-e3d446094b45_18uci76d {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:33:45 devstack sudo[104391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_993f0fc2-293b-4fab-bcb2-e3d446094b45_18uci76d Jul 07 08:33:45 devstack sudo[104391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:33:46 devstack sudo[104391]: pam_unix(sudo:session): session closed for user root Jul 07 08:33:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_993f0fc2-293b-4fab-bcb2-e3d446094b45_18uci76d" returned: 0 in 0.738s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:33:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_993f0fc2-293b-4fab-bcb2-e3d446094b45_18uci76d {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:33:46 devstack sudo[104395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_993f0fc2-293b-4fab-bcb2-e3d446094b45_18uci76d Jul 07 08:33:46 devstack sudo[104395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:33:46 devstack sudo[104395]: pam_unix(sudo:session): session closed for user root Jul 07 08:33:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_993f0fc2-293b-4fab-bcb2-e3d446094b45_18uci76d" returned: 1 in 0.703s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:33:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_993f0fc2-293b-4fab-bcb2-e3d446094b45_18uci76d' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:33:46 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[a925efe1-757d-4d1e-8541-86c749cebee4]: (4, 'raw') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:33:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_993f0fc2-293b-4fab-bcb2-e3d446094b45_a_ut6nmvdevstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:33:47 devstack sudo[104399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_993f0fc2-293b-4fab-bcb2-e3d446094b45_a_ut6nmvdevstack@QuobyteHD Jul 07 08:33:47 devstack sudo[104399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:33:47 devstack sudo[104399]: pam_unix(sudo:session): session closed for user root Jul 07 08:33:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_993f0fc2-293b-4fab-bcb2-e3d446094b45_a_ut6nmvdevstack@QuobyteHD" returned: 0 in 0.706s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:33:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_993f0fc2-293b-4fab-bcb2-e3d446094b45_a_ut6nmvdevstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:33:47 devstack sudo[104409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_993f0fc2-293b-4fab-bcb2-e3d446094b45_a_ut6nmvdevstack@QuobyteHD Jul 07 08:33:47 devstack sudo[104409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:33:48 devstack sudo[104409]: pam_unix(sudo:session): session closed for user root Jul 07 08:33:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_993f0fc2-293b-4fab-bcb2-e3d446094b45_a_ut6nmvdevstack@QuobyteHD" returned: 1 in 0.710s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:33:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_993f0fc2-293b-4fab-bcb2-e3d446094b45_a_ut6nmvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:33:48 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] 993f0fc2-293b-4fab-bcb2-e3d446094b45 was raw, converting to raw {{(pid=87199) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 08:33:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_993f0fc2-293b-4fab-bcb2-e3d446094b45_a_ut6nmvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-9e24e712-2e2c-40d5-ab73-de32a25ae18a {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:33:48 devstack sudo[104414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_993f0fc2-293b-4fab-bcb2-e3d446094b45_a_ut6nmvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-9e24e712-2e2c-40d5-ab73-de32a25ae18a Jul 07 08:33:48 devstack sudo[104414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:33:49 devstack sudo[104414]: pam_unix(sudo:session): session closed for user root Jul 07 08:33:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_993f0fc2-293b-4fab-bcb2-e3d446094b45_a_ut6nmvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-9e24e712-2e2c-40d5-ab73-de32a25ae18a" returned: 0 in 0.699s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:33:49 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_993f0fc2-293b-4fab-bcb2-e3d446094b45_a_ut6nmvdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-9e24e712-2e2c-40d5-ab73-de32a25ae18a {{(pid=87199) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 08:33:49 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Converted 0.00 MB image at 0.00 MB/s Jul 07 08:33:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-9e24e712-2e2c-40d5-ab73-de32a25ae18a 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:33:49 devstack sudo[104419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-9e24e712-2e2c-40d5-ab73-de32a25ae18a 1G Jul 07 08:33:49 devstack sudo[104419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:33:49 devstack sudo[104419]: pam_unix(sudo:session): session closed for user root Jul 07 08:33:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-9e24e712-2e2c-40d5-ab73-de32a25ae18a 1G" returned: 0 in 0.654s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:33:49 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f55c0e-4f62-4ab5-ad2d-5524316dc619]: (4, 'raw') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:33:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-9e24e712-2e2c-40d5-ab73-de32a25ae18a {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:33:49 devstack sudo[104424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-9e24e712-2e2c-40d5-ab73-de32a25ae18a Jul 07 08:33:49 devstack sudo[104424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:33:50 devstack sudo[104424]: pam_unix(sudo:session): session closed for user root Jul 07 08:33:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-9e24e712-2e2c-40d5-ab73-de32a25ae18a" returned: 0 in 0.726s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:33:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-9e24e712-2e2c-40d5-ab73-de32a25ae18a {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:33:50 devstack sudo[104428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-9e24e712-2e2c-40d5-ab73-de32a25ae18a Jul 07 08:33:50 devstack sudo[104428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:33:51 devstack sudo[104428]: pam_unix(sudo:session): session closed for user root Jul 07 08:33:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-9e24e712-2e2c-40d5-ab73-de32a25ae18a" returned: 1 in 0.717s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:33:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-9e24e712-2e2c-40d5-ab73-de32a25ae18a' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:33:51 devstack cinder-volume[87199]: DEBUG cinder.volume.volume_utils [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Downloaded image 993f0fc2-293b-4fab-bcb2-e3d446094b45 ((None, [{'url': 'file:///opt/stack/data/glance/images/993f0fc2-293b-4fab-bcb2-e3d446094b45', 'metadata': {}}])) to volume 9e24e712-2e2c-40d5-ab73-de32a25ae18a successfully. {{(pid=87199) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 08:33:51 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Temporary image 993f0fc2-293b-4fab-bcb2-e3d446094b45 for user 55013eb6ac2349118ed6c72c8deae5fb is deleted. {{(pid=87199) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 08:33:51 devstack cinder-volume[87199]: DEBUG cinder.volume.volume_utils [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Marking volume 9e24e712-2e2c-40d5-ab73-de32a25ae18a as bootable. {{(pid=87199) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 08:33:51 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Copying metadata from image 993f0fc2-293b-4fab-bcb2-e3d446094b45 to 9e24e712-2e2c-40d5-ab73-de32a25ae18a. {{(pid=87199) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 08:33:51 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Creating volume glance metadata for volume 9e24e712-2e2c-40d5-ab73-de32a25ae18a backed by image 993f0fc2-293b-4fab-bcb2-e3d446094b45 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '993f0fc2-293b-4fab-bcb2-e3d446094b45', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '3b1911e10b4ec74e9750aab8dbb4702f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87199) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 08:33:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea9506c9-37db-48a1-87b5-84e9f4bfd8f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e24e712-2e2c-40d5-ab73-de32a25ae18a', 'volume_size': 1, 'image_id': '993f0fc2-293b-4fab-bcb2-e3d446094b45', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/993f0fc2-293b-4fab-bcb2-e3d446094b45', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3b1911e10b4ec74e9750aab8dbb4702f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c890596a22874b0e8deffd900a957c0a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '05f2250dd6117e249a84dc507a68208f6e09a093ca544040d059cf861ed1693fbcf746ebe618d9a0c37a13f7015a948824b50c968d420edd87d9da262289ff5b', 'id': '993f0fc2-293b-4fab-bcb2-e3d446094b45', 'created_at': datetime.datetime(2026, 7, 7, 6, 33, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 6, 33, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/993f0fc2-293b-4fab-bcb2-e3d446094b45/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:33:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2563828-1e1a-4cf7-bfab-f01568dd3e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:33:51 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Volume volume-9e24e712-2e2c-40d5-ab73-de32a25ae18a (9e24e712-2e2c-40d5-ab73-de32a25ae18a): created successfully Jul 07 08:33:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2563828-1e1a-4cf7-bfab-f01568dd3e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:33:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Flow 'volume_create_manager' (efea56e5-bea7-4d3c-94f4-8baa0a136c9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:33:51 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-935feebb-0f0e-4315-bebd-148384d3c8e8 tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Created volume successfully. Jul 07 08:33:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6e97cbd5-cd42-4fd6-a125-7f35cebd60ca tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Acquiring lock "cinder-9e24e712-2e2c-40d5-ab73-de32a25ae18a-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:33:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6e97cbd5-cd42-4fd6-a125-7f35cebd60ca tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Lock "cinder-9e24e712-2e2c-40d5-ab73-de32a25ae18a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:33:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6e97cbd5-cd42-4fd6-a125-7f35cebd60ca tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Acquiring lock "cinder-quobyte-9e24e712-2e2c-40d5-ab73-de32a25ae18a" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:33:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6e97cbd5-cd42-4fd6-a125-7f35cebd60ca tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Lock "cinder-quobyte-9e24e712-2e2c-40d5-ab73-de32a25ae18a" acquired by "delete_volume" :: waited 0.016s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:33:52 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2daa84-0280-4370-ae08-5d433a2cd640]: (4, 'raw') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:33:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6e97cbd5-cd42-4fd6-a125-7f35cebd60ca tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-9e24e712-2e2c-40d5-ab73-de32a25ae18a {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:33:52 devstack sudo[104434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-9e24e712-2e2c-40d5-ab73-de32a25ae18a Jul 07 08:33:52 devstack sudo[104434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:33:53 devstack sudo[104434]: pam_unix(sudo:session): session closed for user root Jul 07 08:33:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6e97cbd5-cd42-4fd6-a125-7f35cebd60ca tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-9e24e712-2e2c-40d5-ab73-de32a25ae18a" returned: 0 in 0.705s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:33:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6e97cbd5-cd42-4fd6-a125-7f35cebd60ca tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-9e24e712-2e2c-40d5-ab73-de32a25ae18a {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:33:53 devstack sudo[104438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-9e24e712-2e2c-40d5-ab73-de32a25ae18a Jul 07 08:33:53 devstack sudo[104438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:33:53 devstack sudo[104438]: pam_unix(sudo:session): session closed for user root Jul 07 08:33:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6e97cbd5-cd42-4fd6-a125-7f35cebd60ca tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-9e24e712-2e2c-40d5-ab73-de32a25ae18a" returned: 1 in 0.742s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:33:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6e97cbd5-cd42-4fd6-a125-7f35cebd60ca tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-9e24e712-2e2c-40d5-ab73-de32a25ae18a' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:33:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6e97cbd5-cd42-4fd6-a125-7f35cebd60ca tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-9e24e712-2e2c-40d5-ab73-de32a25ae18a {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:33:53 devstack sudo[104443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-9e24e712-2e2c-40d5-ab73-de32a25ae18a Jul 07 08:33:53 devstack sudo[104443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:33:54 devstack sudo[104443]: pam_unix(sudo:session): session closed for user root Jul 07 08:33:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6e97cbd5-cd42-4fd6-a125-7f35cebd60ca tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-9e24e712-2e2c-40d5-ab73-de32a25ae18a" returned: 0 in 0.632s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:33:54 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6e97cbd5-cd42-4fd6-a125-7f35cebd60ca tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Lock "cinder-quobyte-9e24e712-2e2c-40d5-ab73-de32a25ae18a" released by "delete_volume" :: held 2.138s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:33:54 devstack cinder-volume[87199]: WARNING cinder.quota [None req-6e97cbd5-cd42-4fd6-a125-7f35cebd60ca tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:33:54 devstack cinder-volume[87199]: WARNING cinder.quota [None req-6e97cbd5-cd42-4fd6-a125-7f35cebd60ca tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:33:54 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-6e97cbd5-cd42-4fd6-a125-7f35cebd60ca tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Created reservations ['8aed2761-9207-4b1e-9b75-237d03df5d9f', 'f3770edf-e0e7-4d31-a2d5-f7a738d932af', '2e835711-0d9d-435f-8823-cfea5c3c22f3', '6326fd14-1218-4bd0-98f1-ea20e13ebc66'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:33:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6e97cbd5-cd42-4fd6-a125-7f35cebd60ca tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:33:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6e97cbd5-cd42-4fd6-a125-7f35cebd60ca tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:33:54 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6e97cbd5-cd42-4fd6-a125-7f35cebd60ca tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:33:54 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-6e97cbd5-cd42-4fd6-a125-7f35cebd60ca tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:33:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-6e97cbd5-cd42-4fd6-a125-7f35cebd60ca tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:33:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6e97cbd5-cd42-4fd6-a125-7f35cebd60ca tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:33:54 devstack sudo[104446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:33:54 devstack sudo[104446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:33:55 devstack sudo[104446]: pam_unix(sudo:session): session closed for user root Jul 07 08:33:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6e97cbd5-cd42-4fd6-a125-7f35cebd60ca tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.670s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:33:55 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-6e97cbd5-cd42-4fd6-a125-7f35cebd60ca tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:33:55 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-6e97cbd5-cd42-4fd6-a125-7f35cebd60ca tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Deleted volume successfully. Jul 07 08:33:55 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6e97cbd5-cd42-4fd6-a125-7f35cebd60ca tempest-VolumeAndVolumeTypeFromImageTest-1362493919 None] Lock "cinder-9e24e712-2e2c-40d5-ab73-de32a25ae18a-delete_volume" released by "delete_volume" :: held 3.024s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:34:04 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:UPDATE=11,cinder:INSERT=7,cinder:SELECT=9,cinder:DELETE=1 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:34:05 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=17,cinder:UPDATE=14,cinder:INSERT=8,cinder:DELETE=1 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:34:05 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:34:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:34:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:34:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:34:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:34:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:34:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:05 devstack sudo[104477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:34:05 devstack sudo[104477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:06 devstack sudo[104477]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.659s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:06 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:34:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running periodic task VolumeManager._thread_info {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:34:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] thread count: 29 {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 08:34:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] thread info: [<_MainThread(MainThread, started 133056092332160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 08:34:12 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-82285458-461a-406e-80ee-16b43854b212 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:34:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-82285458-461a-406e-80ee-16b43854b212 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Flow 'volume_create_manager' (971c952f-dfd6-4f07-adb1-354386d73642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:34:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-82285458-461a-406e-80ee-16b43854b212 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ff9b1da-031d-4202-a083-969ece847a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-82285458-461a-406e-80ee-16b43854b212 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ff9b1da-031d-4202-a083-969ece847a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-405568938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87b34aea-986b-433e-adbe-7ecb7a8852fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='314dd98dd2ef4ddbb08dcd63398f6370',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:34:12Z,use_quota=True,user_id='286198b13787439e946961c654750a36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-82285458-461a-406e-80ee-16b43854b212 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9a2d405-6a84-4beb-afea-e926fb5e662c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-82285458-461a-406e-80ee-16b43854b212 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9a2d405-6a84-4beb-afea-e926fb5e662c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-82285458-461a-406e-80ee-16b43854b212 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d51fe874-654b-4672-9947-2f0aeedbc0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-82285458-461a-406e-80ee-16b43854b212 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d51fe874-654b-4672-9947-2f0aeedbc0e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87b34aea-986b-433e-adbe-7ecb7a8852fb', 'volume_name': 'volume-87b34aea-986b-433e-adbe-7ecb7a8852fb', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-82285458-461a-406e-80ee-16b43854b212 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd46d2bd-8f94-44f4-88e8-01689e553b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-82285458-461a-406e-80ee-16b43854b212 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd46d2bd-8f94-44f4-88e8-01689e553b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-82285458-461a-406e-80ee-16b43854b212 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f56a7f4f-2018-4fd2-80ac-32ae5cfbf760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:12 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-82285458-461a-406e-80ee-16b43854b212 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Volume 87b34aea-986b-433e-adbe-7ecb7a8852fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87b34aea-986b-433e-adbe-7ecb7a8852fb', 'volume_size': 1} Jul 07 08:34:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-82285458-461a-406e-80ee-16b43854b212 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:34:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-82285458-461a-406e-80ee-16b43854b212 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:34:12 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-82285458-461a-406e-80ee-16b43854b212 tempest-CreateVolumesFromSnapshotTest-1959601045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-405568938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87b34aea-986b-433e-adbe-7ecb7a8852fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='314dd98dd2ef4ddbb08dcd63398f6370',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:34:12Z,use_quota=True,user_id='286198b13787439e946961c654750a36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:34:12 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-82285458-461a-406e-80ee-16b43854b212 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Creating volume 87b34aea-986b-433e-adbe-7ecb7a8852fb {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:34:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-82285458-461a-406e-80ee-16b43854b212 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:34:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-82285458-461a-406e-80ee-16b43854b212 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:34:12 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-82285458-461a-406e-80ee-16b43854b212 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:34:12 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-82285458-461a-406e-80ee-16b43854b212 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:34:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-82285458-461a-406e-80ee-16b43854b212 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:34:12 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-82285458-461a-406e-80ee-16b43854b212 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:34:12 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-82285458-461a-406e-80ee-16b43854b212 tempest-CreateVolumesFromSnapshotTest-1959601045 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:34:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-82285458-461a-406e-80ee-16b43854b212 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87b34aea-986b-433e-adbe-7ecb7a8852fb 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:12 devstack sudo[104493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87b34aea-986b-433e-adbe-7ecb7a8852fb 1073741824 Jul 07 08:34:12 devstack sudo[104493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:12 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-73e6e52a-d8fe-486b-bc17-0f76bf1a75cf tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:34:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-73e6e52a-d8fe-486b-bc17-0f76bf1a75cf tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Flow 'volume_create_manager' (791461a6-a054-4872-b7cd-6c9a2ff08c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:34:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-73e6e52a-d8fe-486b-bc17-0f76bf1a75cf tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (916c48e9-941a-424d-b46c-76f46aa23b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-73e6e52a-d8fe-486b-bc17-0f76bf1a75cf tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (916c48e9-941a-424d-b46c-76f46aa23b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-129334384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14df5cee-b080-4c09-907d-d8e251c4d00d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7e36e4eba804b01be8104dce2bafd02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:34:12Z,use_quota=True,user_id='600b58c3d7e043e0a604a24338264757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-73e6e52a-d8fe-486b-bc17-0f76bf1a75cf tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff35946c-abc7-498f-8a38-b0fff00b8e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-73e6e52a-d8fe-486b-bc17-0f76bf1a75cf tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff35946c-abc7-498f-8a38-b0fff00b8e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-73e6e52a-d8fe-486b-bc17-0f76bf1a75cf tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52eab582-c4e4-42f2-beee-ddc597d6a7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-73e6e52a-d8fe-486b-bc17-0f76bf1a75cf tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52eab582-c4e4-42f2-beee-ddc597d6a7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14df5cee-b080-4c09-907d-d8e251c4d00d', 'volume_name': 'volume-14df5cee-b080-4c09-907d-d8e251c4d00d', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-73e6e52a-d8fe-486b-bc17-0f76bf1a75cf tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c6884a3-b4c2-44ae-91e9-f2d510863a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-73e6e52a-d8fe-486b-bc17-0f76bf1a75cf tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c6884a3-b4c2-44ae-91e9-f2d510863a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-73e6e52a-d8fe-486b-bc17-0f76bf1a75cf tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (747bb209-81be-4c5f-8178-c0971daa722e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:12 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-73e6e52a-d8fe-486b-bc17-0f76bf1a75cf tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Volume 14df5cee-b080-4c09-907d-d8e251c4d00d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14df5cee-b080-4c09-907d-d8e251c4d00d', 'volume_size': 1} Jul 07 08:34:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-73e6e52a-d8fe-486b-bc17-0f76bf1a75cf tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:34:13 devstack sudo[104493]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-82285458-461a-406e-80ee-16b43854b212 tempest-CreateVolumesFromSnapshotTest-1959601045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87b34aea-986b-433e-adbe-7ecb7a8852fb 1073741824" returned: 0 in 1.071s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-82285458-461a-406e-80ee-16b43854b212 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87b34aea-986b-433e-adbe-7ecb7a8852fb {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:13 devstack sudo[104499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87b34aea-986b-433e-adbe-7ecb7a8852fb Jul 07 08:34:13 devstack sudo[104499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:13 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-58db2e84-f452-4eb9-860e-63e16273c05f tempest-ProjectReaderTests-1685940573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:34:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-58db2e84-f452-4eb9-860e-63e16273c05f tempest-ProjectReaderTests-1685940573 None] Flow 'volume_create_manager' (79ebd4fb-74aa-42c8-89d9-284465076e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:34:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-58db2e84-f452-4eb9-860e-63e16273c05f tempest-ProjectReaderTests-1685940573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66b0f30e-e8d4-4c65-888e-c9e9e95c329f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-58db2e84-f452-4eb9-860e-63e16273c05f tempest-ProjectReaderTests-1685940573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66b0f30e-e8d4-4c65-888e-c9e9e95c329f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:34:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1269756385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af4a7bf0-ca73-4ffb-b5b6-eea4cc685533,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06330941a308447a9ec29b93464314b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:34:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:34:13Z,use_quota=True,user_id='7e7152ed33e44a5a937717a4c518b2d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-58db2e84-f452-4eb9-860e-63e16273c05f tempest-ProjectReaderTests-1685940573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aaaec33-e847-42d9-88d3-528410ac975c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-58db2e84-f452-4eb9-860e-63e16273c05f tempest-ProjectReaderTests-1685940573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aaaec33-e847-42d9-88d3-528410ac975c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-58db2e84-f452-4eb9-860e-63e16273c05f tempest-ProjectReaderTests-1685940573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (246da8fd-52c2-4611-aeb0-8d45c8a0afb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-58db2e84-f452-4eb9-860e-63e16273c05f tempest-ProjectReaderTests-1685940573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (246da8fd-52c2-4611-aeb0-8d45c8a0afb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af4a7bf0-ca73-4ffb-b5b6-eea4cc685533', 'volume_name': 'volume-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-58db2e84-f452-4eb9-860e-63e16273c05f tempest-ProjectReaderTests-1685940573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00e16cd1-4aa9-4217-a96d-d79ed609e1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-58db2e84-f452-4eb9-860e-63e16273c05f tempest-ProjectReaderTests-1685940573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00e16cd1-4aa9-4217-a96d-d79ed609e1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:13 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-58db2e84-f452-4eb9-860e-63e16273c05f tempest-ProjectReaderTests-1685940573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a80bcc4-ca1a-4f0f-b2aa-638c934201f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:13 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-58db2e84-f452-4eb9-860e-63e16273c05f tempest-ProjectReaderTests-1685940573 None] Volume af4a7bf0-ca73-4ffb-b5b6-eea4cc685533: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533', 'volume_size': 1} Jul 07 08:34:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-58db2e84-f452-4eb9-860e-63e16273c05f tempest-ProjectReaderTests-1685940573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:34:13 devstack sudo[104499]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-82285458-461a-406e-80ee-16b43854b212 tempest-CreateVolumesFromSnapshotTest-1959601045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87b34aea-986b-433e-adbe-7ecb7a8852fb" returned: 0 in 0.667s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-82285458-461a-406e-80ee-16b43854b212 tempest-CreateVolumesFromSnapshotTest-1959601045 None] <== create_volume: return (1797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:34:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-82285458-461a-406e-80ee-16b43854b212 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.799s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:34:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-73e6e52a-d8fe-486b-bc17-0f76bf1a75cf tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.595s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:34:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-73e6e52a-d8fe-486b-bc17-0f76bf1a75cf tempest-CreateVolumesFromSourceVolumeTest-408073723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-129334384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14df5cee-b080-4c09-907d-d8e251c4d00d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7e36e4eba804b01be8104dce2bafd02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:34:12Z,use_quota=True,user_id='600b58c3d7e043e0a604a24338264757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:34:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-73e6e52a-d8fe-486b-bc17-0f76bf1a75cf tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Creating volume 14df5cee-b080-4c09-907d-d8e251c4d00d {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:34:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-73e6e52a-d8fe-486b-bc17-0f76bf1a75cf tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:34:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-73e6e52a-d8fe-486b-bc17-0f76bf1a75cf tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:34:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-73e6e52a-d8fe-486b-bc17-0f76bf1a75cf tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:34:14 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-73e6e52a-d8fe-486b-bc17-0f76bf1a75cf tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:34:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-73e6e52a-d8fe-486b-bc17-0f76bf1a75cf tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:34:14 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-73e6e52a-d8fe-486b-bc17-0f76bf1a75cf tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:34:14 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-73e6e52a-d8fe-486b-bc17-0f76bf1a75cf tempest-CreateVolumesFromSourceVolumeTest-408073723 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:34:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-73e6e52a-d8fe-486b-bc17-0f76bf1a75cf tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-14df5cee-b080-4c09-907d-d8e251c4d00d 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:14 devstack sudo[104502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-14df5cee-b080-4c09-907d-d8e251c4d00d 1073741824 Jul 07 08:34:14 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-82285458-461a-406e-80ee-16b43854b212 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f56a7f4f-2018-4fd2-80ac-32ae5cfbf760) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87b34aea-986b-433e-adbe-7ecb7a8852fb', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:14 devstack sudo[104502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:14 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-82285458-461a-406e-80ee-16b43854b212 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d7f5fbc-8a44-4eb0-93ed-8cc25a3c9099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:14 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-82285458-461a-406e-80ee-16b43854b212 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Volume volume-87b34aea-986b-433e-adbe-7ecb7a8852fb (87b34aea-986b-433e-adbe-7ecb7a8852fb): created successfully Jul 07 08:34:14 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-82285458-461a-406e-80ee-16b43854b212 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d7f5fbc-8a44-4eb0-93ed-8cc25a3c9099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:14 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-82285458-461a-406e-80ee-16b43854b212 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Flow 'volume_create_manager' (971c952f-dfd6-4f07-adb1-354386d73642) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:34:14 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-82285458-461a-406e-80ee-16b43854b212 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Created volume successfully. Jul 07 08:34:14 devstack sudo[104502]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-73e6e52a-d8fe-486b-bc17-0f76bf1a75cf tempest-CreateVolumesFromSourceVolumeTest-408073723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-14df5cee-b080-4c09-907d-d8e251c4d00d 1073741824" returned: 0 in 0.914s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-73e6e52a-d8fe-486b-bc17-0f76bf1a75cf tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-14df5cee-b080-4c09-907d-d8e251c4d00d {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:14 devstack sudo[104508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-14df5cee-b080-4c09-907d-d8e251c4d00d Jul 07 08:34:14 devstack sudo[104508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-bb93fab4-3890-4cda-9dac-4ffcd681997f tempest-CreateVolumesFromSnapshotTest-1959601045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:34:15 devstack sudo[104508]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-73e6e52a-d8fe-486b-bc17-0f76bf1a75cf tempest-CreateVolumesFromSourceVolumeTest-408073723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-14df5cee-b080-4c09-907d-d8e251c4d00d" returned: 0 in 0.711s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-73e6e52a-d8fe-486b-bc17-0f76bf1a75cf tempest-CreateVolumesFromSourceVolumeTest-408073723 None] <== create_volume: return (1671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:34:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-73e6e52a-d8fe-486b-bc17-0f76bf1a75cf tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.675s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:34:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-58db2e84-f452-4eb9-860e-63e16273c05f tempest-ProjectReaderTests-1685940573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.237s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:34:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-58db2e84-f452-4eb9-860e-63e16273c05f tempest-ProjectReaderTests-1685940573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:34:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1269756385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af4a7bf0-ca73-4ffb-b5b6-eea4cc685533,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06330941a308447a9ec29b93464314b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:34:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:34:13Z,use_quota=True,user_id='7e7152ed33e44a5a937717a4c518b2d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:34:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-58db2e84-f452-4eb9-860e-63e16273c05f tempest-ProjectReaderTests-1685940573 None] Creating volume af4a7bf0-ca73-4ffb-b5b6-eea4cc685533 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:34:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-58db2e84-f452-4eb9-860e-63e16273c05f tempest-ProjectReaderTests-1685940573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:34:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-58db2e84-f452-4eb9-860e-63e16273c05f tempest-ProjectReaderTests-1685940573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:34:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-58db2e84-f452-4eb9-860e-63e16273c05f tempest-ProjectReaderTests-1685940573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:34:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-58db2e84-f452-4eb9-860e-63e16273c05f tempest-ProjectReaderTests-1685940573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:34:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-58db2e84-f452-4eb9-860e-63e16273c05f tempest-ProjectReaderTests-1685940573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:34:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-58db2e84-f452-4eb9-860e-63e16273c05f tempest-ProjectReaderTests-1685940573 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:34:15 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-58db2e84-f452-4eb9-860e-63e16273c05f tempest-ProjectReaderTests-1685940573 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:34:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-58db2e84-f452-4eb9-860e-63e16273c05f tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-73e6e52a-d8fe-486b-bc17-0f76bf1a75cf tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (747bb209-81be-4c5f-8178-c0971daa722e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14df5cee-b080-4c09-907d-d8e251c4d00d', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:15 devstack sudo[104512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533 1073741824 Jul 07 08:34:15 devstack sudo[104512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-73e6e52a-d8fe-486b-bc17-0f76bf1a75cf tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57647fc0-997e-47e1-89d8-8a1c9bb68bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:15 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-73e6e52a-d8fe-486b-bc17-0f76bf1a75cf tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Volume volume-14df5cee-b080-4c09-907d-d8e251c4d00d (14df5cee-b080-4c09-907d-d8e251c4d00d): created successfully Jul 07 08:34:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-73e6e52a-d8fe-486b-bc17-0f76bf1a75cf tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57647fc0-997e-47e1-89d8-8a1c9bb68bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-73e6e52a-d8fe-486b-bc17-0f76bf1a75cf tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Flow 'volume_create_manager' (791461a6-a054-4872-b7cd-6c9a2ff08c1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:34:15 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-73e6e52a-d8fe-486b-bc17-0f76bf1a75cf tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Created volume successfully. Jul 07 08:34:16 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:34:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Flow 'volume_create_manager' (d72647cc-cf00-4876-aaba-777b3e63c552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:34:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50ff01da-2957-4e72-ad03-30dcd293cc33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50ff01da-2957-4e72-ad03-30dcd293cc33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:34:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aea3cf1-6405-4571-80a1-9c2d40d4e491,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90a47e1d22a2469e9a475f9d37a49713',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:34:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:34:16Z,use_quota=True,user_id='0e3dc72115474b9990d1eaa72eb93cf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2b4eb7-a45b-4737-8249-0f6ae0de295d),volume_type_id=dc2b4eb7-a45b-4737-8249-0f6ae0de295d)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (243f317b-32e9-4108-b35f-af567853d3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (243f317b-32e9-4108-b35f-af567853d3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42796f5b-afc0-41de-aafd-619642188b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:16 devstack cinder-volume[87199]: DEBUG cinder.image.glance [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Creating Keystone auth plugin from conf {{(pid=87199) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 08:34:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42796f5b-afc0-41de-aafd-619642188b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7aea3cf1-6405-4571-80a1-9c2d40d4e491', 'volume_name': 'volume-7aea3cf1-6405-4571-80a1-9c2d40d4e491', 'volume_size': 1, 'image_id': 'bebe7804-1e87-4c9c-8e59-9163f794b649', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bebe7804-1e87-4c9c-8e59-9163f794b649', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3c56b131664a6c54d6f2b8ffc79c8175', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '90a47e1d22a2469e9a475f9d37a49713', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '98a519afd771c795ad666c36d10a9afa08cffb0a35e6ce9d12984e0ddb21dd93565410e112dc70d70cfc37938a56d8ff69f1e85b76687a2ff650c07e67021ea0', 'id': 'bebe7804-1e87-4c9c-8e59-9163f794b649', 'created_at': datetime.datetime(2026, 7, 7, 6, 34, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 6, 34, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bebe7804-1e87-4c9c-8e59-9163f794b649/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edbcb38e-1444-4028-a476-bd7180387830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edbcb38e-1444-4028-a476-bd7180387830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5b240f1-5d12-45a7-abb2-10ce1d616d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:16 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Volume 7aea3cf1-6405-4571-80a1-9c2d40d4e491: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7aea3cf1-6405-4571-80a1-9c2d40d4e491', 'volume_size': 1, 'image_id': 'bebe7804-1e87-4c9c-8e59-9163f794b649', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bebe7804-1e87-4c9c-8e59-9163f794b649', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3c56b131664a6c54d6f2b8ffc79c8175', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '90a47e1d22a2469e9a475f9d37a49713', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '98a519afd771c795ad666c36d10a9afa08cffb0a35e6ce9d12984e0ddb21dd93565410e112dc70d70cfc37938a56d8ff69f1e85b76687a2ff650c07e67021ea0', 'id': 'bebe7804-1e87-4c9c-8e59-9163f794b649', 'created_at': datetime.datetime(2026, 7, 7, 6, 34, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 6, 34, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bebe7804-1e87-4c9c-8e59-9163f794b649/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 07 08:34:16 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Trying to clone 7aea3cf1-6405-4571-80a1-9c2d40d4e491 from image bebe7804-1e87-4c9c-8e59-9163f794b649 at location (None, [{'url': 'file:///opt/stack/data/glance/images/bebe7804-1e87-4c9c-8e59-9163f794b649', 'metadata': {}}]). {{(pid=87199) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 08:34:16 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bebe7804-1e87-4c9c-8e59-9163f794b649_go1rg9y7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87199) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 08:34:16 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Image download 0.00 MB at 0.00 MB/s Jul 07 08:34:16 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8721b5e-aff5-4e81-b537-95a0cb7d6fca]: (4, 'raw') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:34:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bebe7804-1e87-4c9c-8e59-9163f794b649_go1rg9y7devstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:16 devstack sudo[104512]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-58db2e84-f452-4eb9-860e-63e16273c05f tempest-ProjectReaderTests-1685940573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533 1073741824" returned: 0 in 0.918s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-58db2e84-f452-4eb9-860e-63e16273c05f tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:16 devstack sudo[104519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533 Jul 07 08:34:16 devstack sudo[104519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:16 devstack sudo[104518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bebe7804-1e87-4c9c-8e59-9163f794b649_go1rg9y7devstack@QuobyteHD Jul 07 08:34:16 devstack sudo[104518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:17 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c1cc4e1-a382-471f-9fd2-51f75976fca8 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:34:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1c1cc4e1-a382-471f-9fd2-51f75976fca8 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Flow 'volume_create_manager' (d841a722-43ab-47e6-aa59-a775b41ec794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:34:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1c1cc4e1-a382-471f-9fd2-51f75976fca8 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10b095b8-e6f2-443c-ad3c-4c3b8dd5c56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1c1cc4e1-a382-471f-9fd2-51f75976fca8 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10b095b8-e6f2-443c-ad3c-4c3b8dd5c56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:34:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2111877130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41dd2899-d6ec-4947-8962-508cce2b996f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7e36e4eba804b01be8104dce2bafd02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:34:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:34:17Z,use_quota=True,user_id='600b58c3d7e043e0a604a24338264757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1c1cc4e1-a382-471f-9fd2-51f75976fca8 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2771a8e0-58ab-4181-82f3-8cb17727c5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1c1cc4e1-a382-471f-9fd2-51f75976fca8 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2771a8e0-58ab-4181-82f3-8cb17727c5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1c1cc4e1-a382-471f-9fd2-51f75976fca8 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c54855c-0c71-4e42-be73-583356b0aa28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1c1cc4e1-a382-471f-9fd2-51f75976fca8 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c54855c-0c71-4e42-be73-583356b0aa28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41dd2899-d6ec-4947-8962-508cce2b996f', 'volume_name': 'volume-41dd2899-d6ec-4947-8962-508cce2b996f', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1c1cc4e1-a382-471f-9fd2-51f75976fca8 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (775541a1-7d75-4549-9ee5-d6d9165f5bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1c1cc4e1-a382-471f-9fd2-51f75976fca8 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (775541a1-7d75-4549-9ee5-d6d9165f5bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1c1cc4e1-a382-471f-9fd2-51f75976fca8 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (147c08af-f3ec-48ef-b086-b20a437ac92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:17 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-1c1cc4e1-a382-471f-9fd2-51f75976fca8 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Volume 41dd2899-d6ec-4947-8962-508cce2b996f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41dd2899-d6ec-4947-8962-508cce2b996f', 'volume_size': 1} Jul 07 08:34:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1c1cc4e1-a382-471f-9fd2-51f75976fca8 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:34:17 devstack sudo[104518]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bebe7804-1e87-4c9c-8e59-9163f794b649_go1rg9y7devstack@QuobyteHD" returned: 0 in 0.767s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bebe7804-1e87-4c9c-8e59-9163f794b649_go1rg9y7devstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:17 devstack sudo[104519]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-58db2e84-f452-4eb9-860e-63e16273c05f tempest-ProjectReaderTests-1685940573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533" returned: 0 in 0.744s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:17 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-58db2e84-f452-4eb9-860e-63e16273c05f tempest-ProjectReaderTests-1685940573 None] <== create_volume: return (1703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:34:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-58db2e84-f452-4eb9-860e-63e16273c05f tempest-ProjectReaderTests-1685940573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.706s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:34:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-bb93fab4-3890-4cda-9dac-4ffcd681997f tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.955s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:34:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-58db2e84-f452-4eb9-860e-63e16273c05f tempest-ProjectReaderTests-1685940573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a80bcc4-ca1a-4f0f-b2aa-638c934201f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-58db2e84-f452-4eb9-860e-63e16273c05f tempest-ProjectReaderTests-1685940573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff98af4a-6894-4974-9dfc-cea5670c913c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:17 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-bb93fab4-3890-4cda-9dac-4ffcd681997f tempest-CreateVolumesFromSnapshotTest-1959601045 None] Creating offline snapshot fb953425-39c1-4dc9-941d-ecca86351e64 of volume 87b34aea-986b-433e-adbe-7ecb7a8852fb {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:34:17 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-58db2e84-f452-4eb9-860e-63e16273c05f tempest-ProjectReaderTests-1685940573 None] Volume volume-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533 (af4a7bf0-ca73-4ffb-b5b6-eea4cc685533): created successfully Jul 07 08:34:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-58db2e84-f452-4eb9-860e-63e16273c05f tempest-ProjectReaderTests-1685940573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff98af4a-6894-4974-9dfc-cea5670c913c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-58db2e84-f452-4eb9-860e-63e16273c05f tempest-ProjectReaderTests-1685940573 None] Flow 'volume_create_manager' (79ebd4fb-74aa-42c8-89d9-284465076e00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:34:17 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4b3e18-f96b-44c9-9ae7-fc0c93c63233]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:34:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bb93fab4-3890-4cda-9dac-4ffcd681997f tempest-CreateVolumesFromSnapshotTest-1959601045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87b34aea-986b-433e-adbe-7ecb7a8852fb {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:17 devstack sudo[104525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bebe7804-1e87-4c9c-8e59-9163f794b649_go1rg9y7devstack@QuobyteHD Jul 07 08:34:17 devstack sudo[104525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:17 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-58db2e84-f452-4eb9-860e-63e16273c05f tempest-ProjectReaderTests-1685940573 None] Created volume successfully. Jul 07 08:34:17 devstack sudo[104526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87b34aea-986b-433e-adbe-7ecb7a8852fb Jul 07 08:34:17 devstack sudo[104526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:17 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0b78e76-b7ba-4fee-8256-2eb8e001a9a5 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:34:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f0b78e76-b7ba-4fee-8256-2eb8e001a9a5 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Flow 'volume_create_manager' (2181e910-6b27-4941-9eb6-7d4277fb90d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:34:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f0b78e76-b7ba-4fee-8256-2eb8e001a9a5 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd6d3ffc-324b-4bb9-827a-e546fabc5d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f0b78e76-b7ba-4fee-8256-2eb8e001a9a5 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd6d3ffc-324b-4bb9-827a-e546fabc5d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:34:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2120365291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85ec3799-b59a-427e-bb02-abc9afc61de0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7e36e4eba804b01be8104dce2bafd02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:34:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:34:18Z,use_quota=True,user_id='600b58c3d7e043e0a604a24338264757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f0b78e76-b7ba-4fee-8256-2eb8e001a9a5 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0f14945-dae7-4b14-a4b8-67643bad9b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f0b78e76-b7ba-4fee-8256-2eb8e001a9a5 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0f14945-dae7-4b14-a4b8-67643bad9b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f0b78e76-b7ba-4fee-8256-2eb8e001a9a5 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (370845da-9add-4403-8d88-bce700893ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f0b78e76-b7ba-4fee-8256-2eb8e001a9a5 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (370845da-9add-4403-8d88-bce700893ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85ec3799-b59a-427e-bb02-abc9afc61de0', 'volume_name': 'volume-85ec3799-b59a-427e-bb02-abc9afc61de0', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f0b78e76-b7ba-4fee-8256-2eb8e001a9a5 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bddd5823-e6a8-465c-a7b4-3d51e3a039de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f0b78e76-b7ba-4fee-8256-2eb8e001a9a5 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bddd5823-e6a8-465c-a7b4-3d51e3a039de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:17 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f0b78e76-b7ba-4fee-8256-2eb8e001a9a5 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8e21e0c-0271-40f4-bb1c-4fc5e16e1328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:17 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-f0b78e76-b7ba-4fee-8256-2eb8e001a9a5 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Volume 85ec3799-b59a-427e-bb02-abc9afc61de0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85ec3799-b59a-427e-bb02-abc9afc61de0', 'volume_size': 1} Jul 07 08:34:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f0b78e76-b7ba-4fee-8256-2eb8e001a9a5 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:34:18 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a547ea5-73e7-45c6-9618-b513e4593a33 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:34:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5a547ea5-73e7-45c6-9618-b513e4593a33 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Flow 'volume_create_manager' (22a29b02-5aba-4a00-bacf-a5fe216f64d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:34:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5a547ea5-73e7-45c6-9618-b513e4593a33 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c0ec18d-b1d2-4b28-b645-279ce086b283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a8a867e0-3433-4b11-9be5-52d6f0e93c79 tempest-ProjectReaderTests-1685940573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:34:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5a547ea5-73e7-45c6-9618-b513e4593a33 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c0ec18d-b1d2-4b28-b645-279ce086b283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:34:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1123820594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82f888df-81bf-46be-816b-5b0183a2f459,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7e36e4eba804b01be8104dce2bafd02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:34:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:34:18Z,use_quota=True,user_id='600b58c3d7e043e0a604a24338264757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5a547ea5-73e7-45c6-9618-b513e4593a33 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16b667b7-72da-4ab2-a69d-8b42c24bd11e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5a547ea5-73e7-45c6-9618-b513e4593a33 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16b667b7-72da-4ab2-a69d-8b42c24bd11e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5a547ea5-73e7-45c6-9618-b513e4593a33 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b454603d-f879-4cd5-916c-207aade6211a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5a547ea5-73e7-45c6-9618-b513e4593a33 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b454603d-f879-4cd5-916c-207aade6211a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82f888df-81bf-46be-816b-5b0183a2f459', 'volume_name': 'volume-82f888df-81bf-46be-816b-5b0183a2f459', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:18 devstack sudo[104525]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5a547ea5-73e7-45c6-9618-b513e4593a33 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d13ee48-68f3-4518-bd4e-e7ba93c6ea47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5a547ea5-73e7-45c6-9618-b513e4593a33 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d13ee48-68f3-4518-bd4e-e7ba93c6ea47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5a547ea5-73e7-45c6-9618-b513e4593a33 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2a44080-e70e-49dc-b94d-9e0741bf8eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:18 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-5a547ea5-73e7-45c6-9618-b513e4593a33 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Volume 82f888df-81bf-46be-816b-5b0183a2f459: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82f888df-81bf-46be-816b-5b0183a2f459', 'volume_size': 1} Jul 07 08:34:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-5a547ea5-73e7-45c6-9618-b513e4593a33 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:34:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bebe7804-1e87-4c9c-8e59-9163f794b649_go1rg9y7devstack@QuobyteHD" returned: 1 in 1.039s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bebe7804-1e87-4c9c-8e59-9163f794b649_go1rg9y7devstack@QuobyteHD' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:34:18 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Temporary image bebe7804-1e87-4c9c-8e59-9163f794b649 is fetched for user 0e3dc72115474b9990d1eaa72eb93cf2. {{(pid=87199) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 08:34:18 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[6860ac96-b076-445c-b219-f75ea6063ffe]: (4, 'raw') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:34:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bebe7804-1e87-4c9c-8e59-9163f794b649_go1rg9y7devstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:18 devstack sudo[104526]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bb93fab4-3890-4cda-9dac-4ffcd681997f tempest-CreateVolumesFromSnapshotTest-1959601045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87b34aea-986b-433e-adbe-7ecb7a8852fb" returned: 0 in 1.052s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bb93fab4-3890-4cda-9dac-4ffcd681997f tempest-CreateVolumesFromSnapshotTest-1959601045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87b34aea-986b-433e-adbe-7ecb7a8852fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87b34aea-986b-433e-adbe-7ecb7a8852fb.fb953425-39c1-4dc9-941d-ecca86351e64 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:18 devstack sudo[104538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87b34aea-986b-433e-adbe-7ecb7a8852fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87b34aea-986b-433e-adbe-7ecb7a8852fb.fb953425-39c1-4dc9-941d-ecca86351e64 1G Jul 07 08:34:18 devstack sudo[104538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:18 devstack sudo[104537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bebe7804-1e87-4c9c-8e59-9163f794b649_go1rg9y7devstack@QuobyteHD Jul 07 08:34:18 devstack sudo[104537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:18 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-00aab952-5963-4fac-ad0c-c518ffd42927 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:34:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-00aab952-5963-4fac-ad0c-c518ffd42927 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Flow 'volume_create_manager' (c0b6b0c3-2e88-46f8-a897-a65cf71f39a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:34:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-00aab952-5963-4fac-ad0c-c518ffd42927 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (360abd25-476c-4751-835d-4ad5bdb4e05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-00aab952-5963-4fac-ad0c-c518ffd42927 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (360abd25-476c-4751-835d-4ad5bdb4e05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:34:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-759542358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31998d80-bcf8-4e3f-838f-285fa4b7bd2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7e36e4eba804b01be8104dce2bafd02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:34:19Z,use_quota=True,user_id='600b58c3d7e043e0a604a24338264757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-00aab952-5963-4fac-ad0c-c518ffd42927 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b00d585c-d50e-4a81-83e0-282d57204a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-00aab952-5963-4fac-ad0c-c518ffd42927 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b00d585c-d50e-4a81-83e0-282d57204a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-00aab952-5963-4fac-ad0c-c518ffd42927 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf0f05ce-a897-4870-951c-33e268bd7cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-00aab952-5963-4fac-ad0c-c518ffd42927 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf0f05ce-a897-4870-951c-33e268bd7cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31998d80-bcf8-4e3f-838f-285fa4b7bd2e', 'volume_name': 'volume-31998d80-bcf8-4e3f-838f-285fa4b7bd2e', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-00aab952-5963-4fac-ad0c-c518ffd42927 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (910acaca-4b50-4cda-b1f4-1acab5a517f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-00aab952-5963-4fac-ad0c-c518ffd42927 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (910acaca-4b50-4cda-b1f4-1acab5a517f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-00aab952-5963-4fac-ad0c-c518ffd42927 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8316fc6-abce-4406-92ee-dc564aa9efd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:18 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-00aab952-5963-4fac-ad0c-c518ffd42927 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Volume 31998d80-bcf8-4e3f-838f-285fa4b7bd2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31998d80-bcf8-4e3f-838f-285fa4b7bd2e', 'volume_size': 1} Jul 07 08:34:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-00aab952-5963-4fac-ad0c-c518ffd42927 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:34:19 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-8efb428c-6193-4dc7-93b5-bfc02592dc44 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:34:19 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8efb428c-6193-4dc7-93b5-bfc02592dc44 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Flow 'volume_create_manager' (2362561d-de33-44f2-8d85-b95d37b3cde1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:34:19 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8efb428c-6193-4dc7-93b5-bfc02592dc44 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f725fdee-3180-49da-aef7-7b944305d73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:19 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8efb428c-6193-4dc7-93b5-bfc02592dc44 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f725fdee-3180-49da-aef7-7b944305d73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1329832241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1901880d-27c1-4749-9c28-6f5d66f163bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7e36e4eba804b01be8104dce2bafd02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:34:19Z,use_quota=True,user_id='600b58c3d7e043e0a604a24338264757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:19 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8efb428c-6193-4dc7-93b5-bfc02592dc44 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6ebb90d-7c1a-4613-b8f1-e71576a0d6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:19 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8efb428c-6193-4dc7-93b5-bfc02592dc44 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6ebb90d-7c1a-4613-b8f1-e71576a0d6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:19 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8efb428c-6193-4dc7-93b5-bfc02592dc44 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e002af97-ee46-47e4-81b3-eb64fe9d897a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:19 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8efb428c-6193-4dc7-93b5-bfc02592dc44 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e002af97-ee46-47e4-81b3-eb64fe9d897a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1901880d-27c1-4749-9c28-6f5d66f163bf', 'volume_name': 'volume-1901880d-27c1-4749-9c28-6f5d66f163bf', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:19 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8efb428c-6193-4dc7-93b5-bfc02592dc44 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38075dbd-b3b4-427a-8a51-97bf617bdfe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:19 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8efb428c-6193-4dc7-93b5-bfc02592dc44 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38075dbd-b3b4-427a-8a51-97bf617bdfe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:19 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8efb428c-6193-4dc7-93b5-bfc02592dc44 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfaae813-57bc-450b-965f-8421d46e20fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:19 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-8efb428c-6193-4dc7-93b5-bfc02592dc44 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Volume 1901880d-27c1-4749-9c28-6f5d66f163bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1901880d-27c1-4749-9c28-6f5d66f163bf', 'volume_size': 1} Jul 07 08:34:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8efb428c-6193-4dc7-93b5-bfc02592dc44 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:34:19 devstack sudo[104537]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bebe7804-1e87-4c9c-8e59-9163f794b649_go1rg9y7devstack@QuobyteHD" returned: 0 in 0.870s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bebe7804-1e87-4c9c-8e59-9163f794b649_go1rg9y7devstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:19 devstack sudo[104538]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bb93fab4-3890-4cda-9dac-4ffcd681997f tempest-CreateVolumesFromSnapshotTest-1959601045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87b34aea-986b-433e-adbe-7ecb7a8852fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87b34aea-986b-433e-adbe-7ecb7a8852fb.fb953425-39c1-4dc9-941d-ecca86351e64 1G" returned: 0 in 0.943s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bb93fab4-3890-4cda-9dac-4ffcd681997f tempest-CreateVolumesFromSnapshotTest-1959601045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87b34aea-986b-433e-adbe-7ecb7a8852fb -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87b34aea-986b-433e-adbe-7ecb7a8852fb.fb953425-39c1-4dc9-941d-ecca86351e64 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:19 devstack sudo[104546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bebe7804-1e87-4c9c-8e59-9163f794b649_go1rg9y7devstack@QuobyteHD Jul 07 08:34:19 devstack sudo[104546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:19 devstack sudo[104547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87b34aea-986b-433e-adbe-7ecb7a8852fb -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87b34aea-986b-433e-adbe-7ecb7a8852fb.fb953425-39c1-4dc9-941d-ecca86351e64 Jul 07 08:34:19 devstack sudo[104547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:20 devstack sudo[104546]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bebe7804-1e87-4c9c-8e59-9163f794b649_go1rg9y7devstack@QuobyteHD" returned: 1 in 0.759s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bebe7804-1e87-4c9c-8e59-9163f794b649_go1rg9y7devstack@QuobyteHD' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:34:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:34:20 devstack sudo[104547]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bb93fab4-3890-4cda-9dac-4ffcd681997f tempest-CreateVolumesFromSnapshotTest-1959601045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87b34aea-986b-433e-adbe-7ecb7a8852fb -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87b34aea-986b-433e-adbe-7ecb7a8852fb.fb953425-39c1-4dc9-941d-ecca86351e64" returned: 0 in 0.699s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:20 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-bb93fab4-3890-4cda-9dac-4ffcd681997f tempest-CreateVolumesFromSnapshotTest-1959601045 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87b34aea-986b-433e-adbe-7ecb7a8852fb.fb953425-39c1-4dc9-941d-ecca86351e64 is being set with open permissions: ugo+rw Jul 07 08:34:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bb93fab4-3890-4cda-9dac-4ffcd681997f tempest-CreateVolumesFromSnapshotTest-1959601045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87b34aea-986b-433e-adbe-7ecb7a8852fb.fb953425-39c1-4dc9-941d-ecca86351e64 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:20 devstack sudo[104556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87b34aea-986b-433e-adbe-7ecb7a8852fb.fb953425-39c1-4dc9-941d-ecca86351e64 Jul 07 08:34:20 devstack sudo[104556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:20 devstack sudo[104556]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bb93fab4-3890-4cda-9dac-4ffcd681997f tempest-CreateVolumesFromSnapshotTest-1959601045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87b34aea-986b-433e-adbe-7ecb7a8852fb.fb953425-39c1-4dc9-941d-ecca86351e64" returned: 0 in 0.638s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bb93fab4-3890-4cda-9dac-4ffcd681997f tempest-CreateVolumesFromSnapshotTest-1959601045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87b34aea-986b-433e-adbe-7ecb7a8852fb.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:20 devstack sudo[104559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87b34aea-986b-433e-adbe-7ecb7a8852fb.info Jul 07 08:34:20 devstack sudo[104559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:21 devstack sudo[104559]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bb93fab4-3890-4cda-9dac-4ffcd681997f tempest-CreateVolumesFromSnapshotTest-1959601045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87b34aea-986b-433e-adbe-7ecb7a8852fb.info" returned: 0 in 0.633s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:21 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-bb93fab4-3890-4cda-9dac-4ffcd681997f tempest-CreateVolumesFromSnapshotTest-1959601045 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87b34aea-986b-433e-adbe-7ecb7a8852fb.info is being set with open permissions: ugo+rw Jul 07 08:34:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bb93fab4-3890-4cda-9dac-4ffcd681997f tempest-CreateVolumesFromSnapshotTest-1959601045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87b34aea-986b-433e-adbe-7ecb7a8852fb.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:21 devstack sudo[104563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87b34aea-986b-433e-adbe-7ecb7a8852fb.info Jul 07 08:34:21 devstack sudo[104563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:22 devstack sudo[104563]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-bb93fab4-3890-4cda-9dac-4ffcd681997f tempest-CreateVolumesFromSnapshotTest-1959601045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87b34aea-986b-433e-adbe-7ecb7a8852fb.info" returned: 0 in 0.630s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-bb93fab4-3890-4cda-9dac-4ffcd681997f tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.727s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:34:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1c1cc4e1-a382-471f-9fd2-51f75976fca8 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.811s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:34:22 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1c1cc4e1-a382-471f-9fd2-51f75976fca8 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:34:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2111877130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41dd2899-d6ec-4947-8962-508cce2b996f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7e36e4eba804b01be8104dce2bafd02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:34:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:34:17Z,use_quota=True,user_id='600b58c3d7e043e0a604a24338264757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:34:22 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-1c1cc4e1-a382-471f-9fd2-51f75976fca8 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Creating volume 41dd2899-d6ec-4947-8962-508cce2b996f {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:34:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1c1cc4e1-a382-471f-9fd2-51f75976fca8 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:34:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1c1cc4e1-a382-471f-9fd2-51f75976fca8 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:34:22 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1c1cc4e1-a382-471f-9fd2-51f75976fca8 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:34:22 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1c1cc4e1-a382-471f-9fd2-51f75976fca8 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:34:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1c1cc4e1-a382-471f-9fd2-51f75976fca8 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:34:22 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1c1cc4e1-a382-471f-9fd2-51f75976fca8 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:34:22 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-1c1cc4e1-a382-471f-9fd2-51f75976fca8 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:34:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1c1cc4e1-a382-471f-9fd2-51f75976fca8 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41dd2899-d6ec-4947-8962-508cce2b996f 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:22 devstack sudo[104566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41dd2899-d6ec-4947-8962-508cce2b996f 1073741824 Jul 07 08:34:22 devstack sudo[104566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:22 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-bb93fab4-3890-4cda-9dac-4ffcd681997f tempest-CreateVolumesFromSnapshotTest-1959601045 None] Create snapshot completed successfully Jul 07 08:34:22 devstack sudo[104566]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1c1cc4e1-a382-471f-9fd2-51f75976fca8 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41dd2899-d6ec-4947-8962-508cce2b996f 1073741824" returned: 0 in 0.808s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1c1cc4e1-a382-471f-9fd2-51f75976fca8 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41dd2899-d6ec-4947-8962-508cce2b996f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:22 devstack sudo[104571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41dd2899-d6ec-4947-8962-508cce2b996f Jul 07 08:34:22 devstack sudo[104571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:23 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-803b256b-f1fa-4574-a0c6-8ae28052894d tempest-CreateVolumesFromSnapshotTest-1959601045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:34:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-803b256b-f1fa-4574-a0c6-8ae28052894d tempest-CreateVolumesFromSnapshotTest-1959601045 None] Flow 'volume_create_manager' (8aa3b4b8-3993-48b7-8b6d-347f7c100d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:34:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-803b256b-f1fa-4574-a0c6-8ae28052894d tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee1852fe-21aa-40e3-8954-52d10df39535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-803b256b-f1fa-4574-a0c6-8ae28052894d tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee1852fe-21aa-40e3-8954-52d10df39535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:34:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-781016932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c42a951-01db-4eda-ae89-ff532feebcd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='314dd98dd2ef4ddbb08dcd63398f6370',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:34:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:34:23Z,use_quota=True,user_id='286198b13787439e946961c654750a36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-803b256b-f1fa-4574-a0c6-8ae28052894d tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e2f6a41-8f56-43ee-a0d6-1fc9efeb6d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-803b256b-f1fa-4574-a0c6-8ae28052894d tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e2f6a41-8f56-43ee-a0d6-1fc9efeb6d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-803b256b-f1fa-4574-a0c6-8ae28052894d tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef01706b-0bb5-45bb-bfe5-00c63cf684f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-803b256b-f1fa-4574-a0c6-8ae28052894d tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef01706b-0bb5-45bb-bfe5-00c63cf684f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c42a951-01db-4eda-ae89-ff532feebcd9', 'volume_name': 'volume-8c42a951-01db-4eda-ae89-ff532feebcd9', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-803b256b-f1fa-4574-a0c6-8ae28052894d tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a84f2a5a-1467-4e1b-a762-ff3fc56765f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-803b256b-f1fa-4574-a0c6-8ae28052894d tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a84f2a5a-1467-4e1b-a762-ff3fc56765f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-803b256b-f1fa-4574-a0c6-8ae28052894d tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49c83a9c-fc06-4c1a-a67d-33522217df0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:23 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-803b256b-f1fa-4574-a0c6-8ae28052894d tempest-CreateVolumesFromSnapshotTest-1959601045 None] Volume 8c42a951-01db-4eda-ae89-ff532feebcd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c42a951-01db-4eda-ae89-ff532feebcd9', 'volume_size': 1} Jul 07 08:34:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-803b256b-f1fa-4574-a0c6-8ae28052894d tempest-CreateVolumesFromSnapshotTest-1959601045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:34:23 devstack sudo[104571]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1c1cc4e1-a382-471f-9fd2-51f75976fca8 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41dd2899-d6ec-4947-8962-508cce2b996f" returned: 0 in 0.705s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1c1cc4e1-a382-471f-9fd2-51f75976fca8 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] <== create_volume: return (1551ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:34:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1c1cc4e1-a382-471f-9fd2-51f75976fca8 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.555s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:34:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f0b78e76-b7ba-4fee-8256-2eb8e001a9a5 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.801s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:34:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f0b78e76-b7ba-4fee-8256-2eb8e001a9a5 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:34:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2120365291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85ec3799-b59a-427e-bb02-abc9afc61de0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7e36e4eba804b01be8104dce2bafd02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:34:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:34:18Z,use_quota=True,user_id='600b58c3d7e043e0a604a24338264757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:34:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-f0b78e76-b7ba-4fee-8256-2eb8e001a9a5 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Creating volume 85ec3799-b59a-427e-bb02-abc9afc61de0 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:34:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f0b78e76-b7ba-4fee-8256-2eb8e001a9a5 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:34:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f0b78e76-b7ba-4fee-8256-2eb8e001a9a5 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:34:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f0b78e76-b7ba-4fee-8256-2eb8e001a9a5 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:34:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f0b78e76-b7ba-4fee-8256-2eb8e001a9a5 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:34:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f0b78e76-b7ba-4fee-8256-2eb8e001a9a5 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:34:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f0b78e76-b7ba-4fee-8256-2eb8e001a9a5 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:34:23 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-f0b78e76-b7ba-4fee-8256-2eb8e001a9a5 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:34:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f0b78e76-b7ba-4fee-8256-2eb8e001a9a5 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-85ec3799-b59a-427e-bb02-abc9afc61de0 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:23 devstack sudo[104574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-85ec3799-b59a-427e-bb02-abc9afc61de0 1073741824 Jul 07 08:34:23 devstack sudo[104574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1c1cc4e1-a382-471f-9fd2-51f75976fca8 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (147c08af-f3ec-48ef-b086-b20a437ac92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41dd2899-d6ec-4947-8962-508cce2b996f', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1c1cc4e1-a382-471f-9fd2-51f75976fca8 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41d5954c-0b05-43c0-b139-f4e8c5626b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:23 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-1c1cc4e1-a382-471f-9fd2-51f75976fca8 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Volume volume-41dd2899-d6ec-4947-8962-508cce2b996f (41dd2899-d6ec-4947-8962-508cce2b996f): created successfully Jul 07 08:34:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1c1cc4e1-a382-471f-9fd2-51f75976fca8 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41d5954c-0b05-43c0-b139-f4e8c5626b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1c1cc4e1-a382-471f-9fd2-51f75976fca8 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Flow 'volume_create_manager' (d841a722-43ab-47e6-aa59-a775b41ec794) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:34:23 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-fea40dce-0051-4247-9212-e29df37939f4 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:34:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-fea40dce-0051-4247-9212-e29df37939f4 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Flow 'volume_create_manager' (1f0beff8-a4a6-48ff-b2b0-5e4303582b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:34:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-fea40dce-0051-4247-9212-e29df37939f4 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad472202-6888-4965-a18b-a05e8712fd6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:23 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-1c1cc4e1-a382-471f-9fd2-51f75976fca8 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Created volume successfully. Jul 07 08:34:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-fea40dce-0051-4247-9212-e29df37939f4 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad472202-6888-4965-a18b-a05e8712fd6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:34:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1203063533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4001870-4716-4aaf-a040-6474e605031b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='314dd98dd2ef4ddbb08dcd63398f6370',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:34:24Z,use_quota=True,user_id='286198b13787439e946961c654750a36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-fea40dce-0051-4247-9212-e29df37939f4 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b58f9a64-d5b4-46fd-bfaf-1c808a8da1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-fea40dce-0051-4247-9212-e29df37939f4 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b58f9a64-d5b4-46fd-bfaf-1c808a8da1c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-fea40dce-0051-4247-9212-e29df37939f4 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e97c3f54-b743-45fe-b851-613e13c8da55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-fea40dce-0051-4247-9212-e29df37939f4 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e97c3f54-b743-45fe-b851-613e13c8da55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4001870-4716-4aaf-a040-6474e605031b', 'volume_name': 'volume-c4001870-4716-4aaf-a040-6474e605031b', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-fea40dce-0051-4247-9212-e29df37939f4 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00b0afa1-b9d7-4701-8663-43b29a479403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-fea40dce-0051-4247-9212-e29df37939f4 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00b0afa1-b9d7-4701-8663-43b29a479403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-fea40dce-0051-4247-9212-e29df37939f4 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8d0f435-aea3-4761-8408-cfdf7d7d3f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:23 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-fea40dce-0051-4247-9212-e29df37939f4 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Volume c4001870-4716-4aaf-a040-6474e605031b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4001870-4716-4aaf-a040-6474e605031b', 'volume_size': 1} Jul 07 08:34:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-fea40dce-0051-4247-9212-e29df37939f4 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:34:24 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3e317d4-27c3-4896-989e-23cc80e25bbb tempest-CreateVolumesFromSnapshotTest-1959601045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:34:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f3e317d4-27c3-4896-989e-23cc80e25bbb tempest-CreateVolumesFromSnapshotTest-1959601045 None] Flow 'volume_create_manager' (72a97dab-176e-4c49-b3f7-d5dbd2e1e39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:34:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f3e317d4-27c3-4896-989e-23cc80e25bbb tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (110b4f40-385c-4fca-9c22-fc4764e4a723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f3e317d4-27c3-4896-989e-23cc80e25bbb tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (110b4f40-385c-4fca-9c22-fc4764e4a723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-570087524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3dd316e-9ee4-4cfc-9e93-5450af047a63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='314dd98dd2ef4ddbb08dcd63398f6370',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:34:24Z,use_quota=True,user_id='286198b13787439e946961c654750a36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f3e317d4-27c3-4896-989e-23cc80e25bbb tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88ff0c60-7830-40cf-8eaf-5a42fe3b7f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f3e317d4-27c3-4896-989e-23cc80e25bbb tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88ff0c60-7830-40cf-8eaf-5a42fe3b7f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f3e317d4-27c3-4896-989e-23cc80e25bbb tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44065cb0-7648-44aa-bbe7-cc78e82dd2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f3e317d4-27c3-4896-989e-23cc80e25bbb tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44065cb0-7648-44aa-bbe7-cc78e82dd2b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3dd316e-9ee4-4cfc-9e93-5450af047a63', 'volume_name': 'volume-d3dd316e-9ee4-4cfc-9e93-5450af047a63', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f3e317d4-27c3-4896-989e-23cc80e25bbb tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4846892-8687-469a-861c-2b3d5274dc1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f3e317d4-27c3-4896-989e-23cc80e25bbb tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4846892-8687-469a-861c-2b3d5274dc1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f3e317d4-27c3-4896-989e-23cc80e25bbb tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37fe6e7c-b79e-46ac-a0f5-85202a85762b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:24 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-f3e317d4-27c3-4896-989e-23cc80e25bbb tempest-CreateVolumesFromSnapshotTest-1959601045 None] Volume d3dd316e-9ee4-4cfc-9e93-5450af047a63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3dd316e-9ee4-4cfc-9e93-5450af047a63', 'volume_size': 1} Jul 07 08:34:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f3e317d4-27c3-4896-989e-23cc80e25bbb tempest-CreateVolumesFromSnapshotTest-1959601045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:34:24 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-60d0c4bc-d22d-42a1-b1c2-baffaa440d58 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:34:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-60d0c4bc-d22d-42a1-b1c2-baffaa440d58 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Flow 'volume_create_manager' (fea51cff-e2b7-4fc6-b44f-3e18adbac282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:34:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-60d0c4bc-d22d-42a1-b1c2-baffaa440d58 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04718be2-41ce-4e40-af31-9b8df82e8af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-60d0c4bc-d22d-42a1-b1c2-baffaa440d58 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04718be2-41ce-4e40-af31-9b8df82e8af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-992195649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba1e4c87-c34c-4043-8fc6-d78ac4670e19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='314dd98dd2ef4ddbb08dcd63398f6370',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:34:24Z,use_quota=True,user_id='286198b13787439e946961c654750a36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-60d0c4bc-d22d-42a1-b1c2-baffaa440d58 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33056cae-8c78-4e72-a1a8-55ce4eae1c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-60d0c4bc-d22d-42a1-b1c2-baffaa440d58 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33056cae-8c78-4e72-a1a8-55ce4eae1c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-60d0c4bc-d22d-42a1-b1c2-baffaa440d58 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4895d31-f1a2-4611-95e4-46ffacd523a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-60d0c4bc-d22d-42a1-b1c2-baffaa440d58 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4895d31-f1a2-4611-95e4-46ffacd523a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba1e4c87-c34c-4043-8fc6-d78ac4670e19', 'volume_name': 'volume-ba1e4c87-c34c-4043-8fc6-d78ac4670e19', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-60d0c4bc-d22d-42a1-b1c2-baffaa440d58 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c96fb6bc-4704-4880-b697-218a7513ab6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-60d0c4bc-d22d-42a1-b1c2-baffaa440d58 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c96fb6bc-4704-4880-b697-218a7513ab6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-60d0c4bc-d22d-42a1-b1c2-baffaa440d58 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e24ed61a-7f67-4cc5-8666-c45cd890abf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:24 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-60d0c4bc-d22d-42a1-b1c2-baffaa440d58 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Volume ba1e4c87-c34c-4043-8fc6-d78ac4670e19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba1e4c87-c34c-4043-8fc6-d78ac4670e19', 'volume_size': 1} Jul 07 08:34:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-60d0c4bc-d22d-42a1-b1c2-baffaa440d58 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:34:24 devstack sudo[104574]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f0b78e76-b7ba-4fee-8256-2eb8e001a9a5 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-85ec3799-b59a-427e-bb02-abc9afc61de0 1073741824" returned: 0 in 0.989s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f0b78e76-b7ba-4fee-8256-2eb8e001a9a5 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-85ec3799-b59a-427e-bb02-abc9afc61de0 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:24 devstack sudo[104580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-85ec3799-b59a-427e-bb02-abc9afc61de0 Jul 07 08:34:24 devstack sudo[104580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:24 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a9c7d07-0cff-4cb4-8858-bd0f0a045eac tempest-CreateVolumesFromSnapshotTest-1959601045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:34:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3a9c7d07-0cff-4cb4-8858-bd0f0a045eac tempest-CreateVolumesFromSnapshotTest-1959601045 None] Flow 'volume_create_manager' (c421fa20-f5d5-470d-aebe-b28fc71f72ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:34:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3a9c7d07-0cff-4cb4-8858-bd0f0a045eac tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10e4e464-f47d-4094-b81d-7da189779c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3a9c7d07-0cff-4cb4-8858-bd0f0a045eac tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10e4e464-f47d-4094-b81d-7da189779c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1413201632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f386e03-d414-4ea7-8152-9f0b152021ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='314dd98dd2ef4ddbb08dcd63398f6370',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:34:25Z,use_quota=True,user_id='286198b13787439e946961c654750a36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3a9c7d07-0cff-4cb4-8858-bd0f0a045eac tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b42fe2f-d36c-40e5-b55f-beae4c30d9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3a9c7d07-0cff-4cb4-8858-bd0f0a045eac tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b42fe2f-d36c-40e5-b55f-beae4c30d9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3a9c7d07-0cff-4cb4-8858-bd0f0a045eac tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddf4af99-cedd-4e35-a4b1-0a31a4b9707d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3a9c7d07-0cff-4cb4-8858-bd0f0a045eac tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddf4af99-cedd-4e35-a4b1-0a31a4b9707d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f386e03-d414-4ea7-8152-9f0b152021ef', 'volume_name': 'volume-2f386e03-d414-4ea7-8152-9f0b152021ef', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3a9c7d07-0cff-4cb4-8858-bd0f0a045eac tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7af60d3c-9b55-4ee5-b604-d04b60849cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3a9c7d07-0cff-4cb4-8858-bd0f0a045eac tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7af60d3c-9b55-4ee5-b604-d04b60849cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3a9c7d07-0cff-4cb4-8858-bd0f0a045eac tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2faad1f-d0d2-4f4e-a2fc-0d30ebfd777f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:24 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-3a9c7d07-0cff-4cb4-8858-bd0f0a045eac tempest-CreateVolumesFromSnapshotTest-1959601045 None] Volume 2f386e03-d414-4ea7-8152-9f0b152021ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f386e03-d414-4ea7-8152-9f0b152021ef', 'volume_size': 1} Jul 07 08:34:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3a9c7d07-0cff-4cb4-8858-bd0f0a045eac tempest-CreateVolumesFromSnapshotTest-1959601045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:34:25 devstack sudo[104580]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f0b78e76-b7ba-4fee-8256-2eb8e001a9a5 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-85ec3799-b59a-427e-bb02-abc9afc61de0" returned: 0 in 0.627s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:25 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f0b78e76-b7ba-4fee-8256-2eb8e001a9a5 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] <== create_volume: return (1666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:34:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f0b78e76-b7ba-4fee-8256-2eb8e001a9a5 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.669s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:34:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a8a867e0-3433-4b11-9be5-52d6f0e93c79 tempest-ProjectReaderTests-1685940573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.027s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:34:25 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f0b78e76-b7ba-4fee-8256-2eb8e001a9a5 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8e21e0c-0271-40f4-bb1c-4fc5e16e1328) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85ec3799-b59a-427e-bb02-abc9afc61de0', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:25 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f0b78e76-b7ba-4fee-8256-2eb8e001a9a5 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30b57a9a-19d5-484e-8f4f-28946b611b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:25 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-a8a867e0-3433-4b11-9be5-52d6f0e93c79 tempest-ProjectReaderTests-1685940573 None] Creating offline snapshot a36c3a48-e29c-4118-ba80-a6f9e202bb87 of volume af4a7bf0-ca73-4ffb-b5b6-eea4cc685533 {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:34:25 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-f0b78e76-b7ba-4fee-8256-2eb8e001a9a5 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Volume volume-85ec3799-b59a-427e-bb02-abc9afc61de0 (85ec3799-b59a-427e-bb02-abc9afc61de0): created successfully Jul 07 08:34:25 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f0b78e76-b7ba-4fee-8256-2eb8e001a9a5 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30b57a9a-19d5-484e-8f4f-28946b611b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:25 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f0b78e76-b7ba-4fee-8256-2eb8e001a9a5 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Flow 'volume_create_manager' (2181e910-6b27-4941-9eb6-7d4277fb90d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:34:25 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc891292-ab87-48cb-90eb-01c28d66945e]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:34:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a8a867e0-3433-4b11-9be5-52d6f0e93c79 tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:25 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-f0b78e76-b7ba-4fee-8256-2eb8e001a9a5 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Created volume successfully. Jul 07 08:34:25 devstack sudo[104583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533 Jul 07 08:34:25 devstack sudo[104583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:26 devstack sudo[104583]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a8a867e0-3433-4b11-9be5-52d6f0e93c79 tempest-ProjectReaderTests-1685940573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533" returned: 0 in 0.752s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a8a867e0-3433-4b11-9be5-52d6f0e93c79 tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533.a36c3a48-e29c-4118-ba80-a6f9e202bb87 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:26 devstack sudo[104588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533.a36c3a48-e29c-4118-ba80-a6f9e202bb87 1G Jul 07 08:34:26 devstack sudo[104588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:26 devstack sudo[104588]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a8a867e0-3433-4b11-9be5-52d6f0e93c79 tempest-ProjectReaderTests-1685940573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533.a36c3a48-e29c-4118-ba80-a6f9e202bb87 1G" returned: 0 in 0.826s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a8a867e0-3433-4b11-9be5-52d6f0e93c79 tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533.a36c3a48-e29c-4118-ba80-a6f9e202bb87 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:27 devstack sudo[104594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533.a36c3a48-e29c-4118-ba80-a6f9e202bb87 Jul 07 08:34:27 devstack sudo[104594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:27 devstack sudo[104594]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a8a867e0-3433-4b11-9be5-52d6f0e93c79 tempest-ProjectReaderTests-1685940573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533.a36c3a48-e29c-4118-ba80-a6f9e202bb87" returned: 0 in 0.676s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:27 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-a8a867e0-3433-4b11-9be5-52d6f0e93c79 tempest-ProjectReaderTests-1685940573 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533.a36c3a48-e29c-4118-ba80-a6f9e202bb87 is being set with open permissions: ugo+rw Jul 07 08:34:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a8a867e0-3433-4b11-9be5-52d6f0e93c79 tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533.a36c3a48-e29c-4118-ba80-a6f9e202bb87 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:27 devstack sudo[104599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533.a36c3a48-e29c-4118-ba80-a6f9e202bb87 Jul 07 08:34:27 devstack sudo[104599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:28 devstack sudo[104599]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a8a867e0-3433-4b11-9be5-52d6f0e93c79 tempest-ProjectReaderTests-1685940573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533.a36c3a48-e29c-4118-ba80-a6f9e202bb87" returned: 0 in 0.626s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a8a867e0-3433-4b11-9be5-52d6f0e93c79 tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:28 devstack sudo[104602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533.info Jul 07 08:34:28 devstack sudo[104602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:28 devstack sudo[104602]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a8a867e0-3433-4b11-9be5-52d6f0e93c79 tempest-ProjectReaderTests-1685940573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533.info" returned: 0 in 0.643s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:28 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-a8a867e0-3433-4b11-9be5-52d6f0e93c79 tempest-ProjectReaderTests-1685940573 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533.info is being set with open permissions: ugo+rw Jul 07 08:34:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a8a867e0-3433-4b11-9be5-52d6f0e93c79 tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:28 devstack sudo[104605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533.info Jul 07 08:34:28 devstack sudo[104605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:29 devstack sudo[104605]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a8a867e0-3433-4b11-9be5-52d6f0e93c79 tempest-ProjectReaderTests-1685940573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533.info" returned: 0 in 0.636s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a8a867e0-3433-4b11-9be5-52d6f0e93c79 tempest-ProjectReaderTests-1685940573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.259s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:34:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-5a547ea5-73e7-45c6-9618-b513e4593a33 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.218s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:34:29 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-5a547ea5-73e7-45c6-9618-b513e4593a33 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:34:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1123820594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82f888df-81bf-46be-816b-5b0183a2f459,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7e36e4eba804b01be8104dce2bafd02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:34:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:34:18Z,use_quota=True,user_id='600b58c3d7e043e0a604a24338264757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:34:29 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-5a547ea5-73e7-45c6-9618-b513e4593a33 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Creating volume 82f888df-81bf-46be-816b-5b0183a2f459 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:34:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-5a547ea5-73e7-45c6-9618-b513e4593a33 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:34:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-5a547ea5-73e7-45c6-9618-b513e4593a33 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:34:29 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-5a547ea5-73e7-45c6-9618-b513e4593a33 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:34:29 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-5a547ea5-73e7-45c6-9618-b513e4593a33 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:34:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-5a547ea5-73e7-45c6-9618-b513e4593a33 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:34:29 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-5a547ea5-73e7-45c6-9618-b513e4593a33 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:34:29 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-5a547ea5-73e7-45c6-9618-b513e4593a33 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:34:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5a547ea5-73e7-45c6-9618-b513e4593a33 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-82f888df-81bf-46be-816b-5b0183a2f459 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:29 devstack sudo[104608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-82f888df-81bf-46be-816b-5b0183a2f459 1073741824 Jul 07 08:34:29 devstack sudo[104608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:29 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-a8a867e0-3433-4b11-9be5-52d6f0e93c79 tempest-ProjectReaderTests-1685940573 None] Create snapshot completed successfully Jul 07 08:34:30 devstack sudo[104608]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5a547ea5-73e7-45c6-9618-b513e4593a33 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-82f888df-81bf-46be-816b-5b0183a2f459 1073741824" returned: 0 in 0.825s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5a547ea5-73e7-45c6-9618-b513e4593a33 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-82f888df-81bf-46be-816b-5b0183a2f459 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:30 devstack sudo[104613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-82f888df-81bf-46be-816b-5b0183a2f459 Jul 07 08:34:30 devstack sudo[104613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:30 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-96dac8cf-65f9-4923-b930-36d0885b838a tempest-ProjectReaderTests-1685940573 None] Acquiring lock "cinder-a36c3a48-e29c-4118-ba80-a6f9e202bb87-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:34:30 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-96dac8cf-65f9-4923-b930-36d0885b838a tempest-ProjectReaderTests-1685940573 None] Lock "cinder-a36c3a48-e29c-4118-ba80-a6f9e202bb87-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:34:30 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-96dac8cf-65f9-4923-b930-36d0885b838a tempest-ProjectReaderTests-1685940573 None] Acquiring lock "cinder-quobyte-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:34:30 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-96dac8cf-65f9-4923-b930-36d0885b838a tempest-ProjectReaderTests-1685940573 None] Lock "cinder-quobyte-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:34:30 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-96dac8cf-65f9-4923-b930-36d0885b838a tempest-ProjectReaderTests-1685940573 None] Acquiring lock "cinder-quobyte-a36c3a48-e29c-4118-ba80-a6f9e202bb87" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:34:30 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-96dac8cf-65f9-4923-b930-36d0885b838a tempest-ProjectReaderTests-1685940573 None] Lock "cinder-quobyte-a36c3a48-e29c-4118-ba80-a6f9e202bb87" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:34:30 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-96dac8cf-65f9-4923-b930-36d0885b838a tempest-ProjectReaderTests-1685940573 None] Deleting offline snapshot a36c3a48-e29c-4118-ba80-a6f9e202bb87 of volume af4a7bf0-ca73-4ffb-b5b6-eea4cc685533 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:34:30 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-96dac8cf-65f9-4923-b930-36d0885b838a tempest-ProjectReaderTests-1685940573 None] snapshot_file for this snap is: volume-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533.a36c3a48-e29c-4118-ba80-a6f9e202bb87 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:34:30 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c5c566-fe9f-4d45-89e1-762fcab6e961]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:34:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-96dac8cf-65f9-4923-b930-36d0885b838a tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533.a36c3a48-e29c-4118-ba80-a6f9e202bb87 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:30 devstack sudo[104615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533.a36c3a48-e29c-4118-ba80-a6f9e202bb87 Jul 07 08:34:30 devstack sudo[104615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:31 devstack sudo[104613]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5a547ea5-73e7-45c6-9618-b513e4593a33 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-82f888df-81bf-46be-816b-5b0183a2f459" returned: 0 in 0.659s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:31 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-5a547ea5-73e7-45c6-9618-b513e4593a33 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] <== create_volume: return (1521ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:34:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-5a547ea5-73e7-45c6-9618-b513e4593a33 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:34:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-00aab952-5963-4fac-ad0c-c518ffd42927 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.412s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:34:31 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-00aab952-5963-4fac-ad0c-c518ffd42927 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:34:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-759542358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31998d80-bcf8-4e3f-838f-285fa4b7bd2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7e36e4eba804b01be8104dce2bafd02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:34:19Z,use_quota=True,user_id='600b58c3d7e043e0a604a24338264757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:34:31 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-00aab952-5963-4fac-ad0c-c518ffd42927 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Creating volume 31998d80-bcf8-4e3f-838f-285fa4b7bd2e {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:34:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-00aab952-5963-4fac-ad0c-c518ffd42927 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:34:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-00aab952-5963-4fac-ad0c-c518ffd42927 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:34:31 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-00aab952-5963-4fac-ad0c-c518ffd42927 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:34:31 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-00aab952-5963-4fac-ad0c-c518ffd42927 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:34:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-00aab952-5963-4fac-ad0c-c518ffd42927 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:34:31 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-00aab952-5963-4fac-ad0c-c518ffd42927 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:34:31 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-00aab952-5963-4fac-ad0c-c518ffd42927 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:34:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-00aab952-5963-4fac-ad0c-c518ffd42927 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-31998d80-bcf8-4e3f-838f-285fa4b7bd2e 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:31 devstack sudo[104618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-31998d80-bcf8-4e3f-838f-285fa4b7bd2e 1073741824 Jul 07 08:34:31 devstack sudo[104618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:31 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5a547ea5-73e7-45c6-9618-b513e4593a33 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2a44080-e70e-49dc-b94d-9e0741bf8eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82f888df-81bf-46be-816b-5b0183a2f459', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:31 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5a547ea5-73e7-45c6-9618-b513e4593a33 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e4e062f-7fdf-4059-9093-071f036a5bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:31 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-5a547ea5-73e7-45c6-9618-b513e4593a33 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Volume volume-82f888df-81bf-46be-816b-5b0183a2f459 (82f888df-81bf-46be-816b-5b0183a2f459): created successfully Jul 07 08:34:31 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5a547ea5-73e7-45c6-9618-b513e4593a33 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e4e062f-7fdf-4059-9093-071f036a5bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:31 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-5a547ea5-73e7-45c6-9618-b513e4593a33 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Flow 'volume_create_manager' (22a29b02-5aba-4a00-bacf-a5fe216f64d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:34:31 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-5a547ea5-73e7-45c6-9618-b513e4593a33 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Created volume successfully. Jul 07 08:34:31 devstack sudo[104615]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-96dac8cf-65f9-4923-b930-36d0885b838a tempest-ProjectReaderTests-1685940573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533.a36c3a48-e29c-4118-ba80-a6f9e202bb87" returned: 0 in 0.776s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:31 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-96dac8cf-65f9-4923-b930-36d0885b838a tempest-ProjectReaderTests-1685940573 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:34:31 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[408716d7-a1f3-4131-afb3-0a9154982345]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:34:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-96dac8cf-65f9-4923-b930-36d0885b838a tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:31 devstack sudo[104624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533 Jul 07 08:34:31 devstack sudo[104624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:32 devstack sudo[104618]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-00aab952-5963-4fac-ad0c-c518ffd42927 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-31998d80-bcf8-4e3f-838f-285fa4b7bd2e 1073741824" returned: 0 in 0.916s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-00aab952-5963-4fac-ad0c-c518ffd42927 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-31998d80-bcf8-4e3f-838f-285fa4b7bd2e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:32 devstack sudo[104629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-31998d80-bcf8-4e3f-838f-285fa4b7bd2e Jul 07 08:34:32 devstack sudo[104629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:32 devstack sudo[104624]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-96dac8cf-65f9-4923-b930-36d0885b838a tempest-ProjectReaderTests-1685940573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533" returned: 0 in 0.830s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-96dac8cf-65f9-4923-b930-36d0885b838a tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533.a36c3a48-e29c-4118-ba80-a6f9e202bb87 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:32 devstack sudo[104634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533.a36c3a48-e29c-4118-ba80-a6f9e202bb87 Jul 07 08:34:32 devstack sudo[104634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:32 devstack sudo[104629]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-00aab952-5963-4fac-ad0c-c518ffd42927 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-31998d80-bcf8-4e3f-838f-285fa4b7bd2e" returned: 0 in 0.631s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:32 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-00aab952-5963-4fac-ad0c-c518ffd42927 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] <== create_volume: return (1590ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:34:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-00aab952-5963-4fac-ad0c-c518ffd42927 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.593s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:34:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8efb428c-6193-4dc7-93b5-bfc02592dc44 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.641s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:34:32 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8efb428c-6193-4dc7-93b5-bfc02592dc44 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1329832241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1901880d-27c1-4749-9c28-6f5d66f163bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7e36e4eba804b01be8104dce2bafd02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:34:19Z,use_quota=True,user_id='600b58c3d7e043e0a604a24338264757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:34:32 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-8efb428c-6193-4dc7-93b5-bfc02592dc44 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Creating volume 1901880d-27c1-4749-9c28-6f5d66f163bf {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:34:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8efb428c-6193-4dc7-93b5-bfc02592dc44 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:34:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8efb428c-6193-4dc7-93b5-bfc02592dc44 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:34:32 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8efb428c-6193-4dc7-93b5-bfc02592dc44 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:34:32 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8efb428c-6193-4dc7-93b5-bfc02592dc44 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:34:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8efb428c-6193-4dc7-93b5-bfc02592dc44 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:34:32 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8efb428c-6193-4dc7-93b5-bfc02592dc44 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:34:32 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-8efb428c-6193-4dc7-93b5-bfc02592dc44 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:34:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8efb428c-6193-4dc7-93b5-bfc02592dc44 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1901880d-27c1-4749-9c28-6f5d66f163bf 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:32 devstack sudo[104637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1901880d-27c1-4749-9c28-6f5d66f163bf 1073741824 Jul 07 08:34:32 devstack sudo[104637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-00aab952-5963-4fac-ad0c-c518ffd42927 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8316fc6-abce-4406-92ee-dc564aa9efd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31998d80-bcf8-4e3f-838f-285fa4b7bd2e', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-00aab952-5963-4fac-ad0c-c518ffd42927 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e21247ac-84e3-4f8f-b8fd-e38909e838ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:32 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-00aab952-5963-4fac-ad0c-c518ffd42927 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Volume volume-31998d80-bcf8-4e3f-838f-285fa4b7bd2e (31998d80-bcf8-4e3f-838f-285fa4b7bd2e): created successfully Jul 07 08:34:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-00aab952-5963-4fac-ad0c-c518ffd42927 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e21247ac-84e3-4f8f-b8fd-e38909e838ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-00aab952-5963-4fac-ad0c-c518ffd42927 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Flow 'volume_create_manager' (c0b6b0c3-2e88-46f8-a897-a65cf71f39a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:34:32 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-00aab952-5963-4fac-ad0c-c518ffd42927 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Created volume successfully. Jul 07 08:34:33 devstack sudo[104634]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-96dac8cf-65f9-4923-b930-36d0885b838a tempest-ProjectReaderTests-1685940573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533.a36c3a48-e29c-4118-ba80-a6f9e202bb87" returned: 0 in 0.794s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-96dac8cf-65f9-4923-b930-36d0885b838a tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533.a36c3a48-e29c-4118-ba80-a6f9e202bb87 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:33 devstack sudo[104642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533.a36c3a48-e29c-4118-ba80-a6f9e202bb87 Jul 07 08:34:33 devstack sudo[104642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:33 devstack sudo[104637]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8efb428c-6193-4dc7-93b5-bfc02592dc44 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1901880d-27c1-4749-9c28-6f5d66f163bf 1073741824" returned: 0 in 0.864s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8efb428c-6193-4dc7-93b5-bfc02592dc44 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1901880d-27c1-4749-9c28-6f5d66f163bf {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:33 devstack sudo[104647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1901880d-27c1-4749-9c28-6f5d66f163bf Jul 07 08:34:33 devstack sudo[104647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:33 devstack sudo[104642]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-96dac8cf-65f9-4923-b930-36d0885b838a tempest-ProjectReaderTests-1685940573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533.a36c3a48-e29c-4118-ba80-a6f9e202bb87" returned: 0 in 0.676s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:33 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-96dac8cf-65f9-4923-b930-36d0885b838a tempest-ProjectReaderTests-1685940573 None] Lock "cinder-quobyte-a36c3a48-e29c-4118-ba80-a6f9e202bb87" released by "_delete_snapshot" :: held 3.188s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:34:33 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-96dac8cf-65f9-4923-b930-36d0885b838a tempest-ProjectReaderTests-1685940573 None] Lock "cinder-quobyte-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533" released by "delete_snapshot" :: held 3.216s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:34:34 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-96dac8cf-65f9-4923-b930-36d0885b838a tempest-ProjectReaderTests-1685940573 None] Created reservations ['1f97377a-ecba-4d70-acd6-7e47098d69ef', '1f0ba8b2-cf49-40c3-9a7d-121bcbfd7bce', 'a3ea5d23-bb3e-4573-8fda-a3d544b282db', '504e6587-340a-438c-ba63-fbf1dd595d73'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:34:34 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-96dac8cf-65f9-4923-b930-36d0885b838a tempest-ProjectReaderTests-1685940573 None] Delete snapshot completed successfully. Jul 07 08:34:34 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-96dac8cf-65f9-4923-b930-36d0885b838a tempest-ProjectReaderTests-1685940573 None] Lock "cinder-a36c3a48-e29c-4118-ba80-a6f9e202bb87-delete_snapshot" released by "delete_snapshot" :: held 3.368s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:34:34 devstack sudo[104647]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8efb428c-6193-4dc7-93b5-bfc02592dc44 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1901880d-27c1-4749-9c28-6f5d66f163bf" returned: 0 in 0.666s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:34 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8efb428c-6193-4dc7-93b5-bfc02592dc44 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] <== create_volume: return (1582ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:34:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8efb428c-6193-4dc7-93b5-bfc02592dc44 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.586s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:34:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.197s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:34:34 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:34:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aea3cf1-6405-4571-80a1-9c2d40d4e491,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90a47e1d22a2469e9a475f9d37a49713',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:34:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:34:16Z,use_quota=True,user_id='0e3dc72115474b9990d1eaa72eb93cf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2b4eb7-a45b-4737-8249-0f6ae0de295d),volume_type_id=dc2b4eb7-a45b-4737-8249-0f6ae0de295d)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:34:34 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Creating volume 7aea3cf1-6405-4571-80a1-9c2d40d4e491 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:34:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:34:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:34:34 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:34:34 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:34:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:34:34 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:34:34 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:34:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7aea3cf1-6405-4571-80a1-9c2d40d4e491 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:34 devstack sudo[104651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7aea3cf1-6405-4571-80a1-9c2d40d4e491 1073741824 Jul 07 08:34:34 devstack sudo[104651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8efb428c-6193-4dc7-93b5-bfc02592dc44 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfaae813-57bc-450b-965f-8421d46e20fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1901880d-27c1-4749-9c28-6f5d66f163bf', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8efb428c-6193-4dc7-93b5-bfc02592dc44 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6580e15-84ab-4ccc-af64-e910b7537f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:34 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-8efb428c-6193-4dc7-93b5-bfc02592dc44 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Volume volume-1901880d-27c1-4749-9c28-6f5d66f163bf (1901880d-27c1-4749-9c28-6f5d66f163bf): created successfully Jul 07 08:34:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8efb428c-6193-4dc7-93b5-bfc02592dc44 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6580e15-84ab-4ccc-af64-e910b7537f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8efb428c-6193-4dc7-93b5-bfc02592dc44 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Flow 'volume_create_manager' (2362561d-de33-44f2-8d85-b95d37b3cde1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:34:34 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-8efb428c-6193-4dc7-93b5-bfc02592dc44 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Created volume successfully. Jul 07 08:34:34 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f9a13c78-17ee-45e8-a726-3cc6e2918b6b tempest-ProjectReaderTests-1685940573 None] Acquiring lock "cinder-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:34:34 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f9a13c78-17ee-45e8-a726-3cc6e2918b6b tempest-ProjectReaderTests-1685940573 None] Lock "cinder-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:34:34 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f9a13c78-17ee-45e8-a726-3cc6e2918b6b tempest-ProjectReaderTests-1685940573 None] Acquiring lock "cinder-quobyte-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:34:35 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f9a13c78-17ee-45e8-a726-3cc6e2918b6b tempest-ProjectReaderTests-1685940573 None] Lock "cinder-quobyte-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533" acquired by "delete_volume" :: waited 0.016s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:34:35 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6074afa-8a31-4077-bac0-7f75d46f4b76]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:34:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f9a13c78-17ee-45e8-a726-3cc6e2918b6b tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:35 devstack sudo[104656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533 Jul 07 08:34:35 devstack sudo[104656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:35 devstack sudo[104651]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7aea3cf1-6405-4571-80a1-9c2d40d4e491 1073741824" returned: 0 in 0.903s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:35 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5fe9d48b-796a-45be-8c6b-1b708f86e353 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Acquiring lock "cinder-1901880d-27c1-4749-9c28-6f5d66f163bf-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:34:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7aea3cf1-6405-4571-80a1-9c2d40d4e491 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:35 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5fe9d48b-796a-45be-8c6b-1b708f86e353 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Lock "cinder-1901880d-27c1-4749-9c28-6f5d66f163bf-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:34:35 devstack sudo[104658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7aea3cf1-6405-4571-80a1-9c2d40d4e491 Jul 07 08:34:35 devstack sudo[104658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:35 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5fe9d48b-796a-45be-8c6b-1b708f86e353 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Acquiring lock "cinder-quobyte-1901880d-27c1-4749-9c28-6f5d66f163bf" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:34:35 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5fe9d48b-796a-45be-8c6b-1b708f86e353 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Lock "cinder-quobyte-1901880d-27c1-4749-9c28-6f5d66f163bf" acquired by "delete_volume" :: waited 0.016s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:34:35 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[0083269d-ecaf-4707-b22a-49f73d991cf1]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:34:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5fe9d48b-796a-45be-8c6b-1b708f86e353 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1901880d-27c1-4749-9c28-6f5d66f163bf {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:35 devstack sudo[104660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1901880d-27c1-4749-9c28-6f5d66f163bf Jul 07 08:34:35 devstack sudo[104660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:35 devstack sudo[104656]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f9a13c78-17ee-45e8-a726-3cc6e2918b6b tempest-ProjectReaderTests-1685940573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533" returned: 0 in 0.789s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f9a13c78-17ee-45e8-a726-3cc6e2918b6b tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:35 devstack sudo[104666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533 Jul 07 08:34:35 devstack sudo[104666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:36 devstack sudo[104658]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7aea3cf1-6405-4571-80a1-9c2d40d4e491" returned: 0 in 0.722s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] <== create_volume: return (1693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:34:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.696s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:34:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-803b256b-f1fa-4574-a0c6-8ae28052894d tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.505s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:34:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-803b256b-f1fa-4574-a0c6-8ae28052894d tempest-CreateVolumesFromSnapshotTest-1959601045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:34:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-781016932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c42a951-01db-4eda-ae89-ff532feebcd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='314dd98dd2ef4ddbb08dcd63398f6370',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:34:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:34:23Z,use_quota=True,user_id='286198b13787439e946961c654750a36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:34:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-803b256b-f1fa-4574-a0c6-8ae28052894d tempest-CreateVolumesFromSnapshotTest-1959601045 None] Creating volume 8c42a951-01db-4eda-ae89-ff532feebcd9 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:34:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-803b256b-f1fa-4574-a0c6-8ae28052894d tempest-CreateVolumesFromSnapshotTest-1959601045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:34:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-803b256b-f1fa-4574-a0c6-8ae28052894d tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:34:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-803b256b-f1fa-4574-a0c6-8ae28052894d tempest-CreateVolumesFromSnapshotTest-1959601045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:34:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-803b256b-f1fa-4574-a0c6-8ae28052894d tempest-CreateVolumesFromSnapshotTest-1959601045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:34:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-803b256b-f1fa-4574-a0c6-8ae28052894d tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:34:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-803b256b-f1fa-4574-a0c6-8ae28052894d tempest-CreateVolumesFromSnapshotTest-1959601045 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:34:36 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-803b256b-f1fa-4574-a0c6-8ae28052894d tempest-CreateVolumesFromSnapshotTest-1959601045 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:34:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-803b256b-f1fa-4574-a0c6-8ae28052894d tempest-CreateVolumesFromSnapshotTest-1959601045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8c42a951-01db-4eda-ae89-ff532feebcd9 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:36 devstack sudo[104669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8c42a951-01db-4eda-ae89-ff532feebcd9 1073741824 Jul 07 08:34:36 devstack sudo[104669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:36 devstack cinder-volume[87199]: DEBUG cinder.volume.volume_utils [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Attempting download of bebe7804-1e87-4c9c-8e59-9163f794b649 ((None, [{'url': 'file:///opt/stack/data/glance/images/bebe7804-1e87-4c9c-8e59-9163f794b649', 'metadata': {}}])) to volume 7aea3cf1-6405-4571-80a1-9c2d40d4e491. {{(pid=87199) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 08:34:36 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd94a6ca-4a22-407a-b9a4-5e7195da7055]: (4, 'raw') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:34:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bebe7804-1e87-4c9c-8e59-9163f794b649_qvabwot4 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:36 devstack sudo[104660]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5fe9d48b-796a-45be-8c6b-1b708f86e353 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1901880d-27c1-4749-9c28-6f5d66f163bf" returned: 0 in 0.862s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5fe9d48b-796a-45be-8c6b-1b708f86e353 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1901880d-27c1-4749-9c28-6f5d66f163bf {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:36 devstack sudo[104709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1901880d-27c1-4749-9c28-6f5d66f163bf Jul 07 08:34:36 devstack sudo[104709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:36 devstack sudo[104708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bebe7804-1e87-4c9c-8e59-9163f794b649_qvabwot4 Jul 07 08:34:36 devstack sudo[104708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:36 devstack sudo[104666]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f9a13c78-17ee-45e8-a726-3cc6e2918b6b tempest-ProjectReaderTests-1685940573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533" returned: 0 in 0.913s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:36 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f9a13c78-17ee-45e8-a726-3cc6e2918b6b tempest-ProjectReaderTests-1685940573 None] Lock "cinder-quobyte-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533" released by "delete_volume" :: held 1.781s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:34:36 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-f9a13c78-17ee-45e8-a726-3cc6e2918b6b tempest-ProjectReaderTests-1685940573 None] Created reservations ['a99924cd-2d2f-45cc-8b51-25cb03967a23', '8f773889-5786-4d48-9365-b8261c51f278', '2dc05eec-7c2d-4a5d-83d4-a7d57203c657', 'd4e94afa-2814-40f8-8d9e-453189c459d8'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:34:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f9a13c78-17ee-45e8-a726-3cc6e2918b6b tempest-ProjectReaderTests-1685940573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:34:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f9a13c78-17ee-45e8-a726-3cc6e2918b6b tempest-ProjectReaderTests-1685940573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:34:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f9a13c78-17ee-45e8-a726-3cc6e2918b6b tempest-ProjectReaderTests-1685940573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:34:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f9a13c78-17ee-45e8-a726-3cc6e2918b6b tempest-ProjectReaderTests-1685940573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:34:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f9a13c78-17ee-45e8-a726-3cc6e2918b6b tempest-ProjectReaderTests-1685940573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:34:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f9a13c78-17ee-45e8-a726-3cc6e2918b6b tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:37 devstack sudo[104718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:34:37 devstack sudo[104718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:37 devstack sudo[104708]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bebe7804-1e87-4c9c-8e59-9163f794b649_qvabwot4" returned: 0 in 0.940s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bebe7804-1e87-4c9c-8e59-9163f794b649_qvabwot4 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:37 devstack sudo[104669]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-803b256b-f1fa-4574-a0c6-8ae28052894d tempest-CreateVolumesFromSnapshotTest-1959601045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8c42a951-01db-4eda-ae89-ff532feebcd9 1073741824" returned: 0 in 1.229s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:37 devstack sudo[104709]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5fe9d48b-796a-45be-8c6b-1b708f86e353 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1901880d-27c1-4749-9c28-6f5d66f163bf" returned: 0 in 0.968s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:37 devstack sudo[104724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bebe7804-1e87-4c9c-8e59-9163f794b649_qvabwot4 Jul 07 08:34:37 devstack sudo[104724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:37 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5fe9d48b-796a-45be-8c6b-1b708f86e353 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Lock "cinder-quobyte-1901880d-27c1-4749-9c28-6f5d66f163bf" released by "delete_volume" :: held 1.894s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:34:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-803b256b-f1fa-4574-a0c6-8ae28052894d tempest-CreateVolumesFromSnapshotTest-1959601045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8c42a951-01db-4eda-ae89-ff532feebcd9 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:37 devstack sudo[104726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8c42a951-01db-4eda-ae89-ff532feebcd9 Jul 07 08:34:37 devstack sudo[104726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:37 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-5fe9d48b-796a-45be-8c6b-1b708f86e353 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Created reservations ['531a1a67-25e5-4fc8-8c41-3fdbcea5ddbe', 'c0cf15a2-42f8-49b4-a810-bdce1aba3662', 'b98e72ad-74d1-43d4-998d-a3af3a6121a9', '228e33b6-790a-4fb4-8e9e-7dfb0fe54cb3'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:34:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-5fe9d48b-796a-45be-8c6b-1b708f86e353 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:34:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-5fe9d48b-796a-45be-8c6b-1b708f86e353 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:34:37 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-5fe9d48b-796a-45be-8c6b-1b708f86e353 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:34:37 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-5fe9d48b-796a-45be-8c6b-1b708f86e353 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:34:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-5fe9d48b-796a-45be-8c6b-1b708f86e353 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:34:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5fe9d48b-796a-45be-8c6b-1b708f86e353 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:37 devstack sudo[104728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:34:37 devstack sudo[104728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:37 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ee60f149-ff9f-4770-8cb3-ef2fc2f286b8 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Acquiring lock "cinder-31998d80-bcf8-4e3f-838f-285fa4b7bd2e-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:34:37 devstack sudo[104718]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f9a13c78-17ee-45e8-a726-3cc6e2918b6b tempest-ProjectReaderTests-1685940573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.801s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:37 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-f9a13c78-17ee-45e8-a726-3cc6e2918b6b tempest-ProjectReaderTests-1685940573 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:34:37 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ee60f149-ff9f-4770-8cb3-ef2fc2f286b8 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Lock "cinder-31998d80-bcf8-4e3f-838f-285fa4b7bd2e-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:34:37 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-f9a13c78-17ee-45e8-a726-3cc6e2918b6b tempest-ProjectReaderTests-1685940573 None] Deleted volume successfully. Jul 07 08:34:37 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f9a13c78-17ee-45e8-a726-3cc6e2918b6b tempest-ProjectReaderTests-1685940573 None] Lock "cinder-af4a7bf0-ca73-4ffb-b5b6-eea4cc685533-delete_volume" released by "delete_volume" :: held 2.898s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:34:37 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ee60f149-ff9f-4770-8cb3-ef2fc2f286b8 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Acquiring lock "cinder-quobyte-31998d80-bcf8-4e3f-838f-285fa4b7bd2e" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:34:37 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ee60f149-ff9f-4770-8cb3-ef2fc2f286b8 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Lock "cinder-quobyte-31998d80-bcf8-4e3f-838f-285fa4b7bd2e" acquired by "delete_volume" :: waited 0.026s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:34:37 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[de295cb2-9d89-4933-bada-add4d755f3e3]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:34:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ee60f149-ff9f-4770-8cb3-ef2fc2f286b8 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-31998d80-bcf8-4e3f-838f-285fa4b7bd2e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:38 devstack sudo[104731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-31998d80-bcf8-4e3f-838f-285fa4b7bd2e Jul 07 08:34:38 devstack sudo[104731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:38 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-73eca965-838d-4915-89c4-19c146199d4d tempest-ProjectReaderTests-1685940573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:34:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-73eca965-838d-4915-89c4-19c146199d4d tempest-ProjectReaderTests-1685940573 None] Flow 'volume_create_manager' (f31b42c5-b420-4b1c-8b75-f488ec31052e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:34:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-73eca965-838d-4915-89c4-19c146199d4d tempest-ProjectReaderTests-1685940573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74b560b3-d79b-460b-8cd6-f49aebaecd47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-73eca965-838d-4915-89c4-19c146199d4d tempest-ProjectReaderTests-1685940573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74b560b3-d79b-460b-8cd6-f49aebaecd47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1676099106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db1a3896-d60b-4728-ba95-816b310276b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06330941a308447a9ec29b93464314b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:34:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:34:38Z,use_quota=True,user_id='7e7152ed33e44a5a937717a4c518b2d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-73eca965-838d-4915-89c4-19c146199d4d tempest-ProjectReaderTests-1685940573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec7d311c-a920-42d8-a44e-25ecf9331d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-73eca965-838d-4915-89c4-19c146199d4d tempest-ProjectReaderTests-1685940573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec7d311c-a920-42d8-a44e-25ecf9331d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-73eca965-838d-4915-89c4-19c146199d4d tempest-ProjectReaderTests-1685940573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7965b2c0-b388-4e47-a691-b6cfb0331d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-73eca965-838d-4915-89c4-19c146199d4d tempest-ProjectReaderTests-1685940573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7965b2c0-b388-4e47-a691-b6cfb0331d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db1a3896-d60b-4728-ba95-816b310276b0', 'volume_name': 'volume-db1a3896-d60b-4728-ba95-816b310276b0', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-73eca965-838d-4915-89c4-19c146199d4d tempest-ProjectReaderTests-1685940573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2214b31e-00bf-4c42-a332-301abcd256ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-73eca965-838d-4915-89c4-19c146199d4d tempest-ProjectReaderTests-1685940573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2214b31e-00bf-4c42-a332-301abcd256ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-73eca965-838d-4915-89c4-19c146199d4d tempest-ProjectReaderTests-1685940573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1accbcf-0722-40a9-b703-cd9cc5405bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:38 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-73eca965-838d-4915-89c4-19c146199d4d tempest-ProjectReaderTests-1685940573 None] Volume db1a3896-d60b-4728-ba95-816b310276b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db1a3896-d60b-4728-ba95-816b310276b0', 'volume_size': 1} Jul 07 08:34:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-73eca965-838d-4915-89c4-19c146199d4d tempest-ProjectReaderTests-1685940573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:34:38 devstack sudo[104724]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bebe7804-1e87-4c9c-8e59-9163f794b649_qvabwot4" returned: 1 in 1.367s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bebe7804-1e87-4c9c-8e59-9163f794b649_qvabwot4' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:34:38 devstack sudo[104726]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:38 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c551b20-8efe-49b0-a1bf-faf02f9638f5]: (4, 'raw') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:34:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bebe7804-1e87-4c9c-8e59-9163f794b649_go1rg9y7devstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-803b256b-f1fa-4574-a0c6-8ae28052894d tempest-CreateVolumesFromSnapshotTest-1959601045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8c42a951-01db-4eda-ae89-ff532feebcd9" returned: 0 in 1.205s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:38 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-803b256b-f1fa-4574-a0c6-8ae28052894d tempest-CreateVolumesFromSnapshotTest-1959601045 None] <== create_volume: return (2539ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:34:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-803b256b-f1fa-4574-a0c6-8ae28052894d tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.542s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:34:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-fea40dce-0051-4247-9212-e29df37939f4 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.686s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:34:38 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-fea40dce-0051-4247-9212-e29df37939f4 tempest-CreateVolumesFromSnapshotTest-1959601045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:34:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1203063533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4001870-4716-4aaf-a040-6474e605031b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='314dd98dd2ef4ddbb08dcd63398f6370',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:34:24Z,use_quota=True,user_id='286198b13787439e946961c654750a36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:34:38 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-fea40dce-0051-4247-9212-e29df37939f4 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Creating volume c4001870-4716-4aaf-a040-6474e605031b {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:34:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-fea40dce-0051-4247-9212-e29df37939f4 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:34:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-fea40dce-0051-4247-9212-e29df37939f4 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:34:38 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-fea40dce-0051-4247-9212-e29df37939f4 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:34:38 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-fea40dce-0051-4247-9212-e29df37939f4 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:34:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-fea40dce-0051-4247-9212-e29df37939f4 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:34:38 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-fea40dce-0051-4247-9212-e29df37939f4 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:34:38 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-fea40dce-0051-4247-9212-e29df37939f4 tempest-CreateVolumesFromSnapshotTest-1959601045 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:34:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fea40dce-0051-4247-9212-e29df37939f4 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c4001870-4716-4aaf-a040-6474e605031b 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-803b256b-f1fa-4574-a0c6-8ae28052894d tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49c83a9c-fc06-4c1a-a67d-33522217df0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c42a951-01db-4eda-ae89-ff532feebcd9', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:38 devstack sudo[104739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c4001870-4716-4aaf-a040-6474e605031b 1073741824 Jul 07 08:34:38 devstack sudo[104739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-803b256b-f1fa-4574-a0c6-8ae28052894d tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6803024-1191-468c-8ccc-d3a02659485c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:38 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-803b256b-f1fa-4574-a0c6-8ae28052894d tempest-CreateVolumesFromSnapshotTest-1959601045 None] Volume volume-8c42a951-01db-4eda-ae89-ff532feebcd9 (8c42a951-01db-4eda-ae89-ff532feebcd9): created successfully Jul 07 08:34:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-803b256b-f1fa-4574-a0c6-8ae28052894d tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6803024-1191-468c-8ccc-d3a02659485c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-803b256b-f1fa-4574-a0c6-8ae28052894d tempest-CreateVolumesFromSnapshotTest-1959601045 None] Flow 'volume_create_manager' (8aa3b4b8-3993-48b7-8b6d-347f7c100d8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:34:38 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-803b256b-f1fa-4574-a0c6-8ae28052894d tempest-CreateVolumesFromSnapshotTest-1959601045 None] Created volume successfully. Jul 07 08:34:38 devstack sudo[104737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bebe7804-1e87-4c9c-8e59-9163f794b649_go1rg9y7devstack@QuobyteHD Jul 07 08:34:38 devstack sudo[104737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:38 devstack sudo[104728]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5fe9d48b-796a-45be-8c6b-1b708f86e353 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 1.200s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:38 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-5fe9d48b-796a-45be-8c6b-1b708f86e353 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:34:38 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-5fe9d48b-796a-45be-8c6b-1b708f86e353 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Deleted volume successfully. Jul 07 08:34:38 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5fe9d48b-796a-45be-8c6b-1b708f86e353 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Lock "cinder-1901880d-27c1-4749-9c28-6f5d66f163bf-delete_volume" released by "delete_volume" :: held 3.510s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:34:39 devstack sudo[104731]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ee60f149-ff9f-4770-8cb3-ef2fc2f286b8 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-31998d80-bcf8-4e3f-838f-285fa4b7bd2e" returned: 0 in 1.076s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ee60f149-ff9f-4770-8cb3-ef2fc2f286b8 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-31998d80-bcf8-4e3f-838f-285fa4b7bd2e {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:39 devstack sudo[104745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-31998d80-bcf8-4e3f-838f-285fa4b7bd2e Jul 07 08:34:39 devstack sudo[104745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:39 devstack sudo[104737]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bebe7804-1e87-4c9c-8e59-9163f794b649_go1rg9y7devstack@QuobyteHD" returned: 0 in 0.864s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bebe7804-1e87-4c9c-8e59-9163f794b649_go1rg9y7devstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:39 devstack sudo[104752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bebe7804-1e87-4c9c-8e59-9163f794b649_go1rg9y7devstack@QuobyteHD Jul 07 08:34:39 devstack sudo[104752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:39 devstack sudo[104739]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fea40dce-0051-4247-9212-e29df37939f4 tempest-CreateVolumesFromSnapshotTest-1959601045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c4001870-4716-4aaf-a040-6474e605031b 1073741824" returned: 0 in 1.013s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fea40dce-0051-4247-9212-e29df37939f4 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c4001870-4716-4aaf-a040-6474e605031b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:39 devstack sudo[104754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c4001870-4716-4aaf-a040-6474e605031b Jul 07 08:34:39 devstack sudo[104754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:39 devstack sudo[104745]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ee60f149-ff9f-4770-8cb3-ef2fc2f286b8 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-31998d80-bcf8-4e3f-838f-285fa4b7bd2e" returned: 0 in 0.785s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:39 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ee60f149-ff9f-4770-8cb3-ef2fc2f286b8 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Lock "cinder-quobyte-31998d80-bcf8-4e3f-838f-285fa4b7bd2e" released by "delete_volume" :: held 1.918s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:34:39 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-ee60f149-ff9f-4770-8cb3-ef2fc2f286b8 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Created reservations ['d7131d5e-a42d-4c2f-991a-daf709426227', '05eae49e-fb6d-4ef8-a816-3ac6f96d97b2', '6a5e07db-a1e7-499b-ac97-fd438f7bc025', 'fb723043-fd0a-4373-915b-d1af1d45d485'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:34:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ee60f149-ff9f-4770-8cb3-ef2fc2f286b8 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:34:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ee60f149-ff9f-4770-8cb3-ef2fc2f286b8 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:34:39 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ee60f149-ff9f-4770-8cb3-ef2fc2f286b8 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:34:39 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ee60f149-ff9f-4770-8cb3-ef2fc2f286b8 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:34:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ee60f149-ff9f-4770-8cb3-ef2fc2f286b8 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:34:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ee60f149-ff9f-4770-8cb3-ef2fc2f286b8 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:40 devstack sudo[104757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:34:40 devstack sudo[104757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-81e31e49-27e0-4a38-9fcc-d91c57b66f40 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Acquiring lock "cinder-82f888df-81bf-46be-816b-5b0183a2f459-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:34:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-81e31e49-27e0-4a38-9fcc-d91c57b66f40 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Lock "cinder-82f888df-81bf-46be-816b-5b0183a2f459-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:34:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-81e31e49-27e0-4a38-9fcc-d91c57b66f40 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Acquiring lock "cinder-quobyte-82f888df-81bf-46be-816b-5b0183a2f459" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:34:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-81e31e49-27e0-4a38-9fcc-d91c57b66f40 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Lock "cinder-quobyte-82f888df-81bf-46be-816b-5b0183a2f459" acquired by "delete_volume" :: waited 0.018s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:34:40 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd813f9a-7604-483e-ba15-81b21e0c0919]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:34:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-81e31e49-27e0-4a38-9fcc-d91c57b66f40 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-82f888df-81bf-46be-816b-5b0183a2f459 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:40 devstack sudo[104752]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bebe7804-1e87-4c9c-8e59-9163f794b649_go1rg9y7devstack@QuobyteHD" returned: 1 in 0.799s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bebe7804-1e87-4c9c-8e59-9163f794b649_go1rg9y7devstack@QuobyteHD' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:34:40 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] bebe7804-1e87-4c9c-8e59-9163f794b649 was raw, converting to raw {{(pid=87199) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 08:34:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_bebe7804-1e87-4c9c-8e59-9163f794b649_go1rg9y7devstack@QuobyteHD /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7aea3cf1-6405-4571-80a1-9c2d40d4e491 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:40 devstack sudo[104763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_bebe7804-1e87-4c9c-8e59-9163f794b649_go1rg9y7devstack@QuobyteHD /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7aea3cf1-6405-4571-80a1-9c2d40d4e491 Jul 07 08:34:40 devstack sudo[104763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:40 devstack sudo[104762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-82f888df-81bf-46be-816b-5b0183a2f459 Jul 07 08:34:40 devstack sudo[104762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:40 devstack sudo[104754]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-fea40dce-0051-4247-9212-e29df37939f4 tempest-CreateVolumesFromSnapshotTest-1959601045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c4001870-4716-4aaf-a040-6474e605031b" returned: 0 in 0.814s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:40 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-fea40dce-0051-4247-9212-e29df37939f4 tempest-CreateVolumesFromSnapshotTest-1959601045 None] <== create_volume: return (1882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:34:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-fea40dce-0051-4247-9212-e29df37939f4 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.886s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:34:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f3e317d4-27c3-4896-989e-23cc80e25bbb tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.242s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:34:40 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f3e317d4-27c3-4896-989e-23cc80e25bbb tempest-CreateVolumesFromSnapshotTest-1959601045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-570087524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3dd316e-9ee4-4cfc-9e93-5450af047a63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='314dd98dd2ef4ddbb08dcd63398f6370',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:34:24Z,use_quota=True,user_id='286198b13787439e946961c654750a36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:34:40 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-f3e317d4-27c3-4896-989e-23cc80e25bbb tempest-CreateVolumesFromSnapshotTest-1959601045 None] Creating volume d3dd316e-9ee4-4cfc-9e93-5450af047a63 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:34:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f3e317d4-27c3-4896-989e-23cc80e25bbb tempest-CreateVolumesFromSnapshotTest-1959601045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:34:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f3e317d4-27c3-4896-989e-23cc80e25bbb tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:34:40 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f3e317d4-27c3-4896-989e-23cc80e25bbb tempest-CreateVolumesFromSnapshotTest-1959601045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:34:40 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f3e317d4-27c3-4896-989e-23cc80e25bbb tempest-CreateVolumesFromSnapshotTest-1959601045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:34:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f3e317d4-27c3-4896-989e-23cc80e25bbb tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:34:40 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f3e317d4-27c3-4896-989e-23cc80e25bbb tempest-CreateVolumesFromSnapshotTest-1959601045 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:34:40 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-f3e317d4-27c3-4896-989e-23cc80e25bbb tempest-CreateVolumesFromSnapshotTest-1959601045 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:34:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f3e317d4-27c3-4896-989e-23cc80e25bbb tempest-CreateVolumesFromSnapshotTest-1959601045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d3dd316e-9ee4-4cfc-9e93-5450af047a63 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-fea40dce-0051-4247-9212-e29df37939f4 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8d0f435-aea3-4761-8408-cfdf7d7d3f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4001870-4716-4aaf-a040-6474e605031b', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:40 devstack sudo[104767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d3dd316e-9ee4-4cfc-9e93-5450af047a63 1073741824 Jul 07 08:34:40 devstack sudo[104767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-fea40dce-0051-4247-9212-e29df37939f4 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf7b5165-26b8-451f-b04e-8ba6e1daddb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:40 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-fea40dce-0051-4247-9212-e29df37939f4 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Volume volume-c4001870-4716-4aaf-a040-6474e605031b (c4001870-4716-4aaf-a040-6474e605031b): created successfully Jul 07 08:34:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-fea40dce-0051-4247-9212-e29df37939f4 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf7b5165-26b8-451f-b04e-8ba6e1daddb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-fea40dce-0051-4247-9212-e29df37939f4 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Flow 'volume_create_manager' (1f0beff8-a4a6-48ff-b2b0-5e4303582b8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:34:40 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-fea40dce-0051-4247-9212-e29df37939f4 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Created volume successfully. Jul 07 08:34:40 devstack sudo[104757]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ee60f149-ff9f-4770-8cb3-ef2fc2f286b8 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.833s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:40 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ee60f149-ff9f-4770-8cb3-ef2fc2f286b8 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:34:40 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-ee60f149-ff9f-4770-8cb3-ef2fc2f286b8 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Deleted volume successfully. Jul 07 08:34:40 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ee60f149-ff9f-4770-8cb3-ef2fc2f286b8 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Lock "cinder-31998d80-bcf8-4e3f-838f-285fa4b7bd2e-delete_volume" released by "delete_volume" :: held 3.056s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:34:41 devstack sudo[104763]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_bebe7804-1e87-4c9c-8e59-9163f794b649_go1rg9y7devstack@QuobyteHD /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7aea3cf1-6405-4571-80a1-9c2d40d4e491" returned: 0 in 0.884s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:41 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bebe7804-1e87-4c9c-8e59-9163f794b649_go1rg9y7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7aea3cf1-6405-4571-80a1-9c2d40d4e491 {{(pid=87199) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 08:34:41 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Converted 0.00 MB image at 0.00 MB/s Jul 07 08:34:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7aea3cf1-6405-4571-80a1-9c2d40d4e491 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:41 devstack sudo[104762]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-81e31e49-27e0-4a38-9fcc-d91c57b66f40 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-82f888df-81bf-46be-816b-5b0183a2f459" returned: 0 in 0.950s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-81e31e49-27e0-4a38-9fcc-d91c57b66f40 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-82f888df-81bf-46be-816b-5b0183a2f459 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:41 devstack sudo[104778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7aea3cf1-6405-4571-80a1-9c2d40d4e491 1G Jul 07 08:34:41 devstack sudo[104778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:41 devstack sudo[104779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-82f888df-81bf-46be-816b-5b0183a2f459 Jul 07 08:34:41 devstack sudo[104779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:41 devstack sudo[104767]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f3e317d4-27c3-4896-989e-23cc80e25bbb tempest-CreateVolumesFromSnapshotTest-1959601045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d3dd316e-9ee4-4cfc-9e93-5450af047a63 1073741824" returned: 0 in 0.999s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f3e317d4-27c3-4896-989e-23cc80e25bbb tempest-CreateVolumesFromSnapshotTest-1959601045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d3dd316e-9ee4-4cfc-9e93-5450af047a63 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:41 devstack sudo[104784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d3dd316e-9ee4-4cfc-9e93-5450af047a63 Jul 07 08:34:41 devstack sudo[104784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:41 devstack sudo[104778]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7aea3cf1-6405-4571-80a1-9c2d40d4e491 1G" returned: 0 in 0.735s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:41 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bea1f8e-829c-43b5-a8c5-2ee3fa9204be]: (4, 'raw') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:34:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7aea3cf1-6405-4571-80a1-9c2d40d4e491 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:41 devstack sudo[104779]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-81e31e49-27e0-4a38-9fcc-d91c57b66f40 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-82f888df-81bf-46be-816b-5b0183a2f459" returned: 0 in 0.770s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:41 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-81e31e49-27e0-4a38-9fcc-d91c57b66f40 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Lock "cinder-quobyte-82f888df-81bf-46be-816b-5b0183a2f459" released by "delete_volume" :: held 1.776s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:34:41 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-81e31e49-27e0-4a38-9fcc-d91c57b66f40 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Created reservations ['34be6e38-0d9c-48ba-848a-f27ebd197d1a', '4e388b0b-a954-45ee-8adc-62ebdfe5586d', '3e510470-8564-4080-a368-f1db08d5deaa', 'aa2aa6ef-04e8-43e1-9b70-0beb11ab54f5'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:34:42 devstack sudo[104790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7aea3cf1-6405-4571-80a1-9c2d40d4e491 Jul 07 08:34:42 devstack sudo[104790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-81e31e49-27e0-4a38-9fcc-d91c57b66f40 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:34:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-81e31e49-27e0-4a38-9fcc-d91c57b66f40 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:34:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-81e31e49-27e0-4a38-9fcc-d91c57b66f40 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:34:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-81e31e49-27e0-4a38-9fcc-d91c57b66f40 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:34:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-81e31e49-27e0-4a38-9fcc-d91c57b66f40 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:34:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-81e31e49-27e0-4a38-9fcc-d91c57b66f40 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:42 devstack sudo[104792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:34:42 devstack sudo[104792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:42 devstack sudo[104784]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f3e317d4-27c3-4896-989e-23cc80e25bbb tempest-CreateVolumesFromSnapshotTest-1959601045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d3dd316e-9ee4-4cfc-9e93-5450af047a63" returned: 0 in 0.730s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f3e317d4-27c3-4896-989e-23cc80e25bbb tempest-CreateVolumesFromSnapshotTest-1959601045 None] <== create_volume: return (1792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:34:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f3e317d4-27c3-4896-989e-23cc80e25bbb tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.795s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:34:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-60d0c4bc-d22d-42a1-b1c2-baffaa440d58 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.616s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:34:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-60d0c4bc-d22d-42a1-b1c2-baffaa440d58 tempest-CreateVolumesFromSnapshotTest-1959601045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-992195649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba1e4c87-c34c-4043-8fc6-d78ac4670e19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='314dd98dd2ef4ddbb08dcd63398f6370',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:34:24Z,use_quota=True,user_id='286198b13787439e946961c654750a36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:34:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-60d0c4bc-d22d-42a1-b1c2-baffaa440d58 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Creating volume ba1e4c87-c34c-4043-8fc6-d78ac4670e19 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:34:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-60d0c4bc-d22d-42a1-b1c2-baffaa440d58 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:34:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-60d0c4bc-d22d-42a1-b1c2-baffaa440d58 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:34:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-60d0c4bc-d22d-42a1-b1c2-baffaa440d58 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:34:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-60d0c4bc-d22d-42a1-b1c2-baffaa440d58 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:34:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-60d0c4bc-d22d-42a1-b1c2-baffaa440d58 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:34:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-60d0c4bc-d22d-42a1-b1c2-baffaa440d58 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:34:42 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-60d0c4bc-d22d-42a1-b1c2-baffaa440d58 tempest-CreateVolumesFromSnapshotTest-1959601045 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:34:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-60d0c4bc-d22d-42a1-b1c2-baffaa440d58 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ba1e4c87-c34c-4043-8fc6-d78ac4670e19 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:42 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-49bb4539-781b-40b5-82ba-c8c970c174bf tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Acquiring lock "cinder-85ec3799-b59a-427e-bb02-abc9afc61de0-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:34:42 devstack sudo[104795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ba1e4c87-c34c-4043-8fc6-d78ac4670e19 1073741824 Jul 07 08:34:42 devstack sudo[104795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f3e317d4-27c3-4896-989e-23cc80e25bbb tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37fe6e7c-b79e-46ac-a0f5-85202a85762b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3dd316e-9ee4-4cfc-9e93-5450af047a63', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f3e317d4-27c3-4896-989e-23cc80e25bbb tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4982ffa-cf72-4322-a54d-237e6758506e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:42 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-49bb4539-781b-40b5-82ba-c8c970c174bf tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Lock "cinder-85ec3799-b59a-427e-bb02-abc9afc61de0-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:34:42 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-f3e317d4-27c3-4896-989e-23cc80e25bbb tempest-CreateVolumesFromSnapshotTest-1959601045 None] Volume volume-d3dd316e-9ee4-4cfc-9e93-5450af047a63 (d3dd316e-9ee4-4cfc-9e93-5450af047a63): created successfully Jul 07 08:34:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f3e317d4-27c3-4896-989e-23cc80e25bbb tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4982ffa-cf72-4322-a54d-237e6758506e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:42 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-f3e317d4-27c3-4896-989e-23cc80e25bbb tempest-CreateVolumesFromSnapshotTest-1959601045 None] Flow 'volume_create_manager' (72a97dab-176e-4c49-b3f7-d5dbd2e1e39b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:34:42 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-f3e317d4-27c3-4896-989e-23cc80e25bbb tempest-CreateVolumesFromSnapshotTest-1959601045 None] Created volume successfully. Jul 07 08:34:42 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-49bb4539-781b-40b5-82ba-c8c970c174bf tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Acquiring lock "cinder-quobyte-85ec3799-b59a-427e-bb02-abc9afc61de0" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:34:42 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-49bb4539-781b-40b5-82ba-c8c970c174bf tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Lock "cinder-quobyte-85ec3799-b59a-427e-bb02-abc9afc61de0" acquired by "delete_volume" :: waited 0.016s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:34:42 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be290cd-1e81-4697-9180-2508fe2860bb]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:34:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-49bb4539-781b-40b5-82ba-c8c970c174bf tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-85ec3799-b59a-427e-bb02-abc9afc61de0 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:42 devstack sudo[104797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-85ec3799-b59a-427e-bb02-abc9afc61de0 Jul 07 08:34:42 devstack sudo[104797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:42 devstack sudo[104792]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-81e31e49-27e0-4a38-9fcc-d91c57b66f40 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.792s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:42 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-81e31e49-27e0-4a38-9fcc-d91c57b66f40 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:34:42 devstack sudo[104790]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7aea3cf1-6405-4571-80a1-9c2d40d4e491" returned: 0 in 0.977s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7aea3cf1-6405-4571-80a1-9c2d40d4e491 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:42 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-81e31e49-27e0-4a38-9fcc-d91c57b66f40 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Deleted volume successfully. Jul 07 08:34:42 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-81e31e49-27e0-4a38-9fcc-d91c57b66f40 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Lock "cinder-82f888df-81bf-46be-816b-5b0183a2f459-delete_volume" released by "delete_volume" :: held 2.836s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:34:43 devstack sudo[104802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7aea3cf1-6405-4571-80a1-9c2d40d4e491 Jul 07 08:34:43 devstack sudo[104802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:43 devstack sudo[104795]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-60d0c4bc-d22d-42a1-b1c2-baffaa440d58 tempest-CreateVolumesFromSnapshotTest-1959601045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ba1e4c87-c34c-4043-8fc6-d78ac4670e19 1073741824" returned: 0 in 1.011s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-60d0c4bc-d22d-42a1-b1c2-baffaa440d58 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ba1e4c87-c34c-4043-8fc6-d78ac4670e19 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:43 devstack sudo[104797]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-49bb4539-781b-40b5-82ba-c8c970c174bf tempest-CreateVolumesFromSourceVolumeTest-408073723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-85ec3799-b59a-427e-bb02-abc9afc61de0" returned: 0 in 0.838s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-49bb4539-781b-40b5-82ba-c8c970c174bf tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-85ec3799-b59a-427e-bb02-abc9afc61de0 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:43 devstack sudo[104810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ba1e4c87-c34c-4043-8fc6-d78ac4670e19 Jul 07 08:34:43 devstack sudo[104810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:43 devstack sudo[104812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-85ec3799-b59a-427e-bb02-abc9afc61de0 Jul 07 08:34:43 devstack sudo[104812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:43 devstack sudo[104802]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7aea3cf1-6405-4571-80a1-9c2d40d4e491" returned: 1 in 0.865s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7aea3cf1-6405-4571-80a1-9c2d40d4e491' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:34:43 devstack cinder-volume[87199]: DEBUG cinder.volume.volume_utils [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Downloaded image bebe7804-1e87-4c9c-8e59-9163f794b649 ((None, [{'url': 'file:///opt/stack/data/glance/images/bebe7804-1e87-4c9c-8e59-9163f794b649', 'metadata': {}}])) to volume 7aea3cf1-6405-4571-80a1-9c2d40d4e491 successfully. {{(pid=87199) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 08:34:43 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Temporary image bebe7804-1e87-4c9c-8e59-9163f794b649 for user 0e3dc72115474b9990d1eaa72eb93cf2 is deleted. {{(pid=87199) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 08:34:43 devstack cinder-volume[87199]: DEBUG cinder.volume.volume_utils [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Marking volume 7aea3cf1-6405-4571-80a1-9c2d40d4e491 as bootable. {{(pid=87199) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 08:34:43 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Copying metadata from image bebe7804-1e87-4c9c-8e59-9163f794b649 to 7aea3cf1-6405-4571-80a1-9c2d40d4e491. {{(pid=87199) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 08:34:43 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Creating volume glance metadata for volume 7aea3cf1-6405-4571-80a1-9c2d40d4e491 backed by image bebe7804-1e87-4c9c-8e59-9163f794b649 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'bebe7804-1e87-4c9c-8e59-9163f794b649', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '3c56b131664a6c54d6f2b8ffc79c8175', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87199) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 08:34:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5b240f1-5d12-45a7-abb2-10ce1d616d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7aea3cf1-6405-4571-80a1-9c2d40d4e491', 'volume_size': 1, 'image_id': 'bebe7804-1e87-4c9c-8e59-9163f794b649', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bebe7804-1e87-4c9c-8e59-9163f794b649', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3c56b131664a6c54d6f2b8ffc79c8175', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '90a47e1d22a2469e9a475f9d37a49713', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '98a519afd771c795ad666c36d10a9afa08cffb0a35e6ce9d12984e0ddb21dd93565410e112dc70d70cfc37938a56d8ff69f1e85b76687a2ff650c07e67021ea0', 'id': 'bebe7804-1e87-4c9c-8e59-9163f794b649', 'created_at': datetime.datetime(2026, 7, 7, 6, 34, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 6, 34, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bebe7804-1e87-4c9c-8e59-9163f794b649/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b00512e7-3195-46a6-8bdb-2af14eea0c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:43 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Volume volume-7aea3cf1-6405-4571-80a1-9c2d40d4e491 (7aea3cf1-6405-4571-80a1-9c2d40d4e491): created successfully Jul 07 08:34:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b00512e7-3195-46a6-8bdb-2af14eea0c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:43 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Flow 'volume_create_manager' (d72647cc-cf00-4876-aaba-777b3e63c552) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:34:43 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-4fdaf70d-9d99-4f9f-8cc5-a19690fed717 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Created volume successfully. Jul 07 08:34:44 devstack sudo[104812]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:44 devstack sudo[104810]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-49bb4539-781b-40b5-82ba-c8c970c174bf tempest-CreateVolumesFromSourceVolumeTest-408073723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-85ec3799-b59a-427e-bb02-abc9afc61de0" returned: 0 in 0.684s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:44 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-44f1bd3b-950f-4915-87cb-964001380d38 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Acquiring lock "cinder-7aea3cf1-6405-4571-80a1-9c2d40d4e491-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:34:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-60d0c4bc-d22d-42a1-b1c2-baffaa440d58 tempest-CreateVolumesFromSnapshotTest-1959601045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ba1e4c87-c34c-4043-8fc6-d78ac4670e19" returned: 0 in 0.727s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-60d0c4bc-d22d-42a1-b1c2-baffaa440d58 tempest-CreateVolumesFromSnapshotTest-1959601045 None] <== create_volume: return (1785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:34:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-60d0c4bc-d22d-42a1-b1c2-baffaa440d58 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.791s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:34:44 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-49bb4539-781b-40b5-82ba-c8c970c174bf tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Lock "cinder-quobyte-85ec3799-b59a-427e-bb02-abc9afc61de0" released by "delete_volume" :: held 1.603s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:34:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3a9c7d07-0cff-4cb4-8858-bd0f0a045eac tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.099s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:34:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-3a9c7d07-0cff-4cb4-8858-bd0f0a045eac tempest-CreateVolumesFromSnapshotTest-1959601045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1413201632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f386e03-d414-4ea7-8152-9f0b152021ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='314dd98dd2ef4ddbb08dcd63398f6370',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:34:25Z,use_quota=True,user_id='286198b13787439e946961c654750a36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:34:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-3a9c7d07-0cff-4cb4-8858-bd0f0a045eac tempest-CreateVolumesFromSnapshotTest-1959601045 None] Creating volume 2f386e03-d414-4ea7-8152-9f0b152021ef {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:34:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3a9c7d07-0cff-4cb4-8858-bd0f0a045eac tempest-CreateVolumesFromSnapshotTest-1959601045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:34:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3a9c7d07-0cff-4cb4-8858-bd0f0a045eac tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:34:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-3a9c7d07-0cff-4cb4-8858-bd0f0a045eac tempest-CreateVolumesFromSnapshotTest-1959601045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:34:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-3a9c7d07-0cff-4cb4-8858-bd0f0a045eac tempest-CreateVolumesFromSnapshotTest-1959601045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:34:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3a9c7d07-0cff-4cb4-8858-bd0f0a045eac tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:34:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-3a9c7d07-0cff-4cb4-8858-bd0f0a045eac tempest-CreateVolumesFromSnapshotTest-1959601045 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:34:44 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-3a9c7d07-0cff-4cb4-8858-bd0f0a045eac tempest-CreateVolumesFromSnapshotTest-1959601045 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:34:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3a9c7d07-0cff-4cb4-8858-bd0f0a045eac tempest-CreateVolumesFromSnapshotTest-1959601045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2f386e03-d414-4ea7-8152-9f0b152021ef 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:44 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-44f1bd3b-950f-4915-87cb-964001380d38 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Lock "cinder-7aea3cf1-6405-4571-80a1-9c2d40d4e491-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:34:44 devstack sudo[104819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2f386e03-d414-4ea7-8152-9f0b152021ef 1073741824 Jul 07 08:34:44 devstack sudo[104819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-60d0c4bc-d22d-42a1-b1c2-baffaa440d58 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e24ed61a-7f67-4cc5-8666-c45cd890abf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba1e4c87-c34c-4043-8fc6-d78ac4670e19', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-60d0c4bc-d22d-42a1-b1c2-baffaa440d58 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba147418-437f-4d12-a324-a76cb6b5bbe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:44 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-60d0c4bc-d22d-42a1-b1c2-baffaa440d58 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Volume volume-ba1e4c87-c34c-4043-8fc6-d78ac4670e19 (ba1e4c87-c34c-4043-8fc6-d78ac4670e19): created successfully Jul 07 08:34:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-60d0c4bc-d22d-42a1-b1c2-baffaa440d58 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba147418-437f-4d12-a324-a76cb6b5bbe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:44 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-60d0c4bc-d22d-42a1-b1c2-baffaa440d58 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Flow 'volume_create_manager' (fea51cff-e2b7-4fc6-b44f-3e18adbac282) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:34:44 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-60d0c4bc-d22d-42a1-b1c2-baffaa440d58 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Created volume successfully. Jul 07 08:34:44 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-44f1bd3b-950f-4915-87cb-964001380d38 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Acquiring lock "cinder-quobyte-7aea3cf1-6405-4571-80a1-9c2d40d4e491" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:34:44 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-44f1bd3b-950f-4915-87cb-964001380d38 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Lock "cinder-quobyte-7aea3cf1-6405-4571-80a1-9c2d40d4e491" acquired by "delete_volume" :: waited 0.029s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:34:44 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-49bb4539-781b-40b5-82ba-c8c970c174bf tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Created reservations ['3d711c25-960f-4359-bc73-4db76a4797c1', 'e5ccc068-2d5f-453c-aec6-cf72265cab74', 'c1c67d99-e99f-439e-bdf0-0f066be5d5c7', 'a5672461-cda5-426d-8996-51dfd408cd79'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:34:44 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f187b5-d19c-497f-b142-7d9856a9c0ca]: (4, 'raw') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:34:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-44f1bd3b-950f-4915-87cb-964001380d38 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7aea3cf1-6405-4571-80a1-9c2d40d4e491 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-49bb4539-781b-40b5-82ba-c8c970c174bf tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:34:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-49bb4539-781b-40b5-82ba-c8c970c174bf tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:34:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-49bb4539-781b-40b5-82ba-c8c970c174bf tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:34:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-49bb4539-781b-40b5-82ba-c8c970c174bf tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:34:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-49bb4539-781b-40b5-82ba-c8c970c174bf tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:34:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-49bb4539-781b-40b5-82ba-c8c970c174bf tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:44 devstack sudo[104822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:34:44 devstack sudo[104822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:44 devstack sudo[104821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7aea3cf1-6405-4571-80a1-9c2d40d4e491 Jul 07 08:34:44 devstack sudo[104821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:44 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f427d6aa-1b9f-4275-b165-3d784e09ada1 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Acquiring lock "cinder-41dd2899-d6ec-4947-8962-508cce2b996f-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:34:44 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f427d6aa-1b9f-4275-b165-3d784e09ada1 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Lock "cinder-41dd2899-d6ec-4947-8962-508cce2b996f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:34:44 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f427d6aa-1b9f-4275-b165-3d784e09ada1 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Acquiring lock "cinder-quobyte-41dd2899-d6ec-4947-8962-508cce2b996f" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:34:44 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f427d6aa-1b9f-4275-b165-3d784e09ada1 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Lock "cinder-quobyte-41dd2899-d6ec-4947-8962-508cce2b996f" acquired by "delete_volume" :: waited 0.021s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:34:44 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[861ad7a4-7668-4768-a329-681045f45bf0]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:34:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f427d6aa-1b9f-4275-b165-3d784e09ada1 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41dd2899-d6ec-4947-8962-508cce2b996f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:44 devstack sudo[104825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41dd2899-d6ec-4947-8962-508cce2b996f Jul 07 08:34:44 devstack sudo[104825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:45 devstack sudo[104819]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3a9c7d07-0cff-4cb4-8858-bd0f0a045eac tempest-CreateVolumesFromSnapshotTest-1959601045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2f386e03-d414-4ea7-8152-9f0b152021ef 1073741824" returned: 0 in 1.004s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3a9c7d07-0cff-4cb4-8858-bd0f0a045eac tempest-CreateVolumesFromSnapshotTest-1959601045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2f386e03-d414-4ea7-8152-9f0b152021ef {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:45 devstack sudo[104834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2f386e03-d414-4ea7-8152-9f0b152021ef Jul 07 08:34:45 devstack sudo[104822]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:45 devstack sudo[104834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-49bb4539-781b-40b5-82ba-c8c970c174bf tempest-CreateVolumesFromSourceVolumeTest-408073723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.857s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:45 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-49bb4539-781b-40b5-82ba-c8c970c174bf tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:34:45 devstack sudo[104821]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:45 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-49bb4539-781b-40b5-82ba-c8c970c174bf tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Deleted volume successfully. Jul 07 08:34:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-44f1bd3b-950f-4915-87cb-964001380d38 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7aea3cf1-6405-4571-80a1-9c2d40d4e491" returned: 0 in 0.931s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-44f1bd3b-950f-4915-87cb-964001380d38 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7aea3cf1-6405-4571-80a1-9c2d40d4e491 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-49bb4539-781b-40b5-82ba-c8c970c174bf tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Lock "cinder-85ec3799-b59a-427e-bb02-abc9afc61de0-delete_volume" released by "delete_volume" :: held 2.883s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:34:45 devstack sudo[104836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7aea3cf1-6405-4571-80a1-9c2d40d4e491 Jul 07 08:34:45 devstack sudo[104836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:45 devstack sudo[104825]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f427d6aa-1b9f-4275-b165-3d784e09ada1 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41dd2899-d6ec-4947-8962-508cce2b996f" returned: 0 in 0.814s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f427d6aa-1b9f-4275-b165-3d784e09ada1 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41dd2899-d6ec-4947-8962-508cce2b996f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:45 devstack sudo[104842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41dd2899-d6ec-4947-8962-508cce2b996f Jul 07 08:34:45 devstack sudo[104842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:45 devstack sudo[104834]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3a9c7d07-0cff-4cb4-8858-bd0f0a045eac tempest-CreateVolumesFromSnapshotTest-1959601045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2f386e03-d414-4ea7-8152-9f0b152021ef" returned: 0 in 0.759s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:45 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-3a9c7d07-0cff-4cb4-8858-bd0f0a045eac tempest-CreateVolumesFromSnapshotTest-1959601045 None] <== create_volume: return (1834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:34:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3a9c7d07-0cff-4cb4-8858-bd0f0a045eac tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.841s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:34:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-73eca965-838d-4915-89c4-19c146199d4d tempest-ProjectReaderTests-1685940573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.448s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:34:45 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-73eca965-838d-4915-89c4-19c146199d4d tempest-ProjectReaderTests-1685940573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1676099106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db1a3896-d60b-4728-ba95-816b310276b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06330941a308447a9ec29b93464314b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:34:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:34:38Z,use_quota=True,user_id='7e7152ed33e44a5a937717a4c518b2d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:34:45 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-73eca965-838d-4915-89c4-19c146199d4d tempest-ProjectReaderTests-1685940573 None] Creating volume db1a3896-d60b-4728-ba95-816b310276b0 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:34:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-73eca965-838d-4915-89c4-19c146199d4d tempest-ProjectReaderTests-1685940573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:34:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-73eca965-838d-4915-89c4-19c146199d4d tempest-ProjectReaderTests-1685940573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:34:45 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-73eca965-838d-4915-89c4-19c146199d4d tempest-ProjectReaderTests-1685940573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:34:45 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-73eca965-838d-4915-89c4-19c146199d4d tempest-ProjectReaderTests-1685940573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:34:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-73eca965-838d-4915-89c4-19c146199d4d tempest-ProjectReaderTests-1685940573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:34:45 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-73eca965-838d-4915-89c4-19c146199d4d tempest-ProjectReaderTests-1685940573 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:34:45 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-73eca965-838d-4915-89c4-19c146199d4d tempest-ProjectReaderTests-1685940573 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:34:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-73eca965-838d-4915-89c4-19c146199d4d tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-db1a3896-d60b-4728-ba95-816b310276b0 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3a9c7d07-0cff-4cb4-8858-bd0f0a045eac tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2faad1f-d0d2-4f4e-a2fc-0d30ebfd777f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f386e03-d414-4ea7-8152-9f0b152021ef', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:45 devstack sudo[104848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-db1a3896-d60b-4728-ba95-816b310276b0 1073741824 Jul 07 08:34:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3a9c7d07-0cff-4cb4-8858-bd0f0a045eac tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f24e560e-b448-4796-9f04-6e1a9aa461fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:45 devstack sudo[104848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:45 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-3a9c7d07-0cff-4cb4-8858-bd0f0a045eac tempest-CreateVolumesFromSnapshotTest-1959601045 None] Volume volume-2f386e03-d414-4ea7-8152-9f0b152021ef (2f386e03-d414-4ea7-8152-9f0b152021ef): created successfully Jul 07 08:34:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3a9c7d07-0cff-4cb4-8858-bd0f0a045eac tempest-CreateVolumesFromSnapshotTest-1959601045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f24e560e-b448-4796-9f04-6e1a9aa461fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:45 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3a9c7d07-0cff-4cb4-8858-bd0f0a045eac tempest-CreateVolumesFromSnapshotTest-1959601045 None] Flow 'volume_create_manager' (c421fa20-f5d5-470d-aebe-b28fc71f72ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:34:45 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-3a9c7d07-0cff-4cb4-8858-bd0f0a045eac tempest-CreateVolumesFromSnapshotTest-1959601045 None] Created volume successfully. Jul 07 08:34:46 devstack sudo[104836]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-44f1bd3b-950f-4915-87cb-964001380d38 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7aea3cf1-6405-4571-80a1-9c2d40d4e491" returned: 1 in 0.807s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-44f1bd3b-950f-4915-87cb-964001380d38 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7aea3cf1-6405-4571-80a1-9c2d40d4e491' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:34:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-44f1bd3b-950f-4915-87cb-964001380d38 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7aea3cf1-6405-4571-80a1-9c2d40d4e491 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:46 devstack sudo[104850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7aea3cf1-6405-4571-80a1-9c2d40d4e491 Jul 07 08:34:46 devstack sudo[104850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:46 devstack sudo[104842]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f427d6aa-1b9f-4275-b165-3d784e09ada1 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-41dd2899-d6ec-4947-8962-508cce2b996f" returned: 0 in 0.793s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f427d6aa-1b9f-4275-b165-3d784e09ada1 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Lock "cinder-quobyte-41dd2899-d6ec-4947-8962-508cce2b996f" released by "delete_volume" :: held 1.669s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:34:46 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-f427d6aa-1b9f-4275-b165-3d784e09ada1 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Created reservations ['9a8bef36-56cb-4c9f-9ec7-2fa2e03842fe', '5e487d01-4284-4401-8fe8-07a17697d69e', '1df97a78-07fe-4f66-a973-0a4d51b79efa', '1a37302f-6f67-43da-8457-93787c105d8c'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:34:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f427d6aa-1b9f-4275-b165-3d784e09ada1 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:34:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f427d6aa-1b9f-4275-b165-3d784e09ada1 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:34:46 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f427d6aa-1b9f-4275-b165-3d784e09ada1 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:34:46 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-f427d6aa-1b9f-4275-b165-3d784e09ada1 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:34:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-f427d6aa-1b9f-4275-b165-3d784e09ada1 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:34:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f427d6aa-1b9f-4275-b165-3d784e09ada1 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:46 devstack sudo[104853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:34:46 devstack sudo[104853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-761e1fb9-1110-4c22-96f9-e1b381fc830f tempest-CreateVolumesFromSnapshotTest-1959601045 None] Acquiring lock "cinder-2f386e03-d414-4ea7-8152-9f0b152021ef-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:34:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-761e1fb9-1110-4c22-96f9-e1b381fc830f tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "cinder-2f386e03-d414-4ea7-8152-9f0b152021ef-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:34:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-761e1fb9-1110-4c22-96f9-e1b381fc830f tempest-CreateVolumesFromSnapshotTest-1959601045 None] Acquiring lock "cinder-quobyte-2f386e03-d414-4ea7-8152-9f0b152021ef" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:34:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-761e1fb9-1110-4c22-96f9-e1b381fc830f tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "cinder-quobyte-2f386e03-d414-4ea7-8152-9f0b152021ef" acquired by "delete_volume" :: waited 0.018s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:34:46 devstack sudo[104850]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-44f1bd3b-950f-4915-87cb-964001380d38 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-7aea3cf1-6405-4571-80a1-9c2d40d4e491" returned: 0 in 0.764s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:46 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a51d088-1dd5-4676-9d23-af6a8cdf6f36]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:34:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-761e1fb9-1110-4c22-96f9-e1b381fc830f tempest-CreateVolumesFromSnapshotTest-1959601045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2f386e03-d414-4ea7-8152-9f0b152021ef {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-44f1bd3b-950f-4915-87cb-964001380d38 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Lock "cinder-quobyte-7aea3cf1-6405-4571-80a1-9c2d40d4e491" released by "delete_volume" :: held 2.628s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:34:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-836ba9e2-6e04-4e61-8013-6b9951a6e117 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Acquiring lock "cinder-14df5cee-b080-4c09-907d-d8e251c4d00d-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:34:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-836ba9e2-6e04-4e61-8013-6b9951a6e117 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Lock "cinder-14df5cee-b080-4c09-907d-d8e251c4d00d-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:34:46 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-44f1bd3b-950f-4915-87cb-964001380d38 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Created reservations ['d7ca12f6-f616-4cf6-a408-d5cc1af0b671', 'f3a199d5-c168-4abb-9cd4-35f7c2eb0164', 'fa12e8a1-df2b-448b-b8af-1cfc42167119', 'c70f6cf1-d158-436f-9455-b6c8b1a5aa27'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:34:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-836ba9e2-6e04-4e61-8013-6b9951a6e117 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Acquiring lock "cinder-quobyte-14df5cee-b080-4c09-907d-d8e251c4d00d" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:34:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-836ba9e2-6e04-4e61-8013-6b9951a6e117 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Lock "cinder-quobyte-14df5cee-b080-4c09-907d-d8e251c4d00d" acquired by "delete_volume" :: waited 0.034s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:34:46 devstack sudo[104860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2f386e03-d414-4ea7-8152-9f0b152021ef Jul 07 08:34:46 devstack sudo[104860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:47 devstack sudo[104848]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-73eca965-838d-4915-89c4-19c146199d4d tempest-ProjectReaderTests-1685940573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-db1a3896-d60b-4728-ba95-816b310276b0 1073741824" returned: 0 in 1.107s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:47 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63f7ab7-e5ed-4090-8cd1-0776bf5cb3b9]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:34:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-836ba9e2-6e04-4e61-8013-6b9951a6e117 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-14df5cee-b080-4c09-907d-d8e251c4d00d {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-73eca965-838d-4915-89c4-19c146199d4d tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-db1a3896-d60b-4728-ba95-816b310276b0 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:47 devstack sudo[104864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-db1a3896-d60b-4728-ba95-816b310276b0 Jul 07 08:34:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-44f1bd3b-950f-4915-87cb-964001380d38 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:34:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-44f1bd3b-950f-4915-87cb-964001380d38 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:34:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-44f1bd3b-950f-4915-87cb-964001380d38 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:34:47 devstack sudo[104864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-44f1bd3b-950f-4915-87cb-964001380d38 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:34:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-44f1bd3b-950f-4915-87cb-964001380d38 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:34:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-44f1bd3b-950f-4915-87cb-964001380d38 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:47 devstack sudo[104862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-14df5cee-b080-4c09-907d-d8e251c4d00d Jul 07 08:34:47 devstack sudo[104862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:47 devstack sudo[104866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:34:47 devstack sudo[104866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:47 devstack sudo[104853]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-f427d6aa-1b9f-4275-b165-3d784e09ada1 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.847s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:47 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-f427d6aa-1b9f-4275-b165-3d784e09ada1 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:34:47 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-f427d6aa-1b9f-4275-b165-3d784e09ada1 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Deleted volume successfully. Jul 07 08:34:47 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-f427d6aa-1b9f-4275-b165-3d784e09ada1 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Lock "cinder-41dd2899-d6ec-4947-8962-508cce2b996f-delete_volume" released by "delete_volume" :: held 2.808s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:34:48 devstack sudo[104862]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-836ba9e2-6e04-4e61-8013-6b9951a6e117 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-14df5cee-b080-4c09-907d-d8e251c4d00d" returned: 0 in 0.987s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-836ba9e2-6e04-4e61-8013-6b9951a6e117 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-14df5cee-b080-4c09-907d-d8e251c4d00d {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:48 devstack sudo[104860]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-761e1fb9-1110-4c22-96f9-e1b381fc830f tempest-CreateVolumesFromSnapshotTest-1959601045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2f386e03-d414-4ea7-8152-9f0b152021ef" returned: 0 in 1.246s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-761e1fb9-1110-4c22-96f9-e1b381fc830f tempest-CreateVolumesFromSnapshotTest-1959601045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2f386e03-d414-4ea7-8152-9f0b152021ef {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:48 devstack sudo[104882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-14df5cee-b080-4c09-907d-d8e251c4d00d Jul 07 08:34:48 devstack sudo[104882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:48 devstack sudo[104883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2f386e03-d414-4ea7-8152-9f0b152021ef Jul 07 08:34:48 devstack sudo[104883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:48 devstack sudo[104864]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-73eca965-838d-4915-89c4-19c146199d4d tempest-ProjectReaderTests-1685940573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-db1a3896-d60b-4728-ba95-816b310276b0" returned: 0 in 1.044s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-73eca965-838d-4915-89c4-19c146199d4d tempest-ProjectReaderTests-1685940573 None] <== create_volume: return (2226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:34:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-73eca965-838d-4915-89c4-19c146199d4d tempest-ProjectReaderTests-1685940573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.233s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:34:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-73eca965-838d-4915-89c4-19c146199d4d tempest-ProjectReaderTests-1685940573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1accbcf-0722-40a9-b703-cd9cc5405bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db1a3896-d60b-4728-ba95-816b310276b0', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-73eca965-838d-4915-89c4-19c146199d4d tempest-ProjectReaderTests-1685940573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33f601d1-1e04-4b61-8dd3-2d0ddb4ac950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:48 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-73eca965-838d-4915-89c4-19c146199d4d tempest-ProjectReaderTests-1685940573 None] Volume volume-db1a3896-d60b-4728-ba95-816b310276b0 (db1a3896-d60b-4728-ba95-816b310276b0): created successfully Jul 07 08:34:48 devstack sudo[104866]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-73eca965-838d-4915-89c4-19c146199d4d tempest-ProjectReaderTests-1685940573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33f601d1-1e04-4b61-8dd3-2d0ddb4ac950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-73eca965-838d-4915-89c4-19c146199d4d tempest-ProjectReaderTests-1685940573 None] Flow 'volume_create_manager' (f31b42c5-b420-4b1c-8b75-f488ec31052e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:34:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-44f1bd3b-950f-4915-87cb-964001380d38 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 1.123s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:48 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-44f1bd3b-950f-4915-87cb-964001380d38 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:34:48 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-44f1bd3b-950f-4915-87cb-964001380d38 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Deleted volume successfully. Jul 07 08:34:48 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-73eca965-838d-4915-89c4-19c146199d4d tempest-ProjectReaderTests-1685940573 None] Created volume successfully. Jul 07 08:34:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-44f1bd3b-950f-4915-87cb-964001380d38 tempest-VolumeAndVolumeTypeFromImageTest-310490009 None] Lock "cinder-7aea3cf1-6405-4571-80a1-9c2d40d4e491-delete_volume" released by "delete_volume" :: held 4.220s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:34:48 devstack sudo[104882]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-836ba9e2-6e04-4e61-8013-6b9951a6e117 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-14df5cee-b080-4c09-907d-d8e251c4d00d" returned: 0 in 0.782s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-836ba9e2-6e04-4e61-8013-6b9951a6e117 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Lock "cinder-quobyte-14df5cee-b080-4c09-907d-d8e251c4d00d" released by "delete_volume" :: held 1.826s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:34:48 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-836ba9e2-6e04-4e61-8013-6b9951a6e117 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Created reservations ['c8a94f54-b234-4dce-93df-9a22915bdecd', 'cbb82806-3fa2-4346-80a4-349850d60e8c', '69328c67-b02e-4365-a00f-4f87d43d49ef', 'c88e8f32-7fd4-4063-b6d5-0253883aeafe'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:34:48 devstack sudo[104883]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-761e1fb9-1110-4c22-96f9-e1b381fc830f tempest-CreateVolumesFromSnapshotTest-1959601045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2f386e03-d414-4ea7-8152-9f0b152021ef" returned: 0 in 0.899s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-761e1fb9-1110-4c22-96f9-e1b381fc830f tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "cinder-quobyte-2f386e03-d414-4ea7-8152-9f0b152021ef" released by "delete_volume" :: held 2.217s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:34:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-836ba9e2-6e04-4e61-8013-6b9951a6e117 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:34:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-836ba9e2-6e04-4e61-8013-6b9951a6e117 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:34:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-836ba9e2-6e04-4e61-8013-6b9951a6e117 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:34:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-836ba9e2-6e04-4e61-8013-6b9951a6e117 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:34:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-836ba9e2-6e04-4e61-8013-6b9951a6e117 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:34:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-836ba9e2-6e04-4e61-8013-6b9951a6e117 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:49 devstack sudo[104889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:34:49 devstack sudo[104889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:49 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-761e1fb9-1110-4c22-96f9-e1b381fc830f tempest-CreateVolumesFromSnapshotTest-1959601045 None] Created reservations ['336dad70-4d38-4f34-bb4b-80c894a02efd', '87a0897c-779d-4d80-8c93-823e2a75a18b', '345a8090-63b0-4f54-a50e-e445aeeb39f1', '3a2e3336-5dce-49f3-9702-df537bd142f0'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:34:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-761e1fb9-1110-4c22-96f9-e1b381fc830f tempest-CreateVolumesFromSnapshotTest-1959601045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:34:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-761e1fb9-1110-4c22-96f9-e1b381fc830f tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:34:49 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-761e1fb9-1110-4c22-96f9-e1b381fc830f tempest-CreateVolumesFromSnapshotTest-1959601045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:34:49 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-761e1fb9-1110-4c22-96f9-e1b381fc830f tempest-CreateVolumesFromSnapshotTest-1959601045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:34:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-761e1fb9-1110-4c22-96f9-e1b381fc830f tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:34:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-761e1fb9-1110-4c22-96f9-e1b381fc830f tempest-CreateVolumesFromSnapshotTest-1959601045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:49 devstack sudo[104891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:34:49 devstack sudo[104891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4d29fa2a-2ec8-450c-aece-fd367189b52c tempest-ProjectReaderTests-1685940573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:34:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4d29fa2a-2ec8-450c-aece-fd367189b52c tempest-ProjectReaderTests-1685940573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:34:49 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-4d29fa2a-2ec8-450c-aece-fd367189b52c tempest-ProjectReaderTests-1685940573 None] Creating offline snapshot 06edb7f0-05ce-4cd0-9265-e0f61e181829 of volume db1a3896-d60b-4728-ba95-816b310276b0 {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:34:49 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[f831d4dd-6f52-4adb-9dcb-d138af442f20]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:34:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4d29fa2a-2ec8-450c-aece-fd367189b52c tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-db1a3896-d60b-4728-ba95-816b310276b0 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:49 devstack sudo[104894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-db1a3896-d60b-4728-ba95-816b310276b0 Jul 07 08:34:49 devstack sudo[104894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:49 devstack sudo[104889]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-836ba9e2-6e04-4e61-8013-6b9951a6e117 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.927s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:49 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-836ba9e2-6e04-4e61-8013-6b9951a6e117 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:34:49 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-836ba9e2-6e04-4e61-8013-6b9951a6e117 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Deleted volume successfully. Jul 07 08:34:49 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-836ba9e2-6e04-4e61-8013-6b9951a6e117 tempest-CreateVolumesFromSourceVolumeTest-408073723 None] Lock "cinder-14df5cee-b080-4c09-907d-d8e251c4d00d-delete_volume" released by "delete_volume" :: held 3.092s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:34:50 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9020d291-17bb-4ac8-a6bb-8432814c2226 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Acquiring lock "cinder-ba1e4c87-c34c-4043-8fc6-d78ac4670e19-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:34:50 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9020d291-17bb-4ac8-a6bb-8432814c2226 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "cinder-ba1e4c87-c34c-4043-8fc6-d78ac4670e19-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:34:50 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9020d291-17bb-4ac8-a6bb-8432814c2226 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Acquiring lock "cinder-quobyte-ba1e4c87-c34c-4043-8fc6-d78ac4670e19" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:34:50 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9020d291-17bb-4ac8-a6bb-8432814c2226 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "cinder-quobyte-ba1e4c87-c34c-4043-8fc6-d78ac4670e19" acquired by "delete_volume" :: waited 0.022s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:34:50 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ebd520b-2cc2-4f0f-b11a-22ca3c2730c3]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:34:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9020d291-17bb-4ac8-a6bb-8432814c2226 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ba1e4c87-c34c-4043-8fc6-d78ac4670e19 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:50 devstack sudo[104891]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-761e1fb9-1110-4c22-96f9-e1b381fc830f tempest-CreateVolumesFromSnapshotTest-1959601045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 1.144s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:50 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-761e1fb9-1110-4c22-96f9-e1b381fc830f tempest-CreateVolumesFromSnapshotTest-1959601045 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:34:50 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-761e1fb9-1110-4c22-96f9-e1b381fc830f tempest-CreateVolumesFromSnapshotTest-1959601045 None] Deleted volume successfully. Jul 07 08:34:50 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-761e1fb9-1110-4c22-96f9-e1b381fc830f tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "cinder-2f386e03-d414-4ea7-8152-9f0b152021ef-delete_volume" released by "delete_volume" :: held 3.781s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:34:50 devstack sudo[104898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ba1e4c87-c34c-4043-8fc6-d78ac4670e19 Jul 07 08:34:50 devstack sudo[104898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:50 devstack sudo[104894]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4d29fa2a-2ec8-450c-aece-fd367189b52c tempest-ProjectReaderTests-1685940573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-db1a3896-d60b-4728-ba95-816b310276b0" returned: 0 in 1.078s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4d29fa2a-2ec8-450c-aece-fd367189b52c tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-db1a3896-d60b-4728-ba95-816b310276b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-db1a3896-d60b-4728-ba95-816b310276b0.06edb7f0-05ce-4cd0-9265-e0f61e181829 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:50 devstack sudo[104904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-db1a3896-d60b-4728-ba95-816b310276b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-db1a3896-d60b-4728-ba95-816b310276b0.06edb7f0-05ce-4cd0-9265-e0f61e181829 1G Jul 07 08:34:50 devstack sudo[104904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:51 devstack sudo[104898]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9020d291-17bb-4ac8-a6bb-8432814c2226 tempest-CreateVolumesFromSnapshotTest-1959601045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ba1e4c87-c34c-4043-8fc6-d78ac4670e19" returned: 0 in 1.117s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9020d291-17bb-4ac8-a6bb-8432814c2226 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ba1e4c87-c34c-4043-8fc6-d78ac4670e19 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:51 devstack sudo[104915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ba1e4c87-c34c-4043-8fc6-d78ac4670e19 Jul 07 08:34:51 devstack sudo[104915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:51 devstack sudo[104904]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4d29fa2a-2ec8-450c-aece-fd367189b52c tempest-ProjectReaderTests-1685940573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-db1a3896-d60b-4728-ba95-816b310276b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-db1a3896-d60b-4728-ba95-816b310276b0.06edb7f0-05ce-4cd0-9265-e0f61e181829 1G" returned: 0 in 1.056s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4d29fa2a-2ec8-450c-aece-fd367189b52c tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db1a3896-d60b-4728-ba95-816b310276b0 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-db1a3896-d60b-4728-ba95-816b310276b0.06edb7f0-05ce-4cd0-9265-e0f61e181829 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:51 devstack sudo[104918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db1a3896-d60b-4728-ba95-816b310276b0 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-db1a3896-d60b-4728-ba95-816b310276b0.06edb7f0-05ce-4cd0-9265-e0f61e181829 Jul 07 08:34:51 devstack sudo[104918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:52 devstack sudo[104915]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9020d291-17bb-4ac8-a6bb-8432814c2226 tempest-CreateVolumesFromSnapshotTest-1959601045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ba1e4c87-c34c-4043-8fc6-d78ac4670e19" returned: 0 in 0.744s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9020d291-17bb-4ac8-a6bb-8432814c2226 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "cinder-quobyte-ba1e4c87-c34c-4043-8fc6-d78ac4670e19" released by "delete_volume" :: held 1.943s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:34:52 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-9020d291-17bb-4ac8-a6bb-8432814c2226 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Created reservations ['3eb30623-65be-4668-939f-11ae85977c35', '58003380-00ab-4f9b-ae59-96217f2a6cea', 'f33fdca1-6565-4c55-b9f0-76ccbd911d8a', '69ba887e-dbea-43d8-8440-030da0745574'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:34:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9020d291-17bb-4ac8-a6bb-8432814c2226 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:34:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9020d291-17bb-4ac8-a6bb-8432814c2226 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:34:52 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-9020d291-17bb-4ac8-a6bb-8432814c2226 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:34:52 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-9020d291-17bb-4ac8-a6bb-8432814c2226 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:34:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9020d291-17bb-4ac8-a6bb-8432814c2226 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:34:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9020d291-17bb-4ac8-a6bb-8432814c2226 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:52 devstack sudo[104924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:34:52 devstack sudo[104924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:52 devstack sudo[104918]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4d29fa2a-2ec8-450c-aece-fd367189b52c tempest-ProjectReaderTests-1685940573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db1a3896-d60b-4728-ba95-816b310276b0 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-db1a3896-d60b-4728-ba95-816b310276b0.06edb7f0-05ce-4cd0-9265-e0f61e181829" returned: 0 in 0.823s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:52 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-4d29fa2a-2ec8-450c-aece-fd367189b52c tempest-ProjectReaderTests-1685940573 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-db1a3896-d60b-4728-ba95-816b310276b0.06edb7f0-05ce-4cd0-9265-e0f61e181829 is being set with open permissions: ugo+rw Jul 07 08:34:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4d29fa2a-2ec8-450c-aece-fd367189b52c tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-db1a3896-d60b-4728-ba95-816b310276b0.06edb7f0-05ce-4cd0-9265-e0f61e181829 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e5b197e6-d408-46b8-a884-28b335e90796 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Acquiring lock "cinder-d3dd316e-9ee4-4cfc-9e93-5450af047a63-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:34:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e5b197e6-d408-46b8-a884-28b335e90796 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "cinder-d3dd316e-9ee4-4cfc-9e93-5450af047a63-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:34:52 devstack sudo[104926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-db1a3896-d60b-4728-ba95-816b310276b0.06edb7f0-05ce-4cd0-9265-e0f61e181829 Jul 07 08:34:52 devstack sudo[104926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e5b197e6-d408-46b8-a884-28b335e90796 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Acquiring lock "cinder-quobyte-d3dd316e-9ee4-4cfc-9e93-5450af047a63" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:34:52 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e5b197e6-d408-46b8-a884-28b335e90796 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "cinder-quobyte-d3dd316e-9ee4-4cfc-9e93-5450af047a63" acquired by "delete_volume" :: waited 0.019s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:34:52 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[68095133-89ec-42f3-ae99-828129440bfd]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:34:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e5b197e6-d408-46b8-a884-28b335e90796 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d3dd316e-9ee4-4cfc-9e93-5450af047a63 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:52 devstack sudo[104928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d3dd316e-9ee4-4cfc-9e93-5450af047a63 Jul 07 08:34:52 devstack sudo[104928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:53 devstack sudo[104924]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:53 devstack sudo[104926]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9020d291-17bb-4ac8-a6bb-8432814c2226 tempest-CreateVolumesFromSnapshotTest-1959601045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 1.086s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:53 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-9020d291-17bb-4ac8-a6bb-8432814c2226 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:34:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4d29fa2a-2ec8-450c-aece-fd367189b52c tempest-ProjectReaderTests-1685940573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-db1a3896-d60b-4728-ba95-816b310276b0.06edb7f0-05ce-4cd0-9265-e0f61e181829" returned: 0 in 0.955s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:53 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-9020d291-17bb-4ac8-a6bb-8432814c2226 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Deleted volume successfully. Jul 07 08:34:53 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9020d291-17bb-4ac8-a6bb-8432814c2226 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "cinder-ba1e4c87-c34c-4043-8fc6-d78ac4670e19-delete_volume" released by "delete_volume" :: held 3.363s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:34:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4d29fa2a-2ec8-450c-aece-fd367189b52c tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-db1a3896-d60b-4728-ba95-816b310276b0.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:53 devstack sudo[104932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-db1a3896-d60b-4728-ba95-816b310276b0.info Jul 07 08:34:53 devstack sudo[104932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:53 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb9c099f-e92d-4d90-829f-bf0266019dbb tempest-CreateVolumesFromImageTest-1340750938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:34:53 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cb9c099f-e92d-4d90-829f-bf0266019dbb tempest-CreateVolumesFromImageTest-1340750938 None] Flow 'volume_create_manager' (f439032f-5260-49d8-9281-dc3cb6f5c9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:34:53 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cb9c099f-e92d-4d90-829f-bf0266019dbb tempest-CreateVolumesFromImageTest-1340750938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73529dc4-77e9-4b27-80a8-c9402417e3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:53 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cb9c099f-e92d-4d90-829f-bf0266019dbb tempest-CreateVolumesFromImageTest-1340750938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73529dc4-77e9-4b27-80a8-c9402417e3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:34:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1348810857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=129e0ae3-a6a1-4950-ab3f-add16806fdac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88246a90a4f644daadae6b8ae30b9781',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:34:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:34:54Z,use_quota=True,user_id='bd1899f11d1a4ee8b258cb23308f7a47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:53 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cb9c099f-e92d-4d90-829f-bf0266019dbb tempest-CreateVolumesFromImageTest-1340750938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb9b232a-8946-4315-9b72-dca3ec56e3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:53 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cb9c099f-e92d-4d90-829f-bf0266019dbb tempest-CreateVolumesFromImageTest-1340750938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb9b232a-8946-4315-9b72-dca3ec56e3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:53 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cb9c099f-e92d-4d90-829f-bf0266019dbb tempest-CreateVolumesFromImageTest-1340750938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50c44509-3d51-4000-bdf3-f2693a53b27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:53 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cb9c099f-e92d-4d90-829f-bf0266019dbb tempest-CreateVolumesFromImageTest-1340750938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50c44509-3d51-4000-bdf3-f2693a53b27c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '129e0ae3-a6a1-4950-ab3f-add16806fdac', 'volume_name': 'volume-129e0ae3-a6a1-4950-ab3f-add16806fdac', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:53 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cb9c099f-e92d-4d90-829f-bf0266019dbb tempest-CreateVolumesFromImageTest-1340750938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d993d47-efa4-44c4-9fee-368b7beeb869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:53 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cb9c099f-e92d-4d90-829f-bf0266019dbb tempest-CreateVolumesFromImageTest-1340750938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d993d47-efa4-44c4-9fee-368b7beeb869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:53 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cb9c099f-e92d-4d90-829f-bf0266019dbb tempest-CreateVolumesFromImageTest-1340750938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (978f6e49-821a-4aba-b346-f92497601272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:53 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-cb9c099f-e92d-4d90-829f-bf0266019dbb tempest-CreateVolumesFromImageTest-1340750938 None] Volume 129e0ae3-a6a1-4950-ab3f-add16806fdac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-129e0ae3-a6a1-4950-ab3f-add16806fdac', 'volume_size': 1} Jul 07 08:34:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cb9c099f-e92d-4d90-829f-bf0266019dbb tempest-CreateVolumesFromImageTest-1340750938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:34:54 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-33a1007c-dfb9-4163-ab94-014211048522 tempest-CinderUnicodeTest-1096390883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:34:54 devstack sudo[104928]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-33a1007c-dfb9-4163-ab94-014211048522 tempest-CinderUnicodeTest-1096390883 None] Flow 'volume_create_manager' (514a9c98-8d21-4373-b504-50eea550c530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:34:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-33a1007c-dfb9-4163-ab94-014211048522 tempest-CinderUnicodeTest-1096390883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dec26d4-3060-43c5-b207-41088d5b915e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e5b197e6-d408-46b8-a884-28b335e90796 tempest-CreateVolumesFromSnapshotTest-1959601045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d3dd316e-9ee4-4cfc-9e93-5450af047a63" returned: 0 in 1.478s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e5b197e6-d408-46b8-a884-28b335e90796 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d3dd316e-9ee4-4cfc-9e93-5450af047a63 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-33a1007c-dfb9-4163-ab94-014211048522 tempest-CinderUnicodeTest-1096390883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dec26d4-3060-43c5-b207-41088d5b915e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:34:54Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=619e8c15-919b-4c1e-b3a6-c109cc77a55f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa4e62a2e3cf47a38703bcebc231b757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:34:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:34:54Z,use_quota=True,user_id='98c81998db8c4f0092049bff367318d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:54 devstack sudo[104937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d3dd316e-9ee4-4cfc-9e93-5450af047a63 Jul 07 08:34:54 devstack sudo[104937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-33a1007c-dfb9-4163-ab94-014211048522 tempest-CinderUnicodeTest-1096390883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdecae90-0e54-45ab-9442-31c072868c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-33a1007c-dfb9-4163-ab94-014211048522 tempest-CinderUnicodeTest-1096390883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdecae90-0e54-45ab-9442-31c072868c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-33a1007c-dfb9-4163-ab94-014211048522 tempest-CinderUnicodeTest-1096390883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c4a61fd-2e9e-4bed-a978-143e0ff32b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-33a1007c-dfb9-4163-ab94-014211048522 tempest-CinderUnicodeTest-1096390883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c4a61fd-2e9e-4bed-a978-143e0ff32b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '619e8c15-919b-4c1e-b3a6-c109cc77a55f', 'volume_name': 'volume-619e8c15-919b-4c1e-b3a6-c109cc77a55f', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-33a1007c-dfb9-4163-ab94-014211048522 tempest-CinderUnicodeTest-1096390883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (610be700-932d-436c-b10b-809057dab4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-33a1007c-dfb9-4163-ab94-014211048522 tempest-CinderUnicodeTest-1096390883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (610be700-932d-436c-b10b-809057dab4af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-33a1007c-dfb9-4163-ab94-014211048522 tempest-CinderUnicodeTest-1096390883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (364d92ae-5567-427e-9708-ee5df2b88a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:54 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-33a1007c-dfb9-4163-ab94-014211048522 tempest-CinderUnicodeTest-1096390883 None] Volume 619e8c15-919b-4c1e-b3a6-c109cc77a55f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-619e8c15-919b-4c1e-b3a6-c109cc77a55f', 'volume_size': 1} Jul 07 08:34:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-33a1007c-dfb9-4163-ab94-014211048522 tempest-CinderUnicodeTest-1096390883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:34:54 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-abd5bd25-0f76-4f43-9ce8-8bbeedf0c58c tempest-CreateVolumesFromImageTest-1340750938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:34:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-abd5bd25-0f76-4f43-9ce8-8bbeedf0c58c tempest-CreateVolumesFromImageTest-1340750938 None] Flow 'volume_create_manager' (f9551e31-d935-4241-873e-661ab075ed78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:34:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-abd5bd25-0f76-4f43-9ce8-8bbeedf0c58c tempest-CreateVolumesFromImageTest-1340750938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f0da04f-8dd6-41ed-8785-db5ed1ff7f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-abd5bd25-0f76-4f43-9ce8-8bbeedf0c58c tempest-CreateVolumesFromImageTest-1340750938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f0da04f-8dd6-41ed-8785-db5ed1ff7f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:34:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-799877575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26996f84-b29d-4573-aff6-de8ef8a1491b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88246a90a4f644daadae6b8ae30b9781',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:34:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:34:54Z,use_quota=True,user_id='bd1899f11d1a4ee8b258cb23308f7a47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-abd5bd25-0f76-4f43-9ce8-8bbeedf0c58c tempest-CreateVolumesFromImageTest-1340750938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9688abf-5e72-478b-9697-f53cb523e285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-abd5bd25-0f76-4f43-9ce8-8bbeedf0c58c tempest-CreateVolumesFromImageTest-1340750938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9688abf-5e72-478b-9697-f53cb523e285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-abd5bd25-0f76-4f43-9ce8-8bbeedf0c58c tempest-CreateVolumesFromImageTest-1340750938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00993e1c-8fc7-4090-94d9-4c43f1f2c269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-abd5bd25-0f76-4f43-9ce8-8bbeedf0c58c tempest-CreateVolumesFromImageTest-1340750938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00993e1c-8fc7-4090-94d9-4c43f1f2c269) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26996f84-b29d-4573-aff6-de8ef8a1491b', 'volume_name': 'volume-26996f84-b29d-4573-aff6-de8ef8a1491b', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-abd5bd25-0f76-4f43-9ce8-8bbeedf0c58c tempest-CreateVolumesFromImageTest-1340750938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a27310f-6539-4c1c-9dee-93b0d56b6b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-abd5bd25-0f76-4f43-9ce8-8bbeedf0c58c tempest-CreateVolumesFromImageTest-1340750938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a27310f-6539-4c1c-9dee-93b0d56b6b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-abd5bd25-0f76-4f43-9ce8-8bbeedf0c58c tempest-CreateVolumesFromImageTest-1340750938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f7752e5-292b-4a07-af2c-0089e7151bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:54 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-abd5bd25-0f76-4f43-9ce8-8bbeedf0c58c tempest-CreateVolumesFromImageTest-1340750938 None] Volume 26996f84-b29d-4573-aff6-de8ef8a1491b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26996f84-b29d-4573-aff6-de8ef8a1491b', 'volume_size': 1} Jul 07 08:34:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-abd5bd25-0f76-4f43-9ce8-8bbeedf0c58c tempest-CreateVolumesFromImageTest-1340750938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:34:54 devstack sudo[104932]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4d29fa2a-2ec8-450c-aece-fd367189b52c tempest-ProjectReaderTests-1685940573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-db1a3896-d60b-4728-ba95-816b310276b0.info" returned: 0 in 1.073s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:54 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-4d29fa2a-2ec8-450c-aece-fd367189b52c tempest-ProjectReaderTests-1685940573 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-db1a3896-d60b-4728-ba95-816b310276b0.info is being set with open permissions: ugo+rw Jul 07 08:34:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4d29fa2a-2ec8-450c-aece-fd367189b52c tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-db1a3896-d60b-4728-ba95-816b310276b0.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:54 devstack sudo[104940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-db1a3896-d60b-4728-ba95-816b310276b0.info Jul 07 08:34:54 devstack sudo[104940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:54 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9881481-824c-4c19-b176-f24c7a4dd2c8 tempest-CreateVolumesFromImageTest-1340750938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:34:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a9881481-824c-4c19-b176-f24c7a4dd2c8 tempest-CreateVolumesFromImageTest-1340750938 None] Flow 'volume_create_manager' (b5d6a896-a4c8-40f1-8191-1394f238706a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:34:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a9881481-824c-4c19-b176-f24c7a4dd2c8 tempest-CreateVolumesFromImageTest-1340750938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f210d5bd-6f0f-424d-88a3-cbe708ad6d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a9881481-824c-4c19-b176-f24c7a4dd2c8 tempest-CreateVolumesFromImageTest-1340750938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f210d5bd-6f0f-424d-88a3-cbe708ad6d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:34:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1964967329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b8f51f6-95db-451f-9368-2ea137c813e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88246a90a4f644daadae6b8ae30b9781',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:34:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:34:55Z,use_quota=True,user_id='bd1899f11d1a4ee8b258cb23308f7a47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a9881481-824c-4c19-b176-f24c7a4dd2c8 tempest-CreateVolumesFromImageTest-1340750938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a1a75d0-8156-4a9d-8af0-24afb4fc48ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a9881481-824c-4c19-b176-f24c7a4dd2c8 tempest-CreateVolumesFromImageTest-1340750938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a1a75d0-8156-4a9d-8af0-24afb4fc48ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a9881481-824c-4c19-b176-f24c7a4dd2c8 tempest-CreateVolumesFromImageTest-1340750938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a02dbe8d-fd0e-417a-8143-98db5b57ea49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a9881481-824c-4c19-b176-f24c7a4dd2c8 tempest-CreateVolumesFromImageTest-1340750938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a02dbe8d-fd0e-417a-8143-98db5b57ea49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b8f51f6-95db-451f-9368-2ea137c813e4', 'volume_name': 'volume-8b8f51f6-95db-451f-9368-2ea137c813e4', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a9881481-824c-4c19-b176-f24c7a4dd2c8 tempest-CreateVolumesFromImageTest-1340750938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de7d6466-ea11-47b7-b2c4-fd8bae3d2069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a9881481-824c-4c19-b176-f24c7a4dd2c8 tempest-CreateVolumesFromImageTest-1340750938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de7d6466-ea11-47b7-b2c4-fd8bae3d2069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a9881481-824c-4c19-b176-f24c7a4dd2c8 tempest-CreateVolumesFromImageTest-1340750938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c19f08d2-5edd-441b-8786-ff50053583c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:54 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-a9881481-824c-4c19-b176-f24c7a4dd2c8 tempest-CreateVolumesFromImageTest-1340750938 None] Volume 8b8f51f6-95db-451f-9368-2ea137c813e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b8f51f6-95db-451f-9368-2ea137c813e4', 'volume_size': 1} Jul 07 08:34:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a9881481-824c-4c19-b176-f24c7a4dd2c8 tempest-CreateVolumesFromImageTest-1340750938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:34:55 devstack sudo[104937]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e5b197e6-d408-46b8-a884-28b335e90796 tempest-CreateVolumesFromSnapshotTest-1959601045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d3dd316e-9ee4-4cfc-9e93-5450af047a63" returned: 0 in 0.897s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:55 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e5b197e6-d408-46b8-a884-28b335e90796 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "cinder-quobyte-d3dd316e-9ee4-4cfc-9e93-5450af047a63" released by "delete_volume" :: held 2.426s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:34:55 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-e5b197e6-d408-46b8-a884-28b335e90796 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Created reservations ['63b7ff85-f5c9-4644-add1-c472f3ced3ee', '1144f9be-8419-4530-b647-97f9ed63db3a', 'f8c922e2-46a5-439b-82b6-10791b43b6ed', '29a8ae1e-ce5a-4c09-9543-60ba7ee03a51'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:34:55 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-04ca3511-8f60-4718-8157-62ca15b53395 tempest-CreateVolumesFromImageTest-1340750938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:34:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-04ca3511-8f60-4718-8157-62ca15b53395 tempest-CreateVolumesFromImageTest-1340750938 None] Flow 'volume_create_manager' (f1381d86-eec8-4fe9-a82c-76ef4ad85f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:34:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-04ca3511-8f60-4718-8157-62ca15b53395 tempest-CreateVolumesFromImageTest-1340750938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeaf23ea-524c-4732-939f-17830bfe689d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-04ca3511-8f60-4718-8157-62ca15b53395 tempest-CreateVolumesFromImageTest-1340750938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeaf23ea-524c-4732-939f-17830bfe689d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:34:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1591427095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b06aaeec-6bbb-46db-9c1e-49cf401ec153,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88246a90a4f644daadae6b8ae30b9781',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:34:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:34:55Z,use_quota=True,user_id='bd1899f11d1a4ee8b258cb23308f7a47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-04ca3511-8f60-4718-8157-62ca15b53395 tempest-CreateVolumesFromImageTest-1340750938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (690cc978-d51a-45dd-8b67-2e8b72626944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-04ca3511-8f60-4718-8157-62ca15b53395 tempest-CreateVolumesFromImageTest-1340750938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (690cc978-d51a-45dd-8b67-2e8b72626944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-04ca3511-8f60-4718-8157-62ca15b53395 tempest-CreateVolumesFromImageTest-1340750938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6257004b-88bd-420e-9b27-585624d827a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-04ca3511-8f60-4718-8157-62ca15b53395 tempest-CreateVolumesFromImageTest-1340750938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6257004b-88bd-420e-9b27-585624d827a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b06aaeec-6bbb-46db-9c1e-49cf401ec153', 'volume_name': 'volume-b06aaeec-6bbb-46db-9c1e-49cf401ec153', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-04ca3511-8f60-4718-8157-62ca15b53395 tempest-CreateVolumesFromImageTest-1340750938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0fea751-93e7-4050-a06b-0a5dcbe06922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-04ca3511-8f60-4718-8157-62ca15b53395 tempest-CreateVolumesFromImageTest-1340750938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0fea751-93e7-4050-a06b-0a5dcbe06922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-04ca3511-8f60-4718-8157-62ca15b53395 tempest-CreateVolumesFromImageTest-1340750938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8dd8466-9904-49c6-b337-1b1fbe50b35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:55 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-04ca3511-8f60-4718-8157-62ca15b53395 tempest-CreateVolumesFromImageTest-1340750938 None] Volume b06aaeec-6bbb-46db-9c1e-49cf401ec153: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b06aaeec-6bbb-46db-9c1e-49cf401ec153', 'volume_size': 1} Jul 07 08:34:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-04ca3511-8f60-4718-8157-62ca15b53395 tempest-CreateVolumesFromImageTest-1340750938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:34:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e5b197e6-d408-46b8-a884-28b335e90796 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:34:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e5b197e6-d408-46b8-a884-28b335e90796 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:34:55 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e5b197e6-d408-46b8-a884-28b335e90796 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:34:55 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e5b197e6-d408-46b8-a884-28b335e90796 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:34:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e5b197e6-d408-46b8-a884-28b335e90796 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:34:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e5b197e6-d408-46b8-a884-28b335e90796 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:55 devstack sudo[104944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:34:55 devstack sudo[104944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:55 devstack sudo[104940]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:55 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e7d804d-f11a-4875-8f83-93f40dc9103a tempest-CreateVolumesFromImageTest-1340750938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:34:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3e7d804d-f11a-4875-8f83-93f40dc9103a tempest-CreateVolumesFromImageTest-1340750938 None] Flow 'volume_create_manager' (ae699fe7-8202-429f-8e48-590bf6a57526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:34:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3e7d804d-f11a-4875-8f83-93f40dc9103a tempest-CreateVolumesFromImageTest-1340750938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b51982f-ebbe-4e0e-8ce5-c6782b9b501e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4d29fa2a-2ec8-450c-aece-fd367189b52c tempest-ProjectReaderTests-1685940573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-db1a3896-d60b-4728-ba95-816b310276b0.info" returned: 0 in 0.866s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4d29fa2a-2ec8-450c-aece-fd367189b52c tempest-ProjectReaderTests-1685940573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:34:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cb9c099f-e92d-4d90-829f-bf0266019dbb tempest-CreateVolumesFromImageTest-1340750938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.505s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:34:55 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-cb9c099f-e92d-4d90-829f-bf0266019dbb tempest-CreateVolumesFromImageTest-1340750938 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:34:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1348810857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=129e0ae3-a6a1-4950-ab3f-add16806fdac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88246a90a4f644daadae6b8ae30b9781',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:34:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:34:54Z,use_quota=True,user_id='bd1899f11d1a4ee8b258cb23308f7a47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:34:55 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-cb9c099f-e92d-4d90-829f-bf0266019dbb tempest-CreateVolumesFromImageTest-1340750938 None] Creating volume 129e0ae3-a6a1-4950-ab3f-add16806fdac {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:34:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cb9c099f-e92d-4d90-829f-bf0266019dbb tempest-CreateVolumesFromImageTest-1340750938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:34:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cb9c099f-e92d-4d90-829f-bf0266019dbb tempest-CreateVolumesFromImageTest-1340750938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:34:55 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-cb9c099f-e92d-4d90-829f-bf0266019dbb tempest-CreateVolumesFromImageTest-1340750938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:34:55 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-cb9c099f-e92d-4d90-829f-bf0266019dbb tempest-CreateVolumesFromImageTest-1340750938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:34:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cb9c099f-e92d-4d90-829f-bf0266019dbb tempest-CreateVolumesFromImageTest-1340750938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:34:55 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-cb9c099f-e92d-4d90-829f-bf0266019dbb tempest-CreateVolumesFromImageTest-1340750938 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:34:55 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-cb9c099f-e92d-4d90-829f-bf0266019dbb tempest-CreateVolumesFromImageTest-1340750938 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:34:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cb9c099f-e92d-4d90-829f-bf0266019dbb tempest-CreateVolumesFromImageTest-1340750938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-129e0ae3-a6a1-4950-ab3f-add16806fdac 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3e7d804d-f11a-4875-8f83-93f40dc9103a tempest-CreateVolumesFromImageTest-1340750938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b51982f-ebbe-4e0e-8ce5-c6782b9b501e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:34:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1022546713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87afaa7e-721e-4571-9cad-aa338b62c82c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88246a90a4f644daadae6b8ae30b9781',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:34:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:34:55Z,use_quota=True,user_id='bd1899f11d1a4ee8b258cb23308f7a47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:55 devstack sudo[104946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-129e0ae3-a6a1-4950-ab3f-add16806fdac 1073741824 Jul 07 08:34:55 devstack sudo[104946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3e7d804d-f11a-4875-8f83-93f40dc9103a tempest-CreateVolumesFromImageTest-1340750938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ef64040-3023-40a8-940f-06f7c1bdbe27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3e7d804d-f11a-4875-8f83-93f40dc9103a tempest-CreateVolumesFromImageTest-1340750938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ef64040-3023-40a8-940f-06f7c1bdbe27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3e7d804d-f11a-4875-8f83-93f40dc9103a tempest-CreateVolumesFromImageTest-1340750938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d72d119c-75a9-4880-b453-2bcbcdde0a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3e7d804d-f11a-4875-8f83-93f40dc9103a tempest-CreateVolumesFromImageTest-1340750938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d72d119c-75a9-4880-b453-2bcbcdde0a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87afaa7e-721e-4571-9cad-aa338b62c82c', 'volume_name': 'volume-87afaa7e-721e-4571-9cad-aa338b62c82c', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3e7d804d-f11a-4875-8f83-93f40dc9103a tempest-CreateVolumesFromImageTest-1340750938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d32691fe-b5fe-4363-9cad-590332c276eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3e7d804d-f11a-4875-8f83-93f40dc9103a tempest-CreateVolumesFromImageTest-1340750938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d32691fe-b5fe-4363-9cad-590332c276eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:55 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3e7d804d-f11a-4875-8f83-93f40dc9103a tempest-CreateVolumesFromImageTest-1340750938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c4bb2e6-b9ea-49f7-958b-b8cc6681f2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:55 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-3e7d804d-f11a-4875-8f83-93f40dc9103a tempest-CreateVolumesFromImageTest-1340750938 None] Volume 87afaa7e-721e-4571-9cad-aa338b62c82c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87afaa7e-721e-4571-9cad-aa338b62c82c', 'volume_size': 1} Jul 07 08:34:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3e7d804d-f11a-4875-8f83-93f40dc9103a tempest-CreateVolumesFromImageTest-1340750938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:34:55 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-4d29fa2a-2ec8-450c-aece-fd367189b52c tempest-ProjectReaderTests-1685940573 None] Create snapshot completed successfully Jul 07 08:34:55 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-61874b66-d108-47ed-99b5-f157adb99c5f tempest-ProjectReaderTests-1685940573 None] Acquiring lock "cinder-06edb7f0-05ce-4cd0-9265-e0f61e181829-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:34:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-61874b66-d108-47ed-99b5-f157adb99c5f tempest-ProjectReaderTests-1685940573 None] Lock "cinder-06edb7f0-05ce-4cd0-9265-e0f61e181829-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:34:56 devstack sudo[104944]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-61874b66-d108-47ed-99b5-f157adb99c5f tempest-ProjectReaderTests-1685940573 None] Acquiring lock "cinder-quobyte-db1a3896-d60b-4728-ba95-816b310276b0" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:34:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e5b197e6-d408-46b8-a884-28b335e90796 tempest-CreateVolumesFromSnapshotTest-1959601045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.703s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:56 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-e5b197e6-d408-46b8-a884-28b335e90796 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:34:56 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-e5b197e6-d408-46b8-a884-28b335e90796 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Deleted volume successfully. Jul 07 08:34:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-61874b66-d108-47ed-99b5-f157adb99c5f tempest-ProjectReaderTests-1685940573 None] Lock "cinder-quobyte-db1a3896-d60b-4728-ba95-816b310276b0" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:34:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-61874b66-d108-47ed-99b5-f157adb99c5f tempest-ProjectReaderTests-1685940573 None] Acquiring lock "cinder-quobyte-06edb7f0-05ce-4cd0-9265-e0f61e181829" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:34:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e5b197e6-d408-46b8-a884-28b335e90796 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "cinder-d3dd316e-9ee4-4cfc-9e93-5450af047a63-delete_volume" released by "delete_volume" :: held 3.480s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:34:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-61874b66-d108-47ed-99b5-f157adb99c5f tempest-ProjectReaderTests-1685940573 None] Lock "cinder-quobyte-06edb7f0-05ce-4cd0-9265-e0f61e181829" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:34:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-61874b66-d108-47ed-99b5-f157adb99c5f tempest-ProjectReaderTests-1685940573 None] Deleting offline snapshot 06edb7f0-05ce-4cd0-9265-e0f61e181829 of volume db1a3896-d60b-4728-ba95-816b310276b0 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:34:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-61874b66-d108-47ed-99b5-f157adb99c5f tempest-ProjectReaderTests-1685940573 None] snapshot_file for this snap is: volume-db1a3896-d60b-4728-ba95-816b310276b0.06edb7f0-05ce-4cd0-9265-e0f61e181829 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:34:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-80f8bf18-f2ad-4ee7-ad26-1616c2d8ddd8 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Acquiring lock "cinder-c4001870-4716-4aaf-a040-6474e605031b-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:34:56 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e5c716-7838-42e2-a0e6-831021ca902c]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:34:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-61874b66-d108-47ed-99b5-f157adb99c5f tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-db1a3896-d60b-4728-ba95-816b310276b0.06edb7f0-05ce-4cd0-9265-e0f61e181829 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-80f8bf18-f2ad-4ee7-ad26-1616c2d8ddd8 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "cinder-c4001870-4716-4aaf-a040-6474e605031b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:34:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-80f8bf18-f2ad-4ee7-ad26-1616c2d8ddd8 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Acquiring lock "cinder-quobyte-c4001870-4716-4aaf-a040-6474e605031b" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:34:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-80f8bf18-f2ad-4ee7-ad26-1616c2d8ddd8 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "cinder-quobyte-c4001870-4716-4aaf-a040-6474e605031b" acquired by "delete_volume" :: waited 0.024s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:34:56 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e660679-1bf7-4c66-bdf3-cb3f408fc706]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:34:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-80f8bf18-f2ad-4ee7-ad26-1616c2d8ddd8 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c4001870-4716-4aaf-a040-6474e605031b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:56 devstack sudo[104952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-db1a3896-d60b-4728-ba95-816b310276b0.06edb7f0-05ce-4cd0-9265-e0f61e181829 Jul 07 08:34:56 devstack sudo[104952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:56 devstack sudo[104953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c4001870-4716-4aaf-a040-6474e605031b Jul 07 08:34:56 devstack sudo[104953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:56 devstack sudo[104946]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cb9c099f-e92d-4d90-829f-bf0266019dbb tempest-CreateVolumesFromImageTest-1340750938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-129e0ae3-a6a1-4950-ab3f-add16806fdac 1073741824" returned: 0 in 0.934s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cb9c099f-e92d-4d90-829f-bf0266019dbb tempest-CreateVolumesFromImageTest-1340750938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-129e0ae3-a6a1-4950-ab3f-add16806fdac {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:56 devstack sudo[104956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-129e0ae3-a6a1-4950-ab3f-add16806fdac Jul 07 08:34:56 devstack sudo[104956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:57 devstack sudo[104952]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-61874b66-d108-47ed-99b5-f157adb99c5f tempest-ProjectReaderTests-1685940573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-db1a3896-d60b-4728-ba95-816b310276b0.06edb7f0-05ce-4cd0-9265-e0f61e181829" returned: 0 in 0.880s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-61874b66-d108-47ed-99b5-f157adb99c5f tempest-ProjectReaderTests-1685940573 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db1a3896-d60b-4728-ba95-816b310276b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:34:57 devstack sudo[104953]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-80f8bf18-f2ad-4ee7-ad26-1616c2d8ddd8 tempest-CreateVolumesFromSnapshotTest-1959601045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c4001870-4716-4aaf-a040-6474e605031b" returned: 0 in 0.794s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-80f8bf18-f2ad-4ee7-ad26-1616c2d8ddd8 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c4001870-4716-4aaf-a040-6474e605031b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:57 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[98556f68-ec5a-4455-9dfb-f90e4ffb9e8f]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:34:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-61874b66-d108-47ed-99b5-f157adb99c5f tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-db1a3896-d60b-4728-ba95-816b310276b0 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:57 devstack sudo[104965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c4001870-4716-4aaf-a040-6474e605031b Jul 07 08:34:57 devstack sudo[104965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:57 devstack sudo[104956]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cb9c099f-e92d-4d90-829f-bf0266019dbb tempest-CreateVolumesFromImageTest-1340750938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-129e0ae3-a6a1-4950-ab3f-add16806fdac" returned: 0 in 0.702s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-cb9c099f-e92d-4d90-829f-bf0266019dbb tempest-CreateVolumesFromImageTest-1340750938 None] <== create_volume: return (1682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:34:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cb9c099f-e92d-4d90-829f-bf0266019dbb tempest-CreateVolumesFromImageTest-1340750938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.686s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:34:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-33a1007c-dfb9-4163-ab94-014211048522 tempest-CinderUnicodeTest-1096390883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.937s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:34:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-33a1007c-dfb9-4163-ab94-014211048522 tempest-CinderUnicodeTest-1096390883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:34:54Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=619e8c15-919b-4c1e-b3a6-c109cc77a55f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa4e62a2e3cf47a38703bcebc231b757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:34:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:34:54Z,use_quota=True,user_id='98c81998db8c4f0092049bff367318d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:34:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-33a1007c-dfb9-4163-ab94-014211048522 tempest-CinderUnicodeTest-1096390883 None] Creating volume 619e8c15-919b-4c1e-b3a6-c109cc77a55f {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:34:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-33a1007c-dfb9-4163-ab94-014211048522 tempest-CinderUnicodeTest-1096390883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:34:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-33a1007c-dfb9-4163-ab94-014211048522 tempest-CinderUnicodeTest-1096390883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:34:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-33a1007c-dfb9-4163-ab94-014211048522 tempest-CinderUnicodeTest-1096390883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:34:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-33a1007c-dfb9-4163-ab94-014211048522 tempest-CinderUnicodeTest-1096390883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:34:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-33a1007c-dfb9-4163-ab94-014211048522 tempest-CinderUnicodeTest-1096390883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:34:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-33a1007c-dfb9-4163-ab94-014211048522 tempest-CinderUnicodeTest-1096390883 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:34:57 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-33a1007c-dfb9-4163-ab94-014211048522 tempest-CinderUnicodeTest-1096390883 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:34:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-33a1007c-dfb9-4163-ab94-014211048522 tempest-CinderUnicodeTest-1096390883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-619e8c15-919b-4c1e-b3a6-c109cc77a55f 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:57 devstack sudo[104966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-db1a3896-d60b-4728-ba95-816b310276b0 Jul 07 08:34:57 devstack sudo[104966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:57 devstack sudo[104968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-619e8c15-919b-4c1e-b3a6-c109cc77a55f 1073741824 Jul 07 08:34:57 devstack sudo[104968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cb9c099f-e92d-4d90-829f-bf0266019dbb tempest-CreateVolumesFromImageTest-1340750938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (978f6e49-821a-4aba-b346-f92497601272) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-129e0ae3-a6a1-4950-ab3f-add16806fdac', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cb9c099f-e92d-4d90-829f-bf0266019dbb tempest-CreateVolumesFromImageTest-1340750938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3f4cc2e-25c2-48c2-9333-1b9430fceac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:57 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-cb9c099f-e92d-4d90-829f-bf0266019dbb tempest-CreateVolumesFromImageTest-1340750938 None] Volume volume-129e0ae3-a6a1-4950-ab3f-add16806fdac (129e0ae3-a6a1-4950-ab3f-add16806fdac): created successfully Jul 07 08:34:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cb9c099f-e92d-4d90-829f-bf0266019dbb tempest-CreateVolumesFromImageTest-1340750938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3f4cc2e-25c2-48c2-9333-1b9430fceac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:57 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cb9c099f-e92d-4d90-829f-bf0266019dbb tempest-CreateVolumesFromImageTest-1340750938 None] Flow 'volume_create_manager' (f439032f-5260-49d8-9281-dc3cb6f5c9b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:34:57 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-cb9c099f-e92d-4d90-829f-bf0266019dbb tempest-CreateVolumesFromImageTest-1340750938 None] Created volume successfully. Jul 07 08:34:57 devstack sudo[104965]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-80f8bf18-f2ad-4ee7-ad26-1616c2d8ddd8 tempest-CreateVolumesFromSnapshotTest-1959601045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c4001870-4716-4aaf-a040-6474e605031b" returned: 0 in 0.774s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:57 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-80f8bf18-f2ad-4ee7-ad26-1616c2d8ddd8 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "cinder-quobyte-c4001870-4716-4aaf-a040-6474e605031b" released by "delete_volume" :: held 1.612s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:34:57 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-80f8bf18-f2ad-4ee7-ad26-1616c2d8ddd8 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Created reservations ['c9e746f6-0231-4018-b5bc-f4ca9050a616', '914d99d3-70da-4f5f-b888-8da6925b7d02', '2a2a9f8b-98c2-48c7-a64e-ce783e419f64', '255bd571-b7cf-47e0-a312-b52e41e80869'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:34:57 devstack sudo[104966]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-61874b66-d108-47ed-99b5-f157adb99c5f tempest-ProjectReaderTests-1685940573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-db1a3896-d60b-4728-ba95-816b310276b0" returned: 0 in 0.845s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-61874b66-d108-47ed-99b5-f157adb99c5f tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-db1a3896-d60b-4728-ba95-816b310276b0.06edb7f0-05ce-4cd0-9265-e0f61e181829 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:57 devstack sudo[104979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-db1a3896-d60b-4728-ba95-816b310276b0.06edb7f0-05ce-4cd0-9265-e0f61e181829 Jul 07 08:34:57 devstack sudo[104979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-80f8bf18-f2ad-4ee7-ad26-1616c2d8ddd8 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:34:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-80f8bf18-f2ad-4ee7-ad26-1616c2d8ddd8 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:34:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-80f8bf18-f2ad-4ee7-ad26-1616c2d8ddd8 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:34:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-80f8bf18-f2ad-4ee7-ad26-1616c2d8ddd8 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:34:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-80f8bf18-f2ad-4ee7-ad26-1616c2d8ddd8 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:34:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-80f8bf18-f2ad-4ee7-ad26-1616c2d8ddd8 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:58 devstack sudo[104981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:34:58 devstack sudo[104981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:58 devstack sudo[104968]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-33a1007c-dfb9-4163-ab94-014211048522 tempest-CinderUnicodeTest-1096390883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-619e8c15-919b-4c1e-b3a6-c109cc77a55f 1073741824" returned: 0 in 0.944s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-33a1007c-dfb9-4163-ab94-014211048522 tempest-CinderUnicodeTest-1096390883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-619e8c15-919b-4c1e-b3a6-c109cc77a55f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:58 devstack sudo[104983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-619e8c15-919b-4c1e-b3a6-c109cc77a55f Jul 07 08:34:58 devstack sudo[104983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:58 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-36b06866-cf4d-4834-a834-2577479c97e6 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Acquiring lock "cinder-8c42a951-01db-4eda-ae89-ff532feebcd9-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:34:58 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-36b06866-cf4d-4834-a834-2577479c97e6 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "cinder-8c42a951-01db-4eda-ae89-ff532feebcd9-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:34:58 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-36b06866-cf4d-4834-a834-2577479c97e6 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Acquiring lock "cinder-quobyte-8c42a951-01db-4eda-ae89-ff532feebcd9" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:34:58 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-36b06866-cf4d-4834-a834-2577479c97e6 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "cinder-quobyte-8c42a951-01db-4eda-ae89-ff532feebcd9" acquired by "delete_volume" :: waited 0.018s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:34:58 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5b7a9f-5b7d-4761-a548-6b4c5182a62e]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:34:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-36b06866-cf4d-4834-a834-2577479c97e6 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8c42a951-01db-4eda-ae89-ff532feebcd9 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:58 devstack sudo[104981]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-80f8bf18-f2ad-4ee7-ad26-1616c2d8ddd8 tempest-CreateVolumesFromSnapshotTest-1959601045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.728s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:58 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-80f8bf18-f2ad-4ee7-ad26-1616c2d8ddd8 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:34:58 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-80f8bf18-f2ad-4ee7-ad26-1616c2d8ddd8 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Deleted volume successfully. Jul 07 08:34:58 devstack sudo[104989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8c42a951-01db-4eda-ae89-ff532feebcd9 Jul 07 08:34:58 devstack sudo[104989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:58 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-80f8bf18-f2ad-4ee7-ad26-1616c2d8ddd8 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "cinder-c4001870-4716-4aaf-a040-6474e605031b-delete_volume" released by "delete_volume" :: held 2.597s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:34:58 devstack sudo[104979]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-61874b66-d108-47ed-99b5-f157adb99c5f tempest-ProjectReaderTests-1685940573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-db1a3896-d60b-4728-ba95-816b310276b0.06edb7f0-05ce-4cd0-9265-e0f61e181829" returned: 0 in 0.870s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-61874b66-d108-47ed-99b5-f157adb99c5f tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-db1a3896-d60b-4728-ba95-816b310276b0.06edb7f0-05ce-4cd0-9265-e0f61e181829 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:58 devstack sudo[104992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-db1a3896-d60b-4728-ba95-816b310276b0.06edb7f0-05ce-4cd0-9265-e0f61e181829 Jul 07 08:34:58 devstack sudo[104992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:58 devstack sudo[104983]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-33a1007c-dfb9-4163-ab94-014211048522 tempest-CinderUnicodeTest-1096390883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-619e8c15-919b-4c1e-b3a6-c109cc77a55f" returned: 0 in 0.755s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-33a1007c-dfb9-4163-ab94-014211048522 tempest-CinderUnicodeTest-1096390883 None] <== create_volume: return (1743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:34:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-33a1007c-dfb9-4163-ab94-014211048522 tempest-CinderUnicodeTest-1096390883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.746s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:34:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-abd5bd25-0f76-4f43-9ce8-8bbeedf0c58c tempest-CreateVolumesFromImageTest-1340750938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.503s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:34:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-abd5bd25-0f76-4f43-9ce8-8bbeedf0c58c tempest-CreateVolumesFromImageTest-1340750938 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:34:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-799877575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26996f84-b29d-4573-aff6-de8ef8a1491b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88246a90a4f644daadae6b8ae30b9781',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:34:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:34:54Z,use_quota=True,user_id='bd1899f11d1a4ee8b258cb23308f7a47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:34:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-abd5bd25-0f76-4f43-9ce8-8bbeedf0c58c tempest-CreateVolumesFromImageTest-1340750938 None] Creating volume 26996f84-b29d-4573-aff6-de8ef8a1491b {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:34:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-abd5bd25-0f76-4f43-9ce8-8bbeedf0c58c tempest-CreateVolumesFromImageTest-1340750938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:34:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-abd5bd25-0f76-4f43-9ce8-8bbeedf0c58c tempest-CreateVolumesFromImageTest-1340750938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:34:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-abd5bd25-0f76-4f43-9ce8-8bbeedf0c58c tempest-CreateVolumesFromImageTest-1340750938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:34:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-abd5bd25-0f76-4f43-9ce8-8bbeedf0c58c tempest-CreateVolumesFromImageTest-1340750938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:34:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-abd5bd25-0f76-4f43-9ce8-8bbeedf0c58c tempest-CreateVolumesFromImageTest-1340750938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:34:58 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-abd5bd25-0f76-4f43-9ce8-8bbeedf0c58c tempest-CreateVolumesFromImageTest-1340750938 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:34:58 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-abd5bd25-0f76-4f43-9ce8-8bbeedf0c58c tempest-CreateVolumesFromImageTest-1340750938 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:34:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-abd5bd25-0f76-4f43-9ce8-8bbeedf0c58c tempest-CreateVolumesFromImageTest-1340750938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-26996f84-b29d-4573-aff6-de8ef8a1491b 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:58 devstack sudo[104995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-26996f84-b29d-4573-aff6-de8ef8a1491b 1073741824 Jul 07 08:34:58 devstack sudo[104995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-33a1007c-dfb9-4163-ab94-014211048522 tempest-CinderUnicodeTest-1096390883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (364d92ae-5567-427e-9708-ee5df2b88a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-619e8c15-919b-4c1e-b3a6-c109cc77a55f', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:58 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-33a1007c-dfb9-4163-ab94-014211048522 tempest-CinderUnicodeTest-1096390883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcf2f1b1-c611-41b8-9b31-8719627d668e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:58 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-33a1007c-dfb9-4163-ab94-014211048522 tempest-CinderUnicodeTest-1096390883 None] Volume volume-619e8c15-919b-4c1e-b3a6-c109cc77a55f (619e8c15-919b-4c1e-b3a6-c109cc77a55f): created successfully Jul 07 08:34:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-33a1007c-dfb9-4163-ab94-014211048522 tempest-CinderUnicodeTest-1096390883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcf2f1b1-c611-41b8-9b31-8719627d668e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:59 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-33a1007c-dfb9-4163-ab94-014211048522 tempest-CinderUnicodeTest-1096390883 None] Flow 'volume_create_manager' (514a9c98-8d21-4373-b504-50eea550c530) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:34:59 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-33a1007c-dfb9-4163-ab94-014211048522 tempest-CinderUnicodeTest-1096390883 None] Created volume successfully. Jul 07 08:34:59 devstack sudo[104989]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-36b06866-cf4d-4834-a834-2577479c97e6 tempest-CreateVolumesFromSnapshotTest-1959601045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8c42a951-01db-4eda-ae89-ff532feebcd9" returned: 0 in 0.997s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-36b06866-cf4d-4834-a834-2577479c97e6 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8c42a951-01db-4eda-ae89-ff532feebcd9 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:59 devstack sudo[104992]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:59 devstack sudo[105003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8c42a951-01db-4eda-ae89-ff532feebcd9 Jul 07 08:34:59 devstack sudo[105003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-61874b66-d108-47ed-99b5-f157adb99c5f tempest-ProjectReaderTests-1685940573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-db1a3896-d60b-4728-ba95-816b310276b0.06edb7f0-05ce-4cd0-9265-e0f61e181829" returned: 0 in 0.844s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:59 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-61874b66-d108-47ed-99b5-f157adb99c5f tempest-ProjectReaderTests-1685940573 None] Lock "cinder-quobyte-06edb7f0-05ce-4cd0-9265-e0f61e181829" released by "_delete_snapshot" :: held 3.598s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:34:59 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-61874b66-d108-47ed-99b5-f157adb99c5f tempest-ProjectReaderTests-1685940573 None] Lock "cinder-quobyte-db1a3896-d60b-4728-ba95-816b310276b0" released by "delete_snapshot" :: held 3.652s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:34:59 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-61874b66-d108-47ed-99b5-f157adb99c5f tempest-ProjectReaderTests-1685940573 None] Created reservations ['6f9ed851-df09-4398-8b1a-e2841b345eee', '72f6cb16-7268-4502-b6cf-671e8555ecc5', 'ad66e1ad-fb73-4b1b-bff8-dbf7e18920d6', 'd12edf8e-ea2c-4015-8ac6-82b8bcf7e451'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:34:59 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-61874b66-d108-47ed-99b5-f157adb99c5f tempest-ProjectReaderTests-1685940573 None] Delete snapshot completed successfully. Jul 07 08:34:59 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-61874b66-d108-47ed-99b5-f157adb99c5f tempest-ProjectReaderTests-1685940573 None] Lock "cinder-06edb7f0-05ce-4cd0-9265-e0f61e181829-delete_snapshot" released by "delete_snapshot" :: held 3.868s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:35:00 devstack sudo[104995]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-abd5bd25-0f76-4f43-9ce8-8bbeedf0c58c tempest-CreateVolumesFromImageTest-1340750938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-26996f84-b29d-4573-aff6-de8ef8a1491b 1073741824" returned: 0 in 1.069s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-abd5bd25-0f76-4f43-9ce8-8bbeedf0c58c tempest-CreateVolumesFromImageTest-1340750938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-26996f84-b29d-4573-aff6-de8ef8a1491b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:00 devstack sudo[105007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-26996f84-b29d-4573-aff6-de8ef8a1491b Jul 07 08:35:00 devstack sudo[105007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:00 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-344c86cb-a271-45d6-b8b1-a9e84aeac4d6 tempest-CinderUnicodeTest-1096390883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:35:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-344c86cb-a271-45d6-b8b1-a9e84aeac4d6 tempest-CinderUnicodeTest-1096390883 None] Flow 'volume_create_manager' (9d9e5a19-ebb2-4c4f-9629-0e4559305984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:35:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-344c86cb-a271-45d6-b8b1-a9e84aeac4d6 tempest-CinderUnicodeTest-1096390883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a894143-1041-4ca1-aac3-29417b4b6f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:35:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-344c86cb-a271-45d6-b8b1-a9e84aeac4d6 tempest-CinderUnicodeTest-1096390883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a894143-1041-4ca1-aac3-29417b4b6f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:35:00Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1070559276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61f44cf5-7f52-4341-8d39-60f92578bcb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa4e62a2e3cf47a38703bcebc231b757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:35:00Z,use_quota=True,user_id='98c81998db8c4f0092049bff367318d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:35:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-344c86cb-a271-45d6-b8b1-a9e84aeac4d6 tempest-CinderUnicodeTest-1096390883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35832573-881e-4daf-af3f-10bc86ae50a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:35:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-344c86cb-a271-45d6-b8b1-a9e84aeac4d6 tempest-CinderUnicodeTest-1096390883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35832573-881e-4daf-af3f-10bc86ae50a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:35:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-344c86cb-a271-45d6-b8b1-a9e84aeac4d6 tempest-CinderUnicodeTest-1096390883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a129ff68-8658-4417-b646-24a3a1f3e296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:35:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-344c86cb-a271-45d6-b8b1-a9e84aeac4d6 tempest-CinderUnicodeTest-1096390883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a129ff68-8658-4417-b646-24a3a1f3e296) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61f44cf5-7f52-4341-8d39-60f92578bcb3', 'volume_name': 'volume-61f44cf5-7f52-4341-8d39-60f92578bcb3', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:35:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-344c86cb-a271-45d6-b8b1-a9e84aeac4d6 tempest-CinderUnicodeTest-1096390883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11e7774f-ce85-4f3f-bad7-feb4278c481f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:35:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-344c86cb-a271-45d6-b8b1-a9e84aeac4d6 tempest-CinderUnicodeTest-1096390883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11e7774f-ce85-4f3f-bad7-feb4278c481f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:35:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-344c86cb-a271-45d6-b8b1-a9e84aeac4d6 tempest-CinderUnicodeTest-1096390883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c79af3fb-111b-4df2-97a6-6b6b72df71f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:35:00 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-344c86cb-a271-45d6-b8b1-a9e84aeac4d6 tempest-CinderUnicodeTest-1096390883 None] Volume 61f44cf5-7f52-4341-8d39-60f92578bcb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61f44cf5-7f52-4341-8d39-60f92578bcb3', 'volume_size': 1} Jul 07 08:35:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-344c86cb-a271-45d6-b8b1-a9e84aeac4d6 tempest-CinderUnicodeTest-1096390883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:35:00 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cf017154-9b60-4ceb-b695-2330a28aaa24 tempest-ProjectReaderTests-1685940573 None] Acquiring lock "cinder-db1a3896-d60b-4728-ba95-816b310276b0-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:35:00 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cf017154-9b60-4ceb-b695-2330a28aaa24 tempest-ProjectReaderTests-1685940573 None] Lock "cinder-db1a3896-d60b-4728-ba95-816b310276b0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:35:00 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cf017154-9b60-4ceb-b695-2330a28aaa24 tempest-ProjectReaderTests-1685940573 None] Acquiring lock "cinder-quobyte-db1a3896-d60b-4728-ba95-816b310276b0" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:35:00 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cf017154-9b60-4ceb-b695-2330a28aaa24 tempest-ProjectReaderTests-1685940573 None] Lock "cinder-quobyte-db1a3896-d60b-4728-ba95-816b310276b0" acquired by "delete_volume" :: waited 0.020s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:35:00 devstack sudo[105003]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:00 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c86a9a-bc23-4f7e-9242-d132afc442d3]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:35:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cf017154-9b60-4ceb-b695-2330a28aaa24 tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-db1a3896-d60b-4728-ba95-816b310276b0 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-36b06866-cf4d-4834-a834-2577479c97e6 tempest-CreateVolumesFromSnapshotTest-1959601045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8c42a951-01db-4eda-ae89-ff532feebcd9" returned: 0 in 0.815s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:00 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-36b06866-cf4d-4834-a834-2577479c97e6 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "cinder-quobyte-8c42a951-01db-4eda-ae89-ff532feebcd9" released by "delete_volume" :: held 1.857s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:35:00 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-36b06866-cf4d-4834-a834-2577479c97e6 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Created reservations ['183c6f88-52c7-4f3d-91f4-0df817d4cb2f', '9b601431-ddae-4378-bf12-51e132020015', 'afb91a40-545e-4316-a4ed-d62f5d5b9bbc', 'a0302f1e-f035-4f19-87bc-7f15297e0815'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:35:00 devstack sudo[105010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-db1a3896-d60b-4728-ba95-816b310276b0 Jul 07 08:35:00 devstack sudo[105010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-36b06866-cf4d-4834-a834-2577479c97e6 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:35:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-36b06866-cf4d-4834-a834-2577479c97e6 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:35:00 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-36b06866-cf4d-4834-a834-2577479c97e6 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:35:00 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-36b06866-cf4d-4834-a834-2577479c97e6 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:35:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-36b06866-cf4d-4834-a834-2577479c97e6 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:35:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-36b06866-cf4d-4834-a834-2577479c97e6 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:00 devstack sudo[105012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:35:00 devstack sudo[105012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:00 devstack sudo[105007]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:00 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0bf58865-6bab-4805-88ae-ff6b01363ee4 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Acquiring lock "cinder-fb953425-39c1-4dc9-941d-ecca86351e64-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:35:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-abd5bd25-0f76-4f43-9ce8-8bbeedf0c58c tempest-CreateVolumesFromImageTest-1340750938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-26996f84-b29d-4573-aff6-de8ef8a1491b" returned: 0 in 0.729s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:00 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-abd5bd25-0f76-4f43-9ce8-8bbeedf0c58c tempest-CreateVolumesFromImageTest-1340750938 None] <== create_volume: return (1859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:35:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-abd5bd25-0f76-4f43-9ce8-8bbeedf0c58c tempest-CreateVolumesFromImageTest-1340750938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.862s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:35:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a9881481-824c-4c19-b176-f24c7a4dd2c8 tempest-CreateVolumesFromImageTest-1340750938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.936s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:35:00 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a9881481-824c-4c19-b176-f24c7a4dd2c8 tempest-CreateVolumesFromImageTest-1340750938 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:34:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1964967329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b8f51f6-95db-451f-9368-2ea137c813e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88246a90a4f644daadae6b8ae30b9781',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:34:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:34:55Z,use_quota=True,user_id='bd1899f11d1a4ee8b258cb23308f7a47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:35:00 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-a9881481-824c-4c19-b176-f24c7a4dd2c8 tempest-CreateVolumesFromImageTest-1340750938 None] Creating volume 8b8f51f6-95db-451f-9368-2ea137c813e4 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:35:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a9881481-824c-4c19-b176-f24c7a4dd2c8 tempest-CreateVolumesFromImageTest-1340750938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:35:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a9881481-824c-4c19-b176-f24c7a4dd2c8 tempest-CreateVolumesFromImageTest-1340750938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:35:00 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a9881481-824c-4c19-b176-f24c7a4dd2c8 tempest-CreateVolumesFromImageTest-1340750938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:35:00 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a9881481-824c-4c19-b176-f24c7a4dd2c8 tempest-CreateVolumesFromImageTest-1340750938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:35:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a9881481-824c-4c19-b176-f24c7a4dd2c8 tempest-CreateVolumesFromImageTest-1340750938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:35:00 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a9881481-824c-4c19-b176-f24c7a4dd2c8 tempest-CreateVolumesFromImageTest-1340750938 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:35:00 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-a9881481-824c-4c19-b176-f24c7a4dd2c8 tempest-CreateVolumesFromImageTest-1340750938 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:35:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a9881481-824c-4c19-b176-f24c7a4dd2c8 tempest-CreateVolumesFromImageTest-1340750938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8b8f51f6-95db-451f-9368-2ea137c813e4 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-abd5bd25-0f76-4f43-9ce8-8bbeedf0c58c tempest-CreateVolumesFromImageTest-1340750938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f7752e5-292b-4a07-af2c-0089e7151bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26996f84-b29d-4573-aff6-de8ef8a1491b', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:35:00 devstack sudo[105015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8b8f51f6-95db-451f-9368-2ea137c813e4 1073741824 Jul 07 08:35:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-abd5bd25-0f76-4f43-9ce8-8bbeedf0c58c tempest-CreateVolumesFromImageTest-1340750938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90de258e-9d28-4e82-a8ba-ddd4a3057d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:35:00 devstack sudo[105015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:00 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0bf58865-6bab-4805-88ae-ff6b01363ee4 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "cinder-fb953425-39c1-4dc9-941d-ecca86351e64-delete_snapshot" acquired by "delete_snapshot" :: waited 0.085s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:35:00 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0bf58865-6bab-4805-88ae-ff6b01363ee4 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Acquiring lock "cinder-quobyte-87b34aea-986b-433e-adbe-7ecb7a8852fb" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:35:00 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-abd5bd25-0f76-4f43-9ce8-8bbeedf0c58c tempest-CreateVolumesFromImageTest-1340750938 None] Volume volume-26996f84-b29d-4573-aff6-de8ef8a1491b (26996f84-b29d-4573-aff6-de8ef8a1491b): created successfully Jul 07 08:35:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-abd5bd25-0f76-4f43-9ce8-8bbeedf0c58c tempest-CreateVolumesFromImageTest-1340750938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90de258e-9d28-4e82-a8ba-ddd4a3057d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:35:00 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-abd5bd25-0f76-4f43-9ce8-8bbeedf0c58c tempest-CreateVolumesFromImageTest-1340750938 None] Flow 'volume_create_manager' (f9551e31-d935-4241-873e-661ab075ed78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:35:00 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0bf58865-6bab-4805-88ae-ff6b01363ee4 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "cinder-quobyte-87b34aea-986b-433e-adbe-7ecb7a8852fb" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:35:00 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0bf58865-6bab-4805-88ae-ff6b01363ee4 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Acquiring lock "cinder-quobyte-fb953425-39c1-4dc9-941d-ecca86351e64" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:35:00 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-abd5bd25-0f76-4f43-9ce8-8bbeedf0c58c tempest-CreateVolumesFromImageTest-1340750938 None] Created volume successfully. Jul 07 08:35:00 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0bf58865-6bab-4805-88ae-ff6b01363ee4 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "cinder-quobyte-fb953425-39c1-4dc9-941d-ecca86351e64" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:35:00 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-0bf58865-6bab-4805-88ae-ff6b01363ee4 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Deleting offline snapshot fb953425-39c1-4dc9-941d-ecca86351e64 of volume 87b34aea-986b-433e-adbe-7ecb7a8852fb {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:35:00 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-0bf58865-6bab-4805-88ae-ff6b01363ee4 tempest-CreateVolumesFromSnapshotTest-1959601045 None] snapshot_file for this snap is: volume-87b34aea-986b-433e-adbe-7ecb7a8852fb.fb953425-39c1-4dc9-941d-ecca86351e64 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:35:00 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7931493-f2be-45cc-967f-9e5e4a2223c4]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:35:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0bf58865-6bab-4805-88ae-ff6b01363ee4 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87b34aea-986b-433e-adbe-7ecb7a8852fb.fb953425-39c1-4dc9-941d-ecca86351e64 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:01 devstack sudo[105017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87b34aea-986b-433e-adbe-7ecb7a8852fb.fb953425-39c1-4dc9-941d-ecca86351e64 Jul 07 08:35:01 devstack sudo[105017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:01 devstack sudo[105010]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cf017154-9b60-4ceb-b695-2330a28aaa24 tempest-ProjectReaderTests-1685940573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-db1a3896-d60b-4728-ba95-816b310276b0" returned: 0 in 0.923s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cf017154-9b60-4ceb-b695-2330a28aaa24 tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-db1a3896-d60b-4728-ba95-816b310276b0 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:01 devstack sudo[105027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-db1a3896-d60b-4728-ba95-816b310276b0 Jul 07 08:35:01 devstack sudo[105027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:01 devstack sudo[105012]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-36b06866-cf4d-4834-a834-2577479c97e6 tempest-CreateVolumesFromSnapshotTest-1959601045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.913s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:01 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-36b06866-cf4d-4834-a834-2577479c97e6 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:35:01 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-36b06866-cf4d-4834-a834-2577479c97e6 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Deleted volume successfully. Jul 07 08:35:01 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-36b06866-cf4d-4834-a834-2577479c97e6 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "cinder-8c42a951-01db-4eda-ae89-ff532feebcd9-delete_volume" released by "delete_volume" :: held 3.039s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:35:01 devstack sudo[105015]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a9881481-824c-4c19-b176-f24c7a4dd2c8 tempest-CreateVolumesFromImageTest-1340750938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8b8f51f6-95db-451f-9368-2ea137c813e4 1073741824" returned: 0 in 1.025s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a9881481-824c-4c19-b176-f24c7a4dd2c8 tempest-CreateVolumesFromImageTest-1340750938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8b8f51f6-95db-451f-9368-2ea137c813e4 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:01 devstack sudo[105017]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0bf58865-6bab-4805-88ae-ff6b01363ee4 tempest-CreateVolumesFromSnapshotTest-1959601045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87b34aea-986b-433e-adbe-7ecb7a8852fb.fb953425-39c1-4dc9-941d-ecca86351e64" returned: 0 in 0.939s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:01 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-0bf58865-6bab-4805-88ae-ff6b01363ee4 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87b34aea-986b-433e-adbe-7ecb7a8852fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:35:01 devstack sudo[105039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8b8f51f6-95db-451f-9368-2ea137c813e4 Jul 07 08:35:01 devstack sudo[105039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:01 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63695f1-e419-4b05-b8f3-c9e9d0f020b0]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:35:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0bf58865-6bab-4805-88ae-ff6b01363ee4 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87b34aea-986b-433e-adbe-7ecb7a8852fb {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:02 devstack sudo[105041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87b34aea-986b-433e-adbe-7ecb7a8852fb Jul 07 08:35:02 devstack sudo[105041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:02 devstack sudo[105027]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cf017154-9b60-4ceb-b695-2330a28aaa24 tempest-ProjectReaderTests-1685940573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-db1a3896-d60b-4728-ba95-816b310276b0" returned: 0 in 0.814s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:02 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cf017154-9b60-4ceb-b695-2330a28aaa24 tempest-ProjectReaderTests-1685940573 None] Lock "cinder-quobyte-db1a3896-d60b-4728-ba95-816b310276b0" released by "delete_volume" :: held 1.801s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:35:02 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-cf017154-9b60-4ceb-b695-2330a28aaa24 tempest-ProjectReaderTests-1685940573 None] Created reservations ['9b577c13-cf3b-4c09-bede-ce94037072d3', 'f32a588a-ff06-4154-aa4a-a80aee179616', '75a8bd09-5758-4d4a-b60d-421d63af2202', 'ea34d46a-8d0c-462d-90f3-317ec8b073a8'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:35:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cf017154-9b60-4ceb-b695-2330a28aaa24 tempest-ProjectReaderTests-1685940573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:35:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cf017154-9b60-4ceb-b695-2330a28aaa24 tempest-ProjectReaderTests-1685940573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:35:02 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-cf017154-9b60-4ceb-b695-2330a28aaa24 tempest-ProjectReaderTests-1685940573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:35:02 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-cf017154-9b60-4ceb-b695-2330a28aaa24 tempest-ProjectReaderTests-1685940573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:35:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cf017154-9b60-4ceb-b695-2330a28aaa24 tempest-ProjectReaderTests-1685940573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:35:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cf017154-9b60-4ceb-b695-2330a28aaa24 tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:02 devstack sudo[105044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:35:02 devstack sudo[105044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:02 devstack sudo[105039]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a9881481-824c-4c19-b176-f24c7a4dd2c8 tempest-CreateVolumesFromImageTest-1340750938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8b8f51f6-95db-451f-9368-2ea137c813e4" returned: 0 in 0.716s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:02 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a9881481-824c-4c19-b176-f24c7a4dd2c8 tempest-CreateVolumesFromImageTest-1340750938 None] <== create_volume: return (1799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:35:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a9881481-824c-4c19-b176-f24c7a4dd2c8 tempest-CreateVolumesFromImageTest-1340750938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.805s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:35:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-04ca3511-8f60-4718-8157-62ca15b53395 tempest-CreateVolumesFromImageTest-1340750938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.360s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:35:02 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-04ca3511-8f60-4718-8157-62ca15b53395 tempest-CreateVolumesFromImageTest-1340750938 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:34:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1591427095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b06aaeec-6bbb-46db-9c1e-49cf401ec153,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88246a90a4f644daadae6b8ae30b9781',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:34:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:34:55Z,use_quota=True,user_id='bd1899f11d1a4ee8b258cb23308f7a47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:35:02 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-04ca3511-8f60-4718-8157-62ca15b53395 tempest-CreateVolumesFromImageTest-1340750938 None] Creating volume b06aaeec-6bbb-46db-9c1e-49cf401ec153 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:35:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-04ca3511-8f60-4718-8157-62ca15b53395 tempest-CreateVolumesFromImageTest-1340750938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:35:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-04ca3511-8f60-4718-8157-62ca15b53395 tempest-CreateVolumesFromImageTest-1340750938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:35:02 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-04ca3511-8f60-4718-8157-62ca15b53395 tempest-CreateVolumesFromImageTest-1340750938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:35:02 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-04ca3511-8f60-4718-8157-62ca15b53395 tempest-CreateVolumesFromImageTest-1340750938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:35:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-04ca3511-8f60-4718-8157-62ca15b53395 tempest-CreateVolumesFromImageTest-1340750938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:35:02 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-04ca3511-8f60-4718-8157-62ca15b53395 tempest-CreateVolumesFromImageTest-1340750938 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:35:02 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-04ca3511-8f60-4718-8157-62ca15b53395 tempest-CreateVolumesFromImageTest-1340750938 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:35:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-04ca3511-8f60-4718-8157-62ca15b53395 tempest-CreateVolumesFromImageTest-1340750938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b06aaeec-6bbb-46db-9c1e-49cf401ec153 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a9881481-824c-4c19-b176-f24c7a4dd2c8 tempest-CreateVolumesFromImageTest-1340750938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c19f08d2-5edd-441b-8786-ff50053583c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b8f51f6-95db-451f-9368-2ea137c813e4', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:35:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a9881481-824c-4c19-b176-f24c7a4dd2c8 tempest-CreateVolumesFromImageTest-1340750938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b1cdf4c-0548-45d9-ab30-31002c912b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:35:02 devstack sudo[105047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b06aaeec-6bbb-46db-9c1e-49cf401ec153 1073741824 Jul 07 08:35:02 devstack sudo[105047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:02 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-a9881481-824c-4c19-b176-f24c7a4dd2c8 tempest-CreateVolumesFromImageTest-1340750938 None] Volume volume-8b8f51f6-95db-451f-9368-2ea137c813e4 (8b8f51f6-95db-451f-9368-2ea137c813e4): created successfully Jul 07 08:35:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a9881481-824c-4c19-b176-f24c7a4dd2c8 tempest-CreateVolumesFromImageTest-1340750938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b1cdf4c-0548-45d9-ab30-31002c912b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:35:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a9881481-824c-4c19-b176-f24c7a4dd2c8 tempest-CreateVolumesFromImageTest-1340750938 None] Flow 'volume_create_manager' (b5d6a896-a4c8-40f1-8191-1394f238706a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:35:02 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-a9881481-824c-4c19-b176-f24c7a4dd2c8 tempest-CreateVolumesFromImageTest-1340750938 None] Created volume successfully. Jul 07 08:35:02 devstack sudo[105041]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0bf58865-6bab-4805-88ae-ff6b01363ee4 tempest-CreateVolumesFromSnapshotTest-1959601045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87b34aea-986b-433e-adbe-7ecb7a8852fb" returned: 0 in 0.984s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0bf58865-6bab-4805-88ae-ff6b01363ee4 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87b34aea-986b-433e-adbe-7ecb7a8852fb.fb953425-39c1-4dc9-941d-ecca86351e64 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:02 devstack sudo[105053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87b34aea-986b-433e-adbe-7ecb7a8852fb.fb953425-39c1-4dc9-941d-ecca86351e64 Jul 07 08:35:02 devstack sudo[105053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:03 devstack sudo[105044]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cf017154-9b60-4ceb-b695-2330a28aaa24 tempest-ProjectReaderTests-1685940573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.777s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:03 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-cf017154-9b60-4ceb-b695-2330a28aaa24 tempest-ProjectReaderTests-1685940573 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:35:03 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-cf017154-9b60-4ceb-b695-2330a28aaa24 tempest-ProjectReaderTests-1685940573 None] Deleted volume successfully. Jul 07 08:35:03 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-cf017154-9b60-4ceb-b695-2330a28aaa24 tempest-ProjectReaderTests-1685940573 None] Lock "cinder-db1a3896-d60b-4728-ba95-816b310276b0-delete_volume" released by "delete_volume" :: held 2.812s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:35:03 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c80949c-0050-47af-8897-3975fd7aeb14 tempest-ProjectReaderTests-1685940573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:35:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7c80949c-0050-47af-8897-3975fd7aeb14 tempest-ProjectReaderTests-1685940573 None] Flow 'volume_create_manager' (e2e20324-911b-4a28-a3b6-e4a3a8e938c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:35:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7c80949c-0050-47af-8897-3975fd7aeb14 tempest-ProjectReaderTests-1685940573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bb09f0c-4f33-4521-bf44-c8252e17fe51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:35:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7c80949c-0050-47af-8897-3975fd7aeb14 tempest-ProjectReaderTests-1685940573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bb09f0c-4f33-4521-bf44-c8252e17fe51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:35:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1136836960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2728c7b7-e012-465d-954d-b26b77de4bd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06330941a308447a9ec29b93464314b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:35:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:35:03Z,use_quota=True,user_id='7e7152ed33e44a5a937717a4c518b2d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:35:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7c80949c-0050-47af-8897-3975fd7aeb14 tempest-ProjectReaderTests-1685940573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (623e3475-bc29-40cb-989e-ea141d24fa84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:35:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7c80949c-0050-47af-8897-3975fd7aeb14 tempest-ProjectReaderTests-1685940573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (623e3475-bc29-40cb-989e-ea141d24fa84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:35:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7c80949c-0050-47af-8897-3975fd7aeb14 tempest-ProjectReaderTests-1685940573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (948e1c75-9245-49cf-a491-a11bda8a05bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:35:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7c80949c-0050-47af-8897-3975fd7aeb14 tempest-ProjectReaderTests-1685940573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (948e1c75-9245-49cf-a491-a11bda8a05bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2728c7b7-e012-465d-954d-b26b77de4bd8', 'volume_name': 'volume-2728c7b7-e012-465d-954d-b26b77de4bd8', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:35:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7c80949c-0050-47af-8897-3975fd7aeb14 tempest-ProjectReaderTests-1685940573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18aee451-e95b-40e1-b077-620ba37b747e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:35:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7c80949c-0050-47af-8897-3975fd7aeb14 tempest-ProjectReaderTests-1685940573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18aee451-e95b-40e1-b077-620ba37b747e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:35:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7c80949c-0050-47af-8897-3975fd7aeb14 tempest-ProjectReaderTests-1685940573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (388b2cff-14b8-4284-a689-2d5ff28a6088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:35:03 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-7c80949c-0050-47af-8897-3975fd7aeb14 tempest-ProjectReaderTests-1685940573 None] Volume 2728c7b7-e012-465d-954d-b26b77de4bd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2728c7b7-e012-465d-954d-b26b77de4bd8', 'volume_size': 1} Jul 07 08:35:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7c80949c-0050-47af-8897-3975fd7aeb14 tempest-ProjectReaderTests-1685940573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:35:03 devstack sudo[105047]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-04ca3511-8f60-4718-8157-62ca15b53395 tempest-CreateVolumesFromImageTest-1340750938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b06aaeec-6bbb-46db-9c1e-49cf401ec153 1073741824" returned: 0 in 1.162s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:03 devstack sudo[105053]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0bf58865-6bab-4805-88ae-ff6b01363ee4 tempest-CreateVolumesFromSnapshotTest-1959601045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87b34aea-986b-433e-adbe-7ecb7a8852fb.fb953425-39c1-4dc9-941d-ecca86351e64" returned: 0 in 0.876s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0bf58865-6bab-4805-88ae-ff6b01363ee4 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87b34aea-986b-433e-adbe-7ecb7a8852fb.fb953425-39c1-4dc9-941d-ecca86351e64 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:03 devstack sudo[105062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87b34aea-986b-433e-adbe-7ecb7a8852fb.fb953425-39c1-4dc9-941d-ecca86351e64 Jul 07 08:35:03 devstack sudo[105062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-04ca3511-8f60-4718-8157-62ca15b53395 tempest-CreateVolumesFromImageTest-1340750938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b06aaeec-6bbb-46db-9c1e-49cf401ec153 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:03 devstack sudo[105064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b06aaeec-6bbb-46db-9c1e-49cf401ec153 Jul 07 08:35:03 devstack sudo[105064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:04 devstack sudo[105062]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0bf58865-6bab-4805-88ae-ff6b01363ee4 tempest-CreateVolumesFromSnapshotTest-1959601045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87b34aea-986b-433e-adbe-7ecb7a8852fb.fb953425-39c1-4dc9-941d-ecca86351e64" returned: 0 in 0.680s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:04 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0bf58865-6bab-4805-88ae-ff6b01363ee4 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "cinder-quobyte-fb953425-39c1-4dc9-941d-ecca86351e64" released by "_delete_snapshot" :: held 3.595s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:35:04 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0bf58865-6bab-4805-88ae-ff6b01363ee4 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "cinder-quobyte-87b34aea-986b-433e-adbe-7ecb7a8852fb" released by "delete_snapshot" :: held 3.631s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:35:04 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=150,cinder:UPDATE=187,cinder:DELETE=18,cinder:INSERT=49 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:35:04 devstack sudo[105064]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-04ca3511-8f60-4718-8157-62ca15b53395 tempest-CreateVolumesFromImageTest-1340750938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b06aaeec-6bbb-46db-9c1e-49cf401ec153" returned: 0 in 0.752s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-04ca3511-8f60-4718-8157-62ca15b53395 tempest-CreateVolumesFromImageTest-1340750938 None] <== create_volume: return (1976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:35:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-04ca3511-8f60-4718-8157-62ca15b53395 tempest-CreateVolumesFromImageTest-1340750938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.981s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:35:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3e7d804d-f11a-4875-8f83-93f40dc9103a tempest-CreateVolumesFromImageTest-1340750938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.041s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:35:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-3e7d804d-f11a-4875-8f83-93f40dc9103a tempest-CreateVolumesFromImageTest-1340750938 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:34:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1022546713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87afaa7e-721e-4571-9cad-aa338b62c82c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88246a90a4f644daadae6b8ae30b9781',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:34:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:34:55Z,use_quota=True,user_id='bd1899f11d1a4ee8b258cb23308f7a47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:35:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-3e7d804d-f11a-4875-8f83-93f40dc9103a tempest-CreateVolumesFromImageTest-1340750938 None] Creating volume 87afaa7e-721e-4571-9cad-aa338b62c82c {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:35:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3e7d804d-f11a-4875-8f83-93f40dc9103a tempest-CreateVolumesFromImageTest-1340750938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:35:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3e7d804d-f11a-4875-8f83-93f40dc9103a tempest-CreateVolumesFromImageTest-1340750938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:35:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-3e7d804d-f11a-4875-8f83-93f40dc9103a tempest-CreateVolumesFromImageTest-1340750938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:35:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-3e7d804d-f11a-4875-8f83-93f40dc9103a tempest-CreateVolumesFromImageTest-1340750938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:35:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3e7d804d-f11a-4875-8f83-93f40dc9103a tempest-CreateVolumesFromImageTest-1340750938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:35:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-3e7d804d-f11a-4875-8f83-93f40dc9103a tempest-CreateVolumesFromImageTest-1340750938 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:35:04 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-3e7d804d-f11a-4875-8f83-93f40dc9103a tempest-CreateVolumesFromImageTest-1340750938 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:35:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3e7d804d-f11a-4875-8f83-93f40dc9103a tempest-CreateVolumesFromImageTest-1340750938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87afaa7e-721e-4571-9cad-aa338b62c82c 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:04 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-0bf58865-6bab-4805-88ae-ff6b01363ee4 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Created reservations ['0fb0bf25-c1d2-4847-a26b-6438f8e1f73f', '581ddea9-ac1d-4b30-b82f-2cc46f8c35a0', '1ee7e157-d2af-4b42-ad4d-b230c75b3a48', 'e7218b0b-098c-478d-ae76-930663d09e17'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:35:04 devstack sudo[105068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87afaa7e-721e-4571-9cad-aa338b62c82c 1073741824 Jul 07 08:35:04 devstack sudo[105068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-04ca3511-8f60-4718-8157-62ca15b53395 tempest-CreateVolumesFromImageTest-1340750938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8dd8466-9904-49c6-b337-1b1fbe50b35c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b06aaeec-6bbb-46db-9c1e-49cf401ec153', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:35:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-04ca3511-8f60-4718-8157-62ca15b53395 tempest-CreateVolumesFromImageTest-1340750938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a460dd28-f95b-4516-8d41-213be063a1de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:35:04 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-04ca3511-8f60-4718-8157-62ca15b53395 tempest-CreateVolumesFromImageTest-1340750938 None] Volume volume-b06aaeec-6bbb-46db-9c1e-49cf401ec153 (b06aaeec-6bbb-46db-9c1e-49cf401ec153): created successfully Jul 07 08:35:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-04ca3511-8f60-4718-8157-62ca15b53395 tempest-CreateVolumesFromImageTest-1340750938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a460dd28-f95b-4516-8d41-213be063a1de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:35:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-04ca3511-8f60-4718-8157-62ca15b53395 tempest-CreateVolumesFromImageTest-1340750938 None] Flow 'volume_create_manager' (f1381d86-eec8-4fe9-a82c-76ef4ad85f2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:35:04 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-04ca3511-8f60-4718-8157-62ca15b53395 tempest-CreateVolumesFromImageTest-1340750938 None] Created volume successfully. Jul 07 08:35:04 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-0bf58865-6bab-4805-88ae-ff6b01363ee4 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Delete snapshot completed successfully. Jul 07 08:35:04 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0bf58865-6bab-4805-88ae-ff6b01363ee4 tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "cinder-fb953425-39c1-4dc9-941d-ecca86351e64-delete_snapshot" released by "delete_snapshot" :: held 3.878s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:35:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ec170379-8dbb-46c9-876f-9e97945c5acb tempest-CreateVolumesFromSnapshotTest-1959601045 None] Acquiring lock "cinder-87b34aea-986b-433e-adbe-7ecb7a8852fb-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:35:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ec170379-8dbb-46c9-876f-9e97945c5acb tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "cinder-87b34aea-986b-433e-adbe-7ecb7a8852fb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:35:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ec170379-8dbb-46c9-876f-9e97945c5acb tempest-CreateVolumesFromSnapshotTest-1959601045 None] Acquiring lock "cinder-quobyte-87b34aea-986b-433e-adbe-7ecb7a8852fb" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:35:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ec170379-8dbb-46c9-876f-9e97945c5acb tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "cinder-quobyte-87b34aea-986b-433e-adbe-7ecb7a8852fb" acquired by "delete_volume" :: waited 0.019s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:35:05 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb6f2f8-12a4-48ec-aefc-061c49067abc]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:35:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ec170379-8dbb-46c9-876f-9e97945c5acb tempest-CreateVolumesFromSnapshotTest-1959601045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87b34aea-986b-433e-adbe-7ecb7a8852fb {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:05 devstack sudo[105073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87b34aea-986b-433e-adbe-7ecb7a8852fb Jul 07 08:35:05 devstack sudo[105073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:05 devstack sudo[105068]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3e7d804d-f11a-4875-8f83-93f40dc9103a tempest-CreateVolumesFromImageTest-1340750938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87afaa7e-721e-4571-9cad-aa338b62c82c 1073741824" returned: 0 in 0.880s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:05 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:UPDATE=201,cinder:SELECT=131,cinder:INSERT=51,cinder:DELETE=18 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:35:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3e7d804d-f11a-4875-8f83-93f40dc9103a tempest-CreateVolumesFromImageTest-1340750938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87afaa7e-721e-4571-9cad-aa338b62c82c {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:05 devstack sudo[105076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87afaa7e-721e-4571-9cad-aa338b62c82c Jul 07 08:35:05 devstack sudo[105076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:05 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:35:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:35:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:35:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:35:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:35:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:35:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:05 devstack sudo[105081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:35:05 devstack sudo[105081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:05 devstack sudo[105073]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ec170379-8dbb-46c9-876f-9e97945c5acb tempest-CreateVolumesFromSnapshotTest-1959601045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87b34aea-986b-433e-adbe-7ecb7a8852fb" returned: 0 in 0.774s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ec170379-8dbb-46c9-876f-9e97945c5acb tempest-CreateVolumesFromSnapshotTest-1959601045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87b34aea-986b-433e-adbe-7ecb7a8852fb {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:06 devstack sudo[105083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87b34aea-986b-433e-adbe-7ecb7a8852fb Jul 07 08:35:06 devstack sudo[105083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:06 devstack sudo[105076]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3e7d804d-f11a-4875-8f83-93f40dc9103a tempest-CreateVolumesFromImageTest-1340750938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87afaa7e-721e-4571-9cad-aa338b62c82c" returned: 0 in 0.732s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-3e7d804d-f11a-4875-8f83-93f40dc9103a tempest-CreateVolumesFromImageTest-1340750938 None] <== create_volume: return (1661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:35:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-3e7d804d-f11a-4875-8f83-93f40dc9103a tempest-CreateVolumesFromImageTest-1340750938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.665s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:35:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-344c86cb-a271-45d6-b8b1-a9e84aeac4d6 tempest-CinderUnicodeTest-1096390883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.075s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:35:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-344c86cb-a271-45d6-b8b1-a9e84aeac4d6 tempest-CinderUnicodeTest-1096390883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:35:00Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1070559276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61f44cf5-7f52-4341-8d39-60f92578bcb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa4e62a2e3cf47a38703bcebc231b757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:35:00Z,use_quota=True,user_id='98c81998db8c4f0092049bff367318d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:35:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-344c86cb-a271-45d6-b8b1-a9e84aeac4d6 tempest-CinderUnicodeTest-1096390883 None] Creating volume 61f44cf5-7f52-4341-8d39-60f92578bcb3 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:35:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-344c86cb-a271-45d6-b8b1-a9e84aeac4d6 tempest-CinderUnicodeTest-1096390883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:35:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-344c86cb-a271-45d6-b8b1-a9e84aeac4d6 tempest-CinderUnicodeTest-1096390883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:35:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-344c86cb-a271-45d6-b8b1-a9e84aeac4d6 tempest-CinderUnicodeTest-1096390883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:35:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-344c86cb-a271-45d6-b8b1-a9e84aeac4d6 tempest-CinderUnicodeTest-1096390883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:35:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-344c86cb-a271-45d6-b8b1-a9e84aeac4d6 tempest-CinderUnicodeTest-1096390883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:35:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-344c86cb-a271-45d6-b8b1-a9e84aeac4d6 tempest-CinderUnicodeTest-1096390883 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:35:06 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-344c86cb-a271-45d6-b8b1-a9e84aeac4d6 tempest-CinderUnicodeTest-1096390883 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:35:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-344c86cb-a271-45d6-b8b1-a9e84aeac4d6 tempest-CinderUnicodeTest-1096390883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61f44cf5-7f52-4341-8d39-60f92578bcb3 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3e7d804d-f11a-4875-8f83-93f40dc9103a tempest-CreateVolumesFromImageTest-1340750938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c4bb2e6-b9ea-49f7-958b-b8cc6681f2a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87afaa7e-721e-4571-9cad-aa338b62c82c', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:35:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3e7d804d-f11a-4875-8f83-93f40dc9103a tempest-CreateVolumesFromImageTest-1340750938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe214329-814d-4e71-aef3-bb0192627f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:35:06 devstack sudo[105086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61f44cf5-7f52-4341-8d39-60f92578bcb3 1073741824 Jul 07 08:35:06 devstack sudo[105086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:06 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-3e7d804d-f11a-4875-8f83-93f40dc9103a tempest-CreateVolumesFromImageTest-1340750938 None] Volume volume-87afaa7e-721e-4571-9cad-aa338b62c82c (87afaa7e-721e-4571-9cad-aa338b62c82c): created successfully Jul 07 08:35:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3e7d804d-f11a-4875-8f83-93f40dc9103a tempest-CreateVolumesFromImageTest-1340750938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe214329-814d-4e71-aef3-bb0192627f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:35:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-3e7d804d-f11a-4875-8f83-93f40dc9103a tempest-CreateVolumesFromImageTest-1340750938 None] Flow 'volume_create_manager' (ae699fe7-8202-429f-8e48-590bf6a57526) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:35:06 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-3e7d804d-f11a-4875-8f83-93f40dc9103a tempest-CreateVolumesFromImageTest-1340750938 None] Created volume successfully. Jul 07 08:35:06 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4ae90e01-eb20-42b2-a68e-cfff3c607a43 tempest-CreateVolumesFromImageTest-1340750938 None] Acquiring lock "cinder-87afaa7e-721e-4571-9cad-aa338b62c82c-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:35:06 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4ae90e01-eb20-42b2-a68e-cfff3c607a43 tempest-CreateVolumesFromImageTest-1340750938 None] Lock "cinder-87afaa7e-721e-4571-9cad-aa338b62c82c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:35:06 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4ae90e01-eb20-42b2-a68e-cfff3c607a43 tempest-CreateVolumesFromImageTest-1340750938 None] Acquiring lock "cinder-quobyte-87afaa7e-721e-4571-9cad-aa338b62c82c" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:35:06 devstack sudo[105081]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:06 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4ae90e01-eb20-42b2-a68e-cfff3c607a43 tempest-CreateVolumesFromImageTest-1340750938 None] Lock "cinder-quobyte-87afaa7e-721e-4571-9cad-aa338b62c82c" acquired by "delete_volume" :: waited 0.023s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:35:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.795s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:06 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:35:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running periodic task VolumeManager._thread_info {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:35:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] thread count: 29 {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 08:35:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] thread info: [<_MainThread(MainThread, started 133056092332160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 08:35:06 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b967f6-45a7-46be-bb67-6dd47ee89164]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:35:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4ae90e01-eb20-42b2-a68e-cfff3c607a43 tempest-CreateVolumesFromImageTest-1340750938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87afaa7e-721e-4571-9cad-aa338b62c82c {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:06 devstack sudo[105083]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ec170379-8dbb-46c9-876f-9e97945c5acb tempest-CreateVolumesFromSnapshotTest-1959601045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87b34aea-986b-433e-adbe-7ecb7a8852fb" returned: 0 in 0.776s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:06 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ec170379-8dbb-46c9-876f-9e97945c5acb tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "cinder-quobyte-87b34aea-986b-433e-adbe-7ecb7a8852fb" released by "delete_volume" :: held 1.607s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:35:06 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-ec170379-8dbb-46c9-876f-9e97945c5acb tempest-CreateVolumesFromSnapshotTest-1959601045 None] Created reservations ['6d63ef68-d914-4fa4-b4ba-a238c118ba67', '2692feb5-6848-4a05-9499-7ddb376a4783', 'a665605e-031d-4033-8029-199f18e3e22c', 'de2f7c2c-2e23-49bd-8ec7-b07d3a0bf0a9'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:35:06 devstack sudo[105090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87afaa7e-721e-4571-9cad-aa338b62c82c Jul 07 08:35:06 devstack sudo[105090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ec170379-8dbb-46c9-876f-9e97945c5acb tempest-CreateVolumesFromSnapshotTest-1959601045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:35:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ec170379-8dbb-46c9-876f-9e97945c5acb tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:35:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ec170379-8dbb-46c9-876f-9e97945c5acb tempest-CreateVolumesFromSnapshotTest-1959601045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:35:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ec170379-8dbb-46c9-876f-9e97945c5acb tempest-CreateVolumesFromSnapshotTest-1959601045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:35:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ec170379-8dbb-46c9-876f-9e97945c5acb tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:35:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ec170379-8dbb-46c9-876f-9e97945c5acb tempest-CreateVolumesFromSnapshotTest-1959601045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:06 devstack sudo[105092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:35:06 devstack sudo[105092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:07 devstack sudo[105086]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-344c86cb-a271-45d6-b8b1-a9e84aeac4d6 tempest-CinderUnicodeTest-1096390883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61f44cf5-7f52-4341-8d39-60f92578bcb3 1073741824" returned: 0 in 0.946s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-344c86cb-a271-45d6-b8b1-a9e84aeac4d6 tempest-CinderUnicodeTest-1096390883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61f44cf5-7f52-4341-8d39-60f92578bcb3 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:07 devstack sudo[105097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61f44cf5-7f52-4341-8d39-60f92578bcb3 Jul 07 08:35:07 devstack sudo[105097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:07 devstack sudo[105090]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4ae90e01-eb20-42b2-a68e-cfff3c607a43 tempest-CreateVolumesFromImageTest-1340750938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87afaa7e-721e-4571-9cad-aa338b62c82c" returned: 0 in 0.880s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4ae90e01-eb20-42b2-a68e-cfff3c607a43 tempest-CreateVolumesFromImageTest-1340750938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87afaa7e-721e-4571-9cad-aa338b62c82c {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:07 devstack sudo[105103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87afaa7e-721e-4571-9cad-aa338b62c82c Jul 07 08:35:07 devstack sudo[105103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:07 devstack sudo[105092]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ec170379-8dbb-46c9-876f-9e97945c5acb tempest-CreateVolumesFromSnapshotTest-1959601045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.870s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:07 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ec170379-8dbb-46c9-876f-9e97945c5acb tempest-CreateVolumesFromSnapshotTest-1959601045 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:35:07 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-ec170379-8dbb-46c9-876f-9e97945c5acb tempest-CreateVolumesFromSnapshotTest-1959601045 None] Deleted volume successfully. Jul 07 08:35:07 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ec170379-8dbb-46c9-876f-9e97945c5acb tempest-CreateVolumesFromSnapshotTest-1959601045 None] Lock "cinder-87b34aea-986b-433e-adbe-7ecb7a8852fb-delete_volume" released by "delete_volume" :: held 2.701s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:35:08 devstack sudo[105097]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-344c86cb-a271-45d6-b8b1-a9e84aeac4d6 tempest-CinderUnicodeTest-1096390883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61f44cf5-7f52-4341-8d39-60f92578bcb3" returned: 0 in 0.858s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:08 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-344c86cb-a271-45d6-b8b1-a9e84aeac4d6 tempest-CinderUnicodeTest-1096390883 None] <== create_volume: return (1874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:35:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-344c86cb-a271-45d6-b8b1-a9e84aeac4d6 tempest-CinderUnicodeTest-1096390883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.881s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:35:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7c80949c-0050-47af-8897-3975fd7aeb14 tempest-ProjectReaderTests-1685940573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.836s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:35:08 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-7c80949c-0050-47af-8897-3975fd7aeb14 tempest-ProjectReaderTests-1685940573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:35:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1136836960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2728c7b7-e012-465d-954d-b26b77de4bd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06330941a308447a9ec29b93464314b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:35:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:35:03Z,use_quota=True,user_id='7e7152ed33e44a5a937717a4c518b2d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:35:08 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-7c80949c-0050-47af-8897-3975fd7aeb14 tempest-ProjectReaderTests-1685940573 None] Creating volume 2728c7b7-e012-465d-954d-b26b77de4bd8 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:35:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7c80949c-0050-47af-8897-3975fd7aeb14 tempest-ProjectReaderTests-1685940573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:35:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7c80949c-0050-47af-8897-3975fd7aeb14 tempest-ProjectReaderTests-1685940573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:35:08 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-7c80949c-0050-47af-8897-3975fd7aeb14 tempest-ProjectReaderTests-1685940573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:35:08 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-7c80949c-0050-47af-8897-3975fd7aeb14 tempest-ProjectReaderTests-1685940573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:35:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7c80949c-0050-47af-8897-3975fd7aeb14 tempest-ProjectReaderTests-1685940573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:35:08 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-7c80949c-0050-47af-8897-3975fd7aeb14 tempest-ProjectReaderTests-1685940573 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:35:08 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-7c80949c-0050-47af-8897-3975fd7aeb14 tempest-ProjectReaderTests-1685940573 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:35:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7c80949c-0050-47af-8897-3975fd7aeb14 tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2728c7b7-e012-465d-954d-b26b77de4bd8 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-344c86cb-a271-45d6-b8b1-a9e84aeac4d6 tempest-CinderUnicodeTest-1096390883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c79af3fb-111b-4df2-97a6-6b6b72df71f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61f44cf5-7f52-4341-8d39-60f92578bcb3', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:35:08 devstack sudo[105106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2728c7b7-e012-465d-954d-b26b77de4bd8 1073741824 Jul 07 08:35:08 devstack sudo[105106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-344c86cb-a271-45d6-b8b1-a9e84aeac4d6 tempest-CinderUnicodeTest-1096390883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9f6e1ec-7511-4ef4-8382-6f8b14e2748b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:35:08 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-344c86cb-a271-45d6-b8b1-a9e84aeac4d6 tempest-CinderUnicodeTest-1096390883 None] Volume volume-61f44cf5-7f52-4341-8d39-60f92578bcb3 (61f44cf5-7f52-4341-8d39-60f92578bcb3): created successfully Jul 07 08:35:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-344c86cb-a271-45d6-b8b1-a9e84aeac4d6 tempest-CinderUnicodeTest-1096390883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9f6e1ec-7511-4ef4-8382-6f8b14e2748b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:35:08 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-344c86cb-a271-45d6-b8b1-a9e84aeac4d6 tempest-CinderUnicodeTest-1096390883 None] Flow 'volume_create_manager' (9d9e5a19-ebb2-4c4f-9629-0e4559305984) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:35:08 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-344c86cb-a271-45d6-b8b1-a9e84aeac4d6 tempest-CinderUnicodeTest-1096390883 None] Created volume successfully. Jul 07 08:35:08 devstack sudo[105103]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4ae90e01-eb20-42b2-a68e-cfff3c607a43 tempest-CreateVolumesFromImageTest-1340750938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-87afaa7e-721e-4571-9cad-aa338b62c82c" returned: 0 in 0.814s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:08 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4ae90e01-eb20-42b2-a68e-cfff3c607a43 tempest-CreateVolumesFromImageTest-1340750938 None] Lock "cinder-quobyte-87afaa7e-721e-4571-9cad-aa338b62c82c" released by "delete_volume" :: held 1.754s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:35:08 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-4ae90e01-eb20-42b2-a68e-cfff3c607a43 tempest-CreateVolumesFromImageTest-1340750938 None] Created reservations ['430305bb-01fb-4459-a39c-93be5531d65e', '1e5f94f7-9239-4615-8677-66d6a391c868', '5bdeacb2-28e2-4b88-b603-1e5d609351ab', '1b86f6e2-a44e-4262-af55-de9b51b75012'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:35:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4ae90e01-eb20-42b2-a68e-cfff3c607a43 tempest-CreateVolumesFromImageTest-1340750938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:35:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4ae90e01-eb20-42b2-a68e-cfff3c607a43 tempest-CreateVolumesFromImageTest-1340750938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:35:08 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4ae90e01-eb20-42b2-a68e-cfff3c607a43 tempest-CreateVolumesFromImageTest-1340750938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:35:08 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-4ae90e01-eb20-42b2-a68e-cfff3c607a43 tempest-CreateVolumesFromImageTest-1340750938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:35:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4ae90e01-eb20-42b2-a68e-cfff3c607a43 tempest-CreateVolumesFromImageTest-1340750938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:35:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4ae90e01-eb20-42b2-a68e-cfff3c607a43 tempest-CreateVolumesFromImageTest-1340750938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:08 devstack sudo[105109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:35:08 devstack sudo[105109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:08 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-83b8d393-11d9-4f23-ab34-5e5703c7caf9 tempest-CreateVolumesFromImageTest-1340750938 None] Acquiring lock "cinder-b06aaeec-6bbb-46db-9c1e-49cf401ec153-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:35:08 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-83b8d393-11d9-4f23-ab34-5e5703c7caf9 tempest-CreateVolumesFromImageTest-1340750938 None] Lock "cinder-b06aaeec-6bbb-46db-9c1e-49cf401ec153-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:35:09 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-83b8d393-11d9-4f23-ab34-5e5703c7caf9 tempest-CreateVolumesFromImageTest-1340750938 None] Acquiring lock "cinder-quobyte-b06aaeec-6bbb-46db-9c1e-49cf401ec153" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:35:09 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-83b8d393-11d9-4f23-ab34-5e5703c7caf9 tempest-CreateVolumesFromImageTest-1340750938 None] Lock "cinder-quobyte-b06aaeec-6bbb-46db-9c1e-49cf401ec153" acquired by "delete_volume" :: waited 0.024s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:35:09 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc09647-6a23-4939-bae5-a522891def34]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:35:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-83b8d393-11d9-4f23-ab34-5e5703c7caf9 tempest-CreateVolumesFromImageTest-1340750938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b06aaeec-6bbb-46db-9c1e-49cf401ec153 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-017f1332-f8aa-4ccc-871c-80250c2ac28a tempest-CinderUnicodeTest-1096390883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:35:09 devstack sudo[105115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b06aaeec-6bbb-46db-9c1e-49cf401ec153 Jul 07 08:35:09 devstack sudo[105115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:09 devstack sudo[105106]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7c80949c-0050-47af-8897-3975fd7aeb14 tempest-ProjectReaderTests-1685940573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2728c7b7-e012-465d-954d-b26b77de4bd8 1073741824" returned: 0 in 1.141s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7c80949c-0050-47af-8897-3975fd7aeb14 tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2728c7b7-e012-465d-954d-b26b77de4bd8 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:09 devstack sudo[105118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2728c7b7-e012-465d-954d-b26b77de4bd8 Jul 07 08:35:09 devstack sudo[105118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:09 devstack sudo[105109]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4ae90e01-eb20-42b2-a68e-cfff3c607a43 tempest-CreateVolumesFromImageTest-1340750938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.958s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:09 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-4ae90e01-eb20-42b2-a68e-cfff3c607a43 tempest-CreateVolumesFromImageTest-1340750938 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:35:09 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-4ae90e01-eb20-42b2-a68e-cfff3c607a43 tempest-CreateVolumesFromImageTest-1340750938 None] Deleted volume successfully. Jul 07 08:35:09 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4ae90e01-eb20-42b2-a68e-cfff3c607a43 tempest-CreateVolumesFromImageTest-1340750938 None] Lock "cinder-87afaa7e-721e-4571-9cad-aa338b62c82c-delete_volume" released by "delete_volume" :: held 2.953s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:35:10 devstack sudo[105118]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7c80949c-0050-47af-8897-3975fd7aeb14 tempest-ProjectReaderTests-1685940573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2728c7b7-e012-465d-954d-b26b77de4bd8" returned: 0 in 0.693s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:10 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-7c80949c-0050-47af-8897-3975fd7aeb14 tempest-ProjectReaderTests-1685940573 None] <== create_volume: return (1895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:35:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7c80949c-0050-47af-8897-3975fd7aeb14 tempest-ProjectReaderTests-1685940573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.898s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:35:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-017f1332-f8aa-4ccc-871c-80250c2ac28a tempest-CinderUnicodeTest-1096390883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.835s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:35:10 devstack sudo[105115]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:10 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7c80949c-0050-47af-8897-3975fd7aeb14 tempest-ProjectReaderTests-1685940573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (388b2cff-14b8-4284-a689-2d5ff28a6088) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2728c7b7-e012-465d-954d-b26b77de4bd8', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:35:10 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7c80949c-0050-47af-8897-3975fd7aeb14 tempest-ProjectReaderTests-1685940573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (205aa1c8-d69f-4e10-97c0-a17e4ef3489e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:35:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-83b8d393-11d9-4f23-ab34-5e5703c7caf9 tempest-CreateVolumesFromImageTest-1340750938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b06aaeec-6bbb-46db-9c1e-49cf401ec153" returned: 0 in 0.981s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-83b8d393-11d9-4f23-ab34-5e5703c7caf9 tempest-CreateVolumesFromImageTest-1340750938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b06aaeec-6bbb-46db-9c1e-49cf401ec153 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:10 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-017f1332-f8aa-4ccc-871c-80250c2ac28a tempest-CinderUnicodeTest-1096390883 None] Creating offline snapshot 5e2f08bf-d9d5-40c0-a1a4-859384ac601b of volume 61f44cf5-7f52-4341-8d39-60f92578bcb3 {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:35:10 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-7c80949c-0050-47af-8897-3975fd7aeb14 tempest-ProjectReaderTests-1685940573 None] Volume volume-2728c7b7-e012-465d-954d-b26b77de4bd8 (2728c7b7-e012-465d-954d-b26b77de4bd8): created successfully Jul 07 08:35:10 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7c80949c-0050-47af-8897-3975fd7aeb14 tempest-ProjectReaderTests-1685940573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (205aa1c8-d69f-4e10-97c0-a17e4ef3489e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:35:10 devstack sudo[105125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b06aaeec-6bbb-46db-9c1e-49cf401ec153 Jul 07 08:35:10 devstack sudo[105125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:10 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-7c80949c-0050-47af-8897-3975fd7aeb14 tempest-ProjectReaderTests-1685940573 None] Flow 'volume_create_manager' (e2e20324-911b-4a28-a3b6-e4a3a8e938c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:35:10 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6c927d-a891-4f75-86cc-db94cebb886d]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:35:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-017f1332-f8aa-4ccc-871c-80250c2ac28a tempest-CinderUnicodeTest-1096390883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61f44cf5-7f52-4341-8d39-60f92578bcb3 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:10 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-7c80949c-0050-47af-8897-3975fd7aeb14 tempest-ProjectReaderTests-1685940573 None] Created volume successfully. Jul 07 08:35:10 devstack sudo[105127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61f44cf5-7f52-4341-8d39-60f92578bcb3 Jul 07 08:35:10 devstack sudo[105127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:10 devstack sudo[105125]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-83b8d393-11d9-4f23-ab34-5e5703c7caf9 tempest-CreateVolumesFromImageTest-1340750938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-b06aaeec-6bbb-46db-9c1e-49cf401ec153" returned: 0 in 0.774s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:10 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-83b8d393-11d9-4f23-ab34-5e5703c7caf9 tempest-CreateVolumesFromImageTest-1340750938 None] Lock "cinder-quobyte-b06aaeec-6bbb-46db-9c1e-49cf401ec153" released by "delete_volume" :: held 1.836s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:35:10 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-83b8d393-11d9-4f23-ab34-5e5703c7caf9 tempest-CreateVolumesFromImageTest-1340750938 None] Created reservations ['2aa036ce-8204-4c0c-a460-a82f2649146c', '0b8be331-9c16-4c5a-862a-2199e4b586af', '5fb2aa0f-1ad8-4782-9b17-7bb1024772b3', '19ba4700-9491-485d-8895-cd9a01ea2316'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:35:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-654272fc-ba1e-418d-a91c-225681232098 tempest-ProjectReaderTests-1685940573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:35:11 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f723408-cf9e-4464-a004-459e4a92759b tempest-VolumeDependencyTests-1845104136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:35:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1f723408-cf9e-4464-a004-459e4a92759b tempest-VolumeDependencyTests-1845104136 None] Flow 'volume_create_manager' (e41c3f19-9730-4c70-94f5-5306042354b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:35:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1f723408-cf9e-4464-a004-459e4a92759b tempest-VolumeDependencyTests-1845104136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01064b37-95b3-4ca6-8fe1-70c930e07ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:35:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1f723408-cf9e-4464-a004-459e4a92759b tempest-VolumeDependencyTests-1845104136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01064b37-95b3-4ca6-8fe1-70c930e07ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:35:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-771839099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37b9eccf-0b7d-4b85-9885-9e7b74d66a6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7da866dad32f42bd93c9551dfa09aad8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:35:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:35:11Z,use_quota=True,user_id='d430fbd4e046491dbb0ca0cdff586591',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:35:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1f723408-cf9e-4464-a004-459e4a92759b tempest-VolumeDependencyTests-1845104136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54ae0582-acf6-46ea-b769-b7d659cb8f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:35:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1f723408-cf9e-4464-a004-459e4a92759b tempest-VolumeDependencyTests-1845104136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54ae0582-acf6-46ea-b769-b7d659cb8f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:35:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1f723408-cf9e-4464-a004-459e4a92759b tempest-VolumeDependencyTests-1845104136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c766bc53-989f-4a2e-8126-aa1f6854ad0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:35:11 devstack sudo[105127]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1f723408-cf9e-4464-a004-459e4a92759b tempest-VolumeDependencyTests-1845104136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c766bc53-989f-4a2e-8126-aa1f6854ad0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37b9eccf-0b7d-4b85-9885-9e7b74d66a6b', 'volume_name': 'volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:35:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1f723408-cf9e-4464-a004-459e4a92759b tempest-VolumeDependencyTests-1845104136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (941ae5cf-6f3e-497f-ba5b-db47aa1b7ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:35:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1f723408-cf9e-4464-a004-459e4a92759b tempest-VolumeDependencyTests-1845104136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (941ae5cf-6f3e-497f-ba5b-db47aa1b7ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:35:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1f723408-cf9e-4464-a004-459e4a92759b tempest-VolumeDependencyTests-1845104136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d5b64f4-5712-48bb-a072-250be05a8c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:35:11 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-1f723408-cf9e-4464-a004-459e4a92759b tempest-VolumeDependencyTests-1845104136 None] Volume 37b9eccf-0b7d-4b85-9885-9e7b74d66a6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b', 'volume_size': 1} Jul 07 08:35:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1f723408-cf9e-4464-a004-459e4a92759b tempest-VolumeDependencyTests-1845104136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:35:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-017f1332-f8aa-4ccc-871c-80250c2ac28a tempest-CinderUnicodeTest-1096390883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61f44cf5-7f52-4341-8d39-60f92578bcb3" returned: 0 in 0.954s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-017f1332-f8aa-4ccc-871c-80250c2ac28a tempest-CinderUnicodeTest-1096390883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61f44cf5-7f52-4341-8d39-60f92578bcb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61f44cf5-7f52-4341-8d39-60f92578bcb3.5e2f08bf-d9d5-40c0-a1a4-859384ac601b 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:11 devstack sudo[105133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61f44cf5-7f52-4341-8d39-60f92578bcb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61f44cf5-7f52-4341-8d39-60f92578bcb3.5e2f08bf-d9d5-40c0-a1a4-859384ac601b 1G Jul 07 08:35:11 devstack sudo[105133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-83b8d393-11d9-4f23-ab34-5e5703c7caf9 tempest-CreateVolumesFromImageTest-1340750938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:35:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-83b8d393-11d9-4f23-ab34-5e5703c7caf9 tempest-CreateVolumesFromImageTest-1340750938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:35:11 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-83b8d393-11d9-4f23-ab34-5e5703c7caf9 tempest-CreateVolumesFromImageTest-1340750938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:35:11 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-83b8d393-11d9-4f23-ab34-5e5703c7caf9 tempest-CreateVolumesFromImageTest-1340750938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:35:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-83b8d393-11d9-4f23-ab34-5e5703c7caf9 tempest-CreateVolumesFromImageTest-1340750938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:35:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-83b8d393-11d9-4f23-ab34-5e5703c7caf9 tempest-CreateVolumesFromImageTest-1340750938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:11 devstack sudo[105135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:35:11 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:11 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-1206ae55-657c-442f-822a-afcf9ad7a0bc tempest-CreateVolumesFromImageTest-1340750938 None] Acquiring lock "cinder-8b8f51f6-95db-451f-9368-2ea137c813e4-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:35:11 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-1206ae55-657c-442f-822a-afcf9ad7a0bc tempest-CreateVolumesFromImageTest-1340750938 None] Lock "cinder-8b8f51f6-95db-451f-9368-2ea137c813e4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:35:11 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-1206ae55-657c-442f-822a-afcf9ad7a0bc tempest-CreateVolumesFromImageTest-1340750938 None] Acquiring lock "cinder-quobyte-8b8f51f6-95db-451f-9368-2ea137c813e4" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:35:11 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-1206ae55-657c-442f-822a-afcf9ad7a0bc tempest-CreateVolumesFromImageTest-1340750938 None] Lock "cinder-quobyte-8b8f51f6-95db-451f-9368-2ea137c813e4" acquired by "delete_volume" :: waited 0.029s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:35:11 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[10df8601-b140-4158-bd0d-a58e5ba16e49]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:35:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1206ae55-657c-442f-822a-afcf9ad7a0bc tempest-CreateVolumesFromImageTest-1340750938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8b8f51f6-95db-451f-9368-2ea137c813e4 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:11 devstack sudo[105138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8b8f51f6-95db-451f-9368-2ea137c813e4 Jul 07 08:35:11 devstack sudo[105138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:11 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-83b8d393-11d9-4f23-ab34-5e5703c7caf9 tempest-CreateVolumesFromImageTest-1340750938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.722s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:11 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-83b8d393-11d9-4f23-ab34-5e5703c7caf9 tempest-CreateVolumesFromImageTest-1340750938 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:35:11 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-83b8d393-11d9-4f23-ab34-5e5703c7caf9 tempest-CreateVolumesFromImageTest-1340750938 None] Deleted volume successfully. Jul 07 08:35:11 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-83b8d393-11d9-4f23-ab34-5e5703c7caf9 tempest-CreateVolumesFromImageTest-1340750938 None] Lock "cinder-b06aaeec-6bbb-46db-9c1e-49cf401ec153-delete_volume" released by "delete_volume" :: held 2.941s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:35:11 devstack sudo[105133]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-017f1332-f8aa-4ccc-871c-80250c2ac28a tempest-CinderUnicodeTest-1096390883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61f44cf5-7f52-4341-8d39-60f92578bcb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61f44cf5-7f52-4341-8d39-60f92578bcb3.5e2f08bf-d9d5-40c0-a1a4-859384ac601b 1G" returned: 0 in 0.891s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-017f1332-f8aa-4ccc-871c-80250c2ac28a tempest-CinderUnicodeTest-1096390883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61f44cf5-7f52-4341-8d39-60f92578bcb3 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61f44cf5-7f52-4341-8d39-60f92578bcb3.5e2f08bf-d9d5-40c0-a1a4-859384ac601b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:12 devstack sudo[105145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61f44cf5-7f52-4341-8d39-60f92578bcb3 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61f44cf5-7f52-4341-8d39-60f92578bcb3.5e2f08bf-d9d5-40c0-a1a4-859384ac601b Jul 07 08:35:12 devstack sudo[105145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:12 devstack sudo[105138]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1206ae55-657c-442f-822a-afcf9ad7a0bc tempest-CreateVolumesFromImageTest-1340750938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8b8f51f6-95db-451f-9368-2ea137c813e4" returned: 0 in 0.836s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1206ae55-657c-442f-822a-afcf9ad7a0bc tempest-CreateVolumesFromImageTest-1340750938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8b8f51f6-95db-451f-9368-2ea137c813e4 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:12 devstack sudo[105150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8b8f51f6-95db-451f-9368-2ea137c813e4 Jul 07 08:35:12 devstack sudo[105150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:12 devstack sudo[105145]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-017f1332-f8aa-4ccc-871c-80250c2ac28a tempest-CinderUnicodeTest-1096390883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61f44cf5-7f52-4341-8d39-60f92578bcb3 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61f44cf5-7f52-4341-8d39-60f92578bcb3.5e2f08bf-d9d5-40c0-a1a4-859384ac601b" returned: 0 in 0.714s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:12 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-017f1332-f8aa-4ccc-871c-80250c2ac28a tempest-CinderUnicodeTest-1096390883 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61f44cf5-7f52-4341-8d39-60f92578bcb3.5e2f08bf-d9d5-40c0-a1a4-859384ac601b is being set with open permissions: ugo+rw Jul 07 08:35:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-017f1332-f8aa-4ccc-871c-80250c2ac28a tempest-CinderUnicodeTest-1096390883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61f44cf5-7f52-4341-8d39-60f92578bcb3.5e2f08bf-d9d5-40c0-a1a4-859384ac601b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:12 devstack sudo[105156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61f44cf5-7f52-4341-8d39-60f92578bcb3.5e2f08bf-d9d5-40c0-a1a4-859384ac601b Jul 07 08:35:12 devstack sudo[105156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:12 devstack sudo[105150]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1206ae55-657c-442f-822a-afcf9ad7a0bc tempest-CreateVolumesFromImageTest-1340750938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8b8f51f6-95db-451f-9368-2ea137c813e4" returned: 0 in 0.670s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:12 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-1206ae55-657c-442f-822a-afcf9ad7a0bc tempest-CreateVolumesFromImageTest-1340750938 None] Lock "cinder-quobyte-8b8f51f6-95db-451f-9368-2ea137c813e4" released by "delete_volume" :: held 1.566s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:35:12 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-1206ae55-657c-442f-822a-afcf9ad7a0bc tempest-CreateVolumesFromImageTest-1340750938 None] Created reservations ['1d6ce6e2-9fe4-42e7-9c50-063f027ba00c', '300909f7-d7c0-405d-aafb-454bf11a24aa', '303c81a6-9998-4a70-9a0c-719da555fb7d', '34afe28a-c4d7-40d9-b321-d02c563b9171'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:35:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1206ae55-657c-442f-822a-afcf9ad7a0bc tempest-CreateVolumesFromImageTest-1340750938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:35:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1206ae55-657c-442f-822a-afcf9ad7a0bc tempest-CreateVolumesFromImageTest-1340750938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:35:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1206ae55-657c-442f-822a-afcf9ad7a0bc tempest-CreateVolumesFromImageTest-1340750938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:35:13 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1206ae55-657c-442f-822a-afcf9ad7a0bc tempest-CreateVolumesFromImageTest-1340750938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:35:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1206ae55-657c-442f-822a-afcf9ad7a0bc tempest-CreateVolumesFromImageTest-1340750938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:35:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1206ae55-657c-442f-822a-afcf9ad7a0bc tempest-CreateVolumesFromImageTest-1340750938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:13 devstack sudo[105160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:35:13 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:13 devstack sudo[105156]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-017f1332-f8aa-4ccc-871c-80250c2ac28a tempest-CinderUnicodeTest-1096390883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61f44cf5-7f52-4341-8d39-60f92578bcb3.5e2f08bf-d9d5-40c0-a1a4-859384ac601b" returned: 0 in 0.651s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-017f1332-f8aa-4ccc-871c-80250c2ac28a tempest-CinderUnicodeTest-1096390883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61f44cf5-7f52-4341-8d39-60f92578bcb3.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:13 devstack sudo[105163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61f44cf5-7f52-4341-8d39-60f92578bcb3.info Jul 07 08:35:13 devstack sudo[105163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:13 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-56c9e00f-57b7-4a1b-9d76-56105c564c05 tempest-CreateVolumesFromImageTest-1340750938 None] Acquiring lock "cinder-26996f84-b29d-4573-aff6-de8ef8a1491b-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:35:13 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-56c9e00f-57b7-4a1b-9d76-56105c564c05 tempest-CreateVolumesFromImageTest-1340750938 None] Lock "cinder-26996f84-b29d-4573-aff6-de8ef8a1491b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:35:13 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-56c9e00f-57b7-4a1b-9d76-56105c564c05 tempest-CreateVolumesFromImageTest-1340750938 None] Acquiring lock "cinder-quobyte-26996f84-b29d-4573-aff6-de8ef8a1491b" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:35:13 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-56c9e00f-57b7-4a1b-9d76-56105c564c05 tempest-CreateVolumesFromImageTest-1340750938 None] Lock "cinder-quobyte-26996f84-b29d-4573-aff6-de8ef8a1491b" acquired by "delete_volume" :: waited 0.015s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:35:13 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d2028e-51be-4d56-bf44-3ecc67ccd230]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:35:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-56c9e00f-57b7-4a1b-9d76-56105c564c05 tempest-CreateVolumesFromImageTest-1340750938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-26996f84-b29d-4573-aff6-de8ef8a1491b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:13 devstack sudo[105165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-26996f84-b29d-4573-aff6-de8ef8a1491b Jul 07 08:35:13 devstack sudo[105165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:13 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1206ae55-657c-442f-822a-afcf9ad7a0bc tempest-CreateVolumesFromImageTest-1340750938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.742s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:13 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-1206ae55-657c-442f-822a-afcf9ad7a0bc tempest-CreateVolumesFromImageTest-1340750938 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:35:13 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-1206ae55-657c-442f-822a-afcf9ad7a0bc tempest-CreateVolumesFromImageTest-1340750938 None] Deleted volume successfully. Jul 07 08:35:13 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-1206ae55-657c-442f-822a-afcf9ad7a0bc tempest-CreateVolumesFromImageTest-1340750938 None] Lock "cinder-8b8f51f6-95db-451f-9368-2ea137c813e4-delete_volume" released by "delete_volume" :: held 2.580s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:35:14 devstack sudo[105163]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-017f1332-f8aa-4ccc-871c-80250c2ac28a tempest-CinderUnicodeTest-1096390883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61f44cf5-7f52-4341-8d39-60f92578bcb3.info" returned: 0 in 0.693s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:14 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-017f1332-f8aa-4ccc-871c-80250c2ac28a tempest-CinderUnicodeTest-1096390883 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61f44cf5-7f52-4341-8d39-60f92578bcb3.info is being set with open permissions: ugo+rw Jul 07 08:35:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-017f1332-f8aa-4ccc-871c-80250c2ac28a tempest-CinderUnicodeTest-1096390883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61f44cf5-7f52-4341-8d39-60f92578bcb3.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:14 devstack sudo[105169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61f44cf5-7f52-4341-8d39-60f92578bcb3.info Jul 07 08:35:14 devstack sudo[105169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:14 devstack sudo[105165]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-56c9e00f-57b7-4a1b-9d76-56105c564c05 tempest-CreateVolumesFromImageTest-1340750938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-26996f84-b29d-4573-aff6-de8ef8a1491b" returned: 0 in 0.782s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-56c9e00f-57b7-4a1b-9d76-56105c564c05 tempest-CreateVolumesFromImageTest-1340750938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-26996f84-b29d-4573-aff6-de8ef8a1491b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:14 devstack sudo[105174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-26996f84-b29d-4573-aff6-de8ef8a1491b Jul 07 08:35:14 devstack sudo[105174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:14 devstack sudo[105169]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-017f1332-f8aa-4ccc-871c-80250c2ac28a tempest-CinderUnicodeTest-1096390883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61f44cf5-7f52-4341-8d39-60f92578bcb3.info" returned: 0 in 0.638s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-017f1332-f8aa-4ccc-871c-80250c2ac28a tempest-CinderUnicodeTest-1096390883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.689s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:35:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-654272fc-ba1e-418d-a91c-225681232098 tempest-ProjectReaderTests-1685940573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.777s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:35:14 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-654272fc-ba1e-418d-a91c-225681232098 tempest-ProjectReaderTests-1685940573 None] Creating offline snapshot 0cd99e87-11aa-41c9-b53f-5eef21a5779f of volume 2728c7b7-e012-465d-954d-b26b77de4bd8 {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:35:14 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-017f1332-f8aa-4ccc-871c-80250c2ac28a tempest-CinderUnicodeTest-1096390883 None] Create snapshot completed successfully Jul 07 08:35:14 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b05609-cf11-4be1-aeaf-23baaac2ffee]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:35:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-654272fc-ba1e-418d-a91c-225681232098 tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2728c7b7-e012-465d-954d-b26b77de4bd8 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:14 devstack sudo[105177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2728c7b7-e012-465d-954d-b26b77de4bd8 Jul 07 08:35:14 devstack sudo[105177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:15 devstack sudo[105174]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-56c9e00f-57b7-4a1b-9d76-56105c564c05 tempest-CreateVolumesFromImageTest-1340750938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-26996f84-b29d-4573-aff6-de8ef8a1491b" returned: 0 in 0.677s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-56c9e00f-57b7-4a1b-9d76-56105c564c05 tempest-CreateVolumesFromImageTest-1340750938 None] Lock "cinder-quobyte-26996f84-b29d-4573-aff6-de8ef8a1491b" released by "delete_volume" :: held 1.511s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:35:15 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-56c9e00f-57b7-4a1b-9d76-56105c564c05 tempest-CreateVolumesFromImageTest-1340750938 None] Created reservations ['df6a17eb-a27f-4e4d-8fe6-2ac7ee0fb2aa', 'd6936916-7ab9-43b9-a232-92305d9134a8', 'c55ccee1-48fc-4ea2-8a8a-f5ef10e74e62', '567f54a7-2d32-494d-9a2e-0e1db6f7504c'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:35:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-56c9e00f-57b7-4a1b-9d76-56105c564c05 tempest-CreateVolumesFromImageTest-1340750938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:35:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-56c9e00f-57b7-4a1b-9d76-56105c564c05 tempest-CreateVolumesFromImageTest-1340750938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:35:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-56c9e00f-57b7-4a1b-9d76-56105c564c05 tempest-CreateVolumesFromImageTest-1340750938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:35:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-56c9e00f-57b7-4a1b-9d76-56105c564c05 tempest-CreateVolumesFromImageTest-1340750938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:35:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-56c9e00f-57b7-4a1b-9d76-56105c564c05 tempest-CreateVolumesFromImageTest-1340750938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:35:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-56c9e00f-57b7-4a1b-9d76-56105c564c05 tempest-CreateVolumesFromImageTest-1340750938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:15 devstack sudo[105180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:35:15 devstack sudo[105180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9aacafc2-1d37-40fb-b1de-012dbd16c7f8 tempest-CinderUnicodeTest-1096390883 None] Acquiring lock "cinder-5e2f08bf-d9d5-40c0-a1a4-859384ac601b-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:35:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9aacafc2-1d37-40fb-b1de-012dbd16c7f8 tempest-CinderUnicodeTest-1096390883 None] Lock "cinder-5e2f08bf-d9d5-40c0-a1a4-859384ac601b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:35:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9aacafc2-1d37-40fb-b1de-012dbd16c7f8 tempest-CinderUnicodeTest-1096390883 None] Acquiring lock "cinder-quobyte-61f44cf5-7f52-4341-8d39-60f92578bcb3" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:35:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9aacafc2-1d37-40fb-b1de-012dbd16c7f8 tempest-CinderUnicodeTest-1096390883 None] Lock "cinder-quobyte-61f44cf5-7f52-4341-8d39-60f92578bcb3" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:35:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9aacafc2-1d37-40fb-b1de-012dbd16c7f8 tempest-CinderUnicodeTest-1096390883 None] Acquiring lock "cinder-quobyte-5e2f08bf-d9d5-40c0-a1a4-859384ac601b" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:35:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9aacafc2-1d37-40fb-b1de-012dbd16c7f8 tempest-CinderUnicodeTest-1096390883 None] Lock "cinder-quobyte-5e2f08bf-d9d5-40c0-a1a4-859384ac601b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:35:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-9aacafc2-1d37-40fb-b1de-012dbd16c7f8 tempest-CinderUnicodeTest-1096390883 None] Deleting offline snapshot 5e2f08bf-d9d5-40c0-a1a4-859384ac601b of volume 61f44cf5-7f52-4341-8d39-60f92578bcb3 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:35:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-9aacafc2-1d37-40fb-b1de-012dbd16c7f8 tempest-CinderUnicodeTest-1096390883 None] snapshot_file for this snap is: volume-61f44cf5-7f52-4341-8d39-60f92578bcb3.5e2f08bf-d9d5-40c0-a1a4-859384ac601b {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:35:15 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e60c424-b229-4d86-8900-dfa2cb3cfd42]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:35:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9aacafc2-1d37-40fb-b1de-012dbd16c7f8 tempest-CinderUnicodeTest-1096390883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61f44cf5-7f52-4341-8d39-60f92578bcb3.5e2f08bf-d9d5-40c0-a1a4-859384ac601b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:15 devstack sudo[105177]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-654272fc-ba1e-418d-a91c-225681232098 tempest-ProjectReaderTests-1685940573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2728c7b7-e012-465d-954d-b26b77de4bd8" returned: 0 in 0.864s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-654272fc-ba1e-418d-a91c-225681232098 tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2728c7b7-e012-465d-954d-b26b77de4bd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2728c7b7-e012-465d-954d-b26b77de4bd8.0cd99e87-11aa-41c9-b53f-5eef21a5779f 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:15 devstack sudo[105186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2728c7b7-e012-465d-954d-b26b77de4bd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2728c7b7-e012-465d-954d-b26b77de4bd8.0cd99e87-11aa-41c9-b53f-5eef21a5779f 1G Jul 07 08:35:15 devstack sudo[105186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ff951c39-52a5-42d5-b06b-1dd29e517fc6 tempest-CreateVolumesFromImageTest-1340750938 None] Acquiring lock "cinder-129e0ae3-a6a1-4950-ab3f-add16806fdac-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:35:15 devstack sudo[105185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61f44cf5-7f52-4341-8d39-60f92578bcb3.5e2f08bf-d9d5-40c0-a1a4-859384ac601b Jul 07 08:35:15 devstack sudo[105185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ff951c39-52a5-42d5-b06b-1dd29e517fc6 tempest-CreateVolumesFromImageTest-1340750938 None] Lock "cinder-129e0ae3-a6a1-4950-ab3f-add16806fdac-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:35:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ff951c39-52a5-42d5-b06b-1dd29e517fc6 tempest-CreateVolumesFromImageTest-1340750938 None] Acquiring lock "cinder-quobyte-129e0ae3-a6a1-4950-ab3f-add16806fdac" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:35:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ff951c39-52a5-42d5-b06b-1dd29e517fc6 tempest-CreateVolumesFromImageTest-1340750938 None] Lock "cinder-quobyte-129e0ae3-a6a1-4950-ab3f-add16806fdac" acquired by "delete_volume" :: waited 0.018s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:35:15 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[2488b637-7642-42b7-bee7-3c311d5b2c8c]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:35:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ff951c39-52a5-42d5-b06b-1dd29e517fc6 tempest-CreateVolumesFromImageTest-1340750938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-129e0ae3-a6a1-4950-ab3f-add16806fdac {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:15 devstack sudo[105180]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-56c9e00f-57b7-4a1b-9d76-56105c564c05 tempest-CreateVolumesFromImageTest-1340750938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.771s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:15 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-56c9e00f-57b7-4a1b-9d76-56105c564c05 tempest-CreateVolumesFromImageTest-1340750938 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:35:15 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-56c9e00f-57b7-4a1b-9d76-56105c564c05 tempest-CreateVolumesFromImageTest-1340750938 None] Deleted volume successfully. Jul 07 08:35:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-56c9e00f-57b7-4a1b-9d76-56105c564c05 tempest-CreateVolumesFromImageTest-1340750938 None] Lock "cinder-26996f84-b29d-4573-aff6-de8ef8a1491b-delete_volume" released by "delete_volume" :: held 2.505s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:35:15 devstack sudo[105190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-129e0ae3-a6a1-4950-ab3f-add16806fdac Jul 07 08:35:15 devstack sudo[105190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:16 devstack sudo[105185]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9aacafc2-1d37-40fb-b1de-012dbd16c7f8 tempest-CinderUnicodeTest-1096390883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61f44cf5-7f52-4341-8d39-60f92578bcb3.5e2f08bf-d9d5-40c0-a1a4-859384ac601b" returned: 0 in 0.947s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:16 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-9aacafc2-1d37-40fb-b1de-012dbd16c7f8 tempest-CinderUnicodeTest-1096390883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61f44cf5-7f52-4341-8d39-60f92578bcb3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:35:16 devstack sudo[105186]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-654272fc-ba1e-418d-a91c-225681232098 tempest-ProjectReaderTests-1685940573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2728c7b7-e012-465d-954d-b26b77de4bd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2728c7b7-e012-465d-954d-b26b77de4bd8.0cd99e87-11aa-41c9-b53f-5eef21a5779f 1G" returned: 0 in 0.906s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-654272fc-ba1e-418d-a91c-225681232098 tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2728c7b7-e012-465d-954d-b26b77de4bd8 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2728c7b7-e012-465d-954d-b26b77de4bd8.0cd99e87-11aa-41c9-b53f-5eef21a5779f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:16 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0a6410-1d25-47fe-b80d-c968b02fc8cd]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:35:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9aacafc2-1d37-40fb-b1de-012dbd16c7f8 tempest-CinderUnicodeTest-1096390883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61f44cf5-7f52-4341-8d39-60f92578bcb3 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:16 devstack sudo[105200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2728c7b7-e012-465d-954d-b26b77de4bd8 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2728c7b7-e012-465d-954d-b26b77de4bd8.0cd99e87-11aa-41c9-b53f-5eef21a5779f Jul 07 08:35:16 devstack sudo[105200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:16 devstack sudo[105202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61f44cf5-7f52-4341-8d39-60f92578bcb3 Jul 07 08:35:16 devstack sudo[105202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:16 devstack sudo[105190]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ff951c39-52a5-42d5-b06b-1dd29e517fc6 tempest-CreateVolumesFromImageTest-1340750938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-129e0ae3-a6a1-4950-ab3f-add16806fdac" returned: 0 in 0.872s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ff951c39-52a5-42d5-b06b-1dd29e517fc6 tempest-CreateVolumesFromImageTest-1340750938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-129e0ae3-a6a1-4950-ab3f-add16806fdac {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:16 devstack sudo[105205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-129e0ae3-a6a1-4950-ab3f-add16806fdac Jul 07 08:35:16 devstack sudo[105205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:17 devstack sudo[105200]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-654272fc-ba1e-418d-a91c-225681232098 tempest-ProjectReaderTests-1685940573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2728c7b7-e012-465d-954d-b26b77de4bd8 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2728c7b7-e012-465d-954d-b26b77de4bd8.0cd99e87-11aa-41c9-b53f-5eef21a5779f" returned: 0 in 0.700s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:17 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-654272fc-ba1e-418d-a91c-225681232098 tempest-ProjectReaderTests-1685940573 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2728c7b7-e012-465d-954d-b26b77de4bd8.0cd99e87-11aa-41c9-b53f-5eef21a5779f is being set with open permissions: ugo+rw Jul 07 08:35:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-654272fc-ba1e-418d-a91c-225681232098 tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2728c7b7-e012-465d-954d-b26b77de4bd8.0cd99e87-11aa-41c9-b53f-5eef21a5779f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:17 devstack sudo[105212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2728c7b7-e012-465d-954d-b26b77de4bd8.0cd99e87-11aa-41c9-b53f-5eef21a5779f Jul 07 08:35:17 devstack sudo[105212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:17 devstack sudo[105205]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ff951c39-52a5-42d5-b06b-1dd29e517fc6 tempest-CreateVolumesFromImageTest-1340750938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-129e0ae3-a6a1-4950-ab3f-add16806fdac" returned: 0 in 0.717s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:17 devstack sudo[105202]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9aacafc2-1d37-40fb-b1de-012dbd16c7f8 tempest-CinderUnicodeTest-1096390883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61f44cf5-7f52-4341-8d39-60f92578bcb3" returned: 0 in 0.878s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9aacafc2-1d37-40fb-b1de-012dbd16c7f8 tempest-CinderUnicodeTest-1096390883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61f44cf5-7f52-4341-8d39-60f92578bcb3.5e2f08bf-d9d5-40c0-a1a4-859384ac601b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:17 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ff951c39-52a5-42d5-b06b-1dd29e517fc6 tempest-CreateVolumesFromImageTest-1340750938 None] Lock "cinder-quobyte-129e0ae3-a6a1-4950-ab3f-add16806fdac" released by "delete_volume" :: held 1.643s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:35:17 devstack sudo[105216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61f44cf5-7f52-4341-8d39-60f92578bcb3.5e2f08bf-d9d5-40c0-a1a4-859384ac601b Jul 07 08:35:17 devstack sudo[105216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:17 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-ff951c39-52a5-42d5-b06b-1dd29e517fc6 tempest-CreateVolumesFromImageTest-1340750938 None] Created reservations ['6f17c887-bb05-413e-b930-290263c34028', '610e2373-b9e2-42da-80a6-1d6fe526fbb7', 'f941711f-b917-446c-b882-9e33b5c1ee50', '609c789c-af97-475d-8fee-6ad9dcf768c2'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:35:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ff951c39-52a5-42d5-b06b-1dd29e517fc6 tempest-CreateVolumesFromImageTest-1340750938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:35:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ff951c39-52a5-42d5-b06b-1dd29e517fc6 tempest-CreateVolumesFromImageTest-1340750938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:35:17 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ff951c39-52a5-42d5-b06b-1dd29e517fc6 tempest-CreateVolumesFromImageTest-1340750938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:35:17 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ff951c39-52a5-42d5-b06b-1dd29e517fc6 tempest-CreateVolumesFromImageTest-1340750938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:35:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ff951c39-52a5-42d5-b06b-1dd29e517fc6 tempest-CreateVolumesFromImageTest-1340750938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:35:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ff951c39-52a5-42d5-b06b-1dd29e517fc6 tempest-CreateVolumesFromImageTest-1340750938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:17 devstack sudo[105218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:35:17 devstack sudo[105218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:17 devstack sudo[105212]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-654272fc-ba1e-418d-a91c-225681232098 tempest-ProjectReaderTests-1685940573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2728c7b7-e012-465d-954d-b26b77de4bd8.0cd99e87-11aa-41c9-b53f-5eef21a5779f" returned: 0 in 0.659s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-654272fc-ba1e-418d-a91c-225681232098 tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2728c7b7-e012-465d-954d-b26b77de4bd8.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:18 devstack sudo[105221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2728c7b7-e012-465d-954d-b26b77de4bd8.info Jul 07 08:35:18 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:18 devstack sudo[105216]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9aacafc2-1d37-40fb-b1de-012dbd16c7f8 tempest-CinderUnicodeTest-1096390883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61f44cf5-7f52-4341-8d39-60f92578bcb3.5e2f08bf-d9d5-40c0-a1a4-859384ac601b" returned: 0 in 0.920s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9aacafc2-1d37-40fb-b1de-012dbd16c7f8 tempest-CinderUnicodeTest-1096390883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61f44cf5-7f52-4341-8d39-60f92578bcb3.5e2f08bf-d9d5-40c0-a1a4-859384ac601b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:18 devstack sudo[105228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61f44cf5-7f52-4341-8d39-60f92578bcb3.5e2f08bf-d9d5-40c0-a1a4-859384ac601b Jul 07 08:35:18 devstack sudo[105228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:18 devstack sudo[105218]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ff951c39-52a5-42d5-b06b-1dd29e517fc6 tempest-CreateVolumesFromImageTest-1340750938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.830s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:18 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ff951c39-52a5-42d5-b06b-1dd29e517fc6 tempest-CreateVolumesFromImageTest-1340750938 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:35:18 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-ff951c39-52a5-42d5-b06b-1dd29e517fc6 tempest-CreateVolumesFromImageTest-1340750938 None] Deleted volume successfully. Jul 07 08:35:18 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ff951c39-52a5-42d5-b06b-1dd29e517fc6 tempest-CreateVolumesFromImageTest-1340750938 None] Lock "cinder-129e0ae3-a6a1-4950-ab3f-add16806fdac-delete_volume" released by "delete_volume" :: held 2.746s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:35:18 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-654272fc-ba1e-418d-a91c-225681232098 tempest-ProjectReaderTests-1685940573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2728c7b7-e012-465d-954d-b26b77de4bd8.info" returned: 0 in 0.740s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:18 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-654272fc-ba1e-418d-a91c-225681232098 tempest-ProjectReaderTests-1685940573 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2728c7b7-e012-465d-954d-b26b77de4bd8.info is being set with open permissions: ugo+rw Jul 07 08:35:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-654272fc-ba1e-418d-a91c-225681232098 tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2728c7b7-e012-465d-954d-b26b77de4bd8.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:18 devstack sudo[105231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2728c7b7-e012-465d-954d-b26b77de4bd8.info Jul 07 08:35:18 devstack sudo[105231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:19 devstack sudo[105228]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9aacafc2-1d37-40fb-b1de-012dbd16c7f8 tempest-CinderUnicodeTest-1096390883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61f44cf5-7f52-4341-8d39-60f92578bcb3.5e2f08bf-d9d5-40c0-a1a4-859384ac601b" returned: 0 in 0.793s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:19 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9aacafc2-1d37-40fb-b1de-012dbd16c7f8 tempest-CinderUnicodeTest-1096390883 None] Lock "cinder-quobyte-5e2f08bf-d9d5-40c0-a1a4-859384ac601b" released by "_delete_snapshot" :: held 3.671s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:35:19 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9aacafc2-1d37-40fb-b1de-012dbd16c7f8 tempest-CinderUnicodeTest-1096390883 None] Lock "cinder-quobyte-61f44cf5-7f52-4341-8d39-60f92578bcb3" released by "delete_snapshot" :: held 3.697s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:35:19 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-9aacafc2-1d37-40fb-b1de-012dbd16c7f8 tempest-CinderUnicodeTest-1096390883 None] Created reservations ['20d95fa6-ab50-4412-a00b-6db150f87653', '1bca42c0-3ae2-4e3f-857d-ce2964679e42', 'dcb9b779-0912-47ef-a237-0c46fe0744e9', 'bc32f187-aee7-4009-a66c-9565413c99c7'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:35:19 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-9aacafc2-1d37-40fb-b1de-012dbd16c7f8 tempest-CinderUnicodeTest-1096390883 None] Delete snapshot completed successfully. Jul 07 08:35:19 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9aacafc2-1d37-40fb-b1de-012dbd16c7f8 tempest-CinderUnicodeTest-1096390883 None] Lock "cinder-5e2f08bf-d9d5-40c0-a1a4-859384ac601b-delete_snapshot" released by "delete_snapshot" :: held 3.886s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:35:19 devstack sudo[105231]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-654272fc-ba1e-418d-a91c-225681232098 tempest-ProjectReaderTests-1685940573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2728c7b7-e012-465d-954d-b26b77de4bd8.info" returned: 0 in 0.785s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-654272fc-ba1e-418d-a91c-225681232098 tempest-ProjectReaderTests-1685940573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.771s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:35:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1f723408-cf9e-4464-a004-459e4a92759b tempest-VolumeDependencyTests-1845104136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.437s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:35:19 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1f723408-cf9e-4464-a004-459e4a92759b tempest-VolumeDependencyTests-1845104136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:35:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-771839099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37b9eccf-0b7d-4b85-9885-9e7b74d66a6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7da866dad32f42bd93c9551dfa09aad8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:35:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:35:11Z,use_quota=True,user_id='d430fbd4e046491dbb0ca0cdff586591',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:35:19 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-1f723408-cf9e-4464-a004-459e4a92759b tempest-VolumeDependencyTests-1845104136 None] Creating volume 37b9eccf-0b7d-4b85-9885-9e7b74d66a6b {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:35:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1f723408-cf9e-4464-a004-459e4a92759b tempest-VolumeDependencyTests-1845104136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:35:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1f723408-cf9e-4464-a004-459e4a92759b tempest-VolumeDependencyTests-1845104136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:35:19 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1f723408-cf9e-4464-a004-459e4a92759b tempest-VolumeDependencyTests-1845104136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:35:19 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1f723408-cf9e-4464-a004-459e4a92759b tempest-VolumeDependencyTests-1845104136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:35:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1f723408-cf9e-4464-a004-459e4a92759b tempest-VolumeDependencyTests-1845104136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:35:19 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1f723408-cf9e-4464-a004-459e4a92759b tempest-VolumeDependencyTests-1845104136 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:35:19 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-1f723408-cf9e-4464-a004-459e4a92759b tempest-VolumeDependencyTests-1845104136 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:35:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1f723408-cf9e-4464-a004-459e4a92759b tempest-VolumeDependencyTests-1845104136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:19 devstack sudo[105235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b 1073741824 Jul 07 08:35:19 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:19 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-654272fc-ba1e-418d-a91c-225681232098 tempest-ProjectReaderTests-1685940573 None] Create snapshot completed successfully Jul 07 08:35:19 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9402860f-41a0-4bac-8b8f-5095c400a50a tempest-CinderUnicodeTest-1096390883 None] Acquiring lock "cinder-61f44cf5-7f52-4341-8d39-60f92578bcb3-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:35:19 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9402860f-41a0-4bac-8b8f-5095c400a50a tempest-CinderUnicodeTest-1096390883 None] Lock "cinder-61f44cf5-7f52-4341-8d39-60f92578bcb3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:35:19 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9402860f-41a0-4bac-8b8f-5095c400a50a tempest-CinderUnicodeTest-1096390883 None] Acquiring lock "cinder-quobyte-61f44cf5-7f52-4341-8d39-60f92578bcb3" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:35:19 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9402860f-41a0-4bac-8b8f-5095c400a50a tempest-CinderUnicodeTest-1096390883 None] Lock "cinder-quobyte-61f44cf5-7f52-4341-8d39-60f92578bcb3" acquired by "delete_volume" :: waited 0.018s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:35:19 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[76beba25-864d-4b30-bf64-7fb52f17982f]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:35:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9402860f-41a0-4bac-8b8f-5095c400a50a tempest-CinderUnicodeTest-1096390883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61f44cf5-7f52-4341-8d39-60f92578bcb3 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:20 devstack sudo[105237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61f44cf5-7f52-4341-8d39-60f92578bcb3 Jul 07 08:35:20 devstack sudo[105237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:20 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-723e8574-0bf4-4d1f-9070-6c6f73e8af69 tempest-ProjectReaderTests-1685940573 None] Acquiring lock "cinder-0cd99e87-11aa-41c9-b53f-5eef21a5779f-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:35:20 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-723e8574-0bf4-4d1f-9070-6c6f73e8af69 tempest-ProjectReaderTests-1685940573 None] Lock "cinder-0cd99e87-11aa-41c9-b53f-5eef21a5779f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:35:20 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-723e8574-0bf4-4d1f-9070-6c6f73e8af69 tempest-ProjectReaderTests-1685940573 None] Acquiring lock "cinder-quobyte-2728c7b7-e012-465d-954d-b26b77de4bd8" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:35:20 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-723e8574-0bf4-4d1f-9070-6c6f73e8af69 tempest-ProjectReaderTests-1685940573 None] Lock "cinder-quobyte-2728c7b7-e012-465d-954d-b26b77de4bd8" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:35:20 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-723e8574-0bf4-4d1f-9070-6c6f73e8af69 tempest-ProjectReaderTests-1685940573 None] Acquiring lock "cinder-quobyte-0cd99e87-11aa-41c9-b53f-5eef21a5779f" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:35:20 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-723e8574-0bf4-4d1f-9070-6c6f73e8af69 tempest-ProjectReaderTests-1685940573 None] Lock "cinder-quobyte-0cd99e87-11aa-41c9-b53f-5eef21a5779f" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:35:20 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-723e8574-0bf4-4d1f-9070-6c6f73e8af69 tempest-ProjectReaderTests-1685940573 None] Deleting offline snapshot 0cd99e87-11aa-41c9-b53f-5eef21a5779f of volume 2728c7b7-e012-465d-954d-b26b77de4bd8 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:35:20 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-723e8574-0bf4-4d1f-9070-6c6f73e8af69 tempest-ProjectReaderTests-1685940573 None] snapshot_file for this snap is: volume-2728c7b7-e012-465d-954d-b26b77de4bd8.0cd99e87-11aa-41c9-b53f-5eef21a5779f {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:35:20 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e57f47-9b1b-4cb6-afd5-cfcfa2f3f40d]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:35:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-723e8574-0bf4-4d1f-9070-6c6f73e8af69 tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2728c7b7-e012-465d-954d-b26b77de4bd8.0cd99e87-11aa-41c9-b53f-5eef21a5779f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:20 devstack sudo[105242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2728c7b7-e012-465d-954d-b26b77de4bd8.0cd99e87-11aa-41c9-b53f-5eef21a5779f Jul 07 08:35:20 devstack sudo[105242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:20 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1f723408-cf9e-4464-a004-459e4a92759b tempest-VolumeDependencyTests-1845104136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b 1073741824" returned: 0 in 1.118s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1f723408-cf9e-4464-a004-459e4a92759b tempest-VolumeDependencyTests-1845104136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:20 devstack sudo[105245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b Jul 07 08:35:20 devstack sudo[105245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:20 devstack sudo[105237]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9402860f-41a0-4bac-8b8f-5095c400a50a tempest-CinderUnicodeTest-1096390883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61f44cf5-7f52-4341-8d39-60f92578bcb3" returned: 0 in 1.038s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9402860f-41a0-4bac-8b8f-5095c400a50a tempest-CinderUnicodeTest-1096390883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61f44cf5-7f52-4341-8d39-60f92578bcb3 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:21 devstack sudo[105250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61f44cf5-7f52-4341-8d39-60f92578bcb3 Jul 07 08:35:21 devstack sudo[105250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:21 devstack sudo[105242]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-723e8574-0bf4-4d1f-9070-6c6f73e8af69 tempest-ProjectReaderTests-1685940573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2728c7b7-e012-465d-954d-b26b77de4bd8.0cd99e87-11aa-41c9-b53f-5eef21a5779f" returned: 0 in 0.915s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:21 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-723e8574-0bf4-4d1f-9070-6c6f73e8af69 tempest-ProjectReaderTests-1685940573 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2728c7b7-e012-465d-954d-b26b77de4bd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:35:21 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[6466bf42-245c-4ce3-9bc1-9e4f78350fa2]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:35:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-723e8574-0bf4-4d1f-9070-6c6f73e8af69 tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2728c7b7-e012-465d-954d-b26b77de4bd8 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:21 devstack sudo[105257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2728c7b7-e012-465d-954d-b26b77de4bd8 Jul 07 08:35:21 devstack sudo[105257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:21 devstack sudo[105245]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1f723408-cf9e-4464-a004-459e4a92759b tempest-VolumeDependencyTests-1845104136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b" returned: 0 in 0.830s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:21 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1f723408-cf9e-4464-a004-459e4a92759b tempest-VolumeDependencyTests-1845104136 None] <== create_volume: return (2003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:35:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1f723408-cf9e-4464-a004-459e4a92759b tempest-VolumeDependencyTests-1845104136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:35:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1f723408-cf9e-4464-a004-459e4a92759b tempest-VolumeDependencyTests-1845104136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d5b64f4-5712-48bb-a072-250be05a8c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:35:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1f723408-cf9e-4464-a004-459e4a92759b tempest-VolumeDependencyTests-1845104136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc00e55d-281e-4b7b-96da-94309c483337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:35:21 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-1f723408-cf9e-4464-a004-459e4a92759b tempest-VolumeDependencyTests-1845104136 None] Volume volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b (37b9eccf-0b7d-4b85-9885-9e7b74d66a6b): created successfully Jul 07 08:35:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1f723408-cf9e-4464-a004-459e4a92759b tempest-VolumeDependencyTests-1845104136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc00e55d-281e-4b7b-96da-94309c483337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:35:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-1f723408-cf9e-4464-a004-459e4a92759b tempest-VolumeDependencyTests-1845104136 None] Flow 'volume_create_manager' (e41c3f19-9730-4c70-94f5-5306042354b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:35:21 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-1f723408-cf9e-4464-a004-459e4a92759b tempest-VolumeDependencyTests-1845104136 None] Created volume successfully. Jul 07 08:35:21 devstack sudo[105250]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9402860f-41a0-4bac-8b8f-5095c400a50a tempest-CinderUnicodeTest-1096390883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-61f44cf5-7f52-4341-8d39-60f92578bcb3" returned: 0 in 0.745s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:21 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9402860f-41a0-4bac-8b8f-5095c400a50a tempest-CinderUnicodeTest-1096390883 None] Lock "cinder-quobyte-61f44cf5-7f52-4341-8d39-60f92578bcb3" released by "delete_volume" :: held 1.863s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:35:21 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-9402860f-41a0-4bac-8b8f-5095c400a50a tempest-CinderUnicodeTest-1096390883 None] Created reservations ['4e1d05b7-d5d2-42a0-b831-24db89e92d74', '802b6dd3-80f4-4539-aeaf-67f35cffd283', '6916a7a0-39f1-43c0-afca-a5fad12b764a', '14a699da-0e1d-49c1-9faa-cc4438886ed3'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:35:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9402860f-41a0-4bac-8b8f-5095c400a50a tempest-CinderUnicodeTest-1096390883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:35:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9402860f-41a0-4bac-8b8f-5095c400a50a tempest-CinderUnicodeTest-1096390883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:35:21 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-9402860f-41a0-4bac-8b8f-5095c400a50a tempest-CinderUnicodeTest-1096390883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:35:21 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-9402860f-41a0-4bac-8b8f-5095c400a50a tempest-CinderUnicodeTest-1096390883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:35:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9402860f-41a0-4bac-8b8f-5095c400a50a tempest-CinderUnicodeTest-1096390883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:35:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9402860f-41a0-4bac-8b8f-5095c400a50a tempest-CinderUnicodeTest-1096390883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:21 devstack sudo[105261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:35:21 devstack sudo[105261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:22 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-61605fb6-6066-4714-a150-90695ec5a8f6 tempest-CinderUnicodeTest-1096390883 None] Acquiring lock "cinder-619e8c15-919b-4c1e-b3a6-c109cc77a55f-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:35:22 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-61605fb6-6066-4714-a150-90695ec5a8f6 tempest-CinderUnicodeTest-1096390883 None] Lock "cinder-619e8c15-919b-4c1e-b3a6-c109cc77a55f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:35:22 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-61605fb6-6066-4714-a150-90695ec5a8f6 tempest-CinderUnicodeTest-1096390883 None] Acquiring lock "cinder-quobyte-619e8c15-919b-4c1e-b3a6-c109cc77a55f" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:35:22 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-61605fb6-6066-4714-a150-90695ec5a8f6 tempest-CinderUnicodeTest-1096390883 None] Lock "cinder-quobyte-619e8c15-919b-4c1e-b3a6-c109cc77a55f" acquired by "delete_volume" :: waited 0.014s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:35:22 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[439285ad-77b5-49a5-92a7-61013631055c]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:35:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-61605fb6-6066-4714-a150-90695ec5a8f6 tempest-CinderUnicodeTest-1096390883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-619e8c15-919b-4c1e-b3a6-c109cc77a55f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:22 devstack sudo[105257]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-723e8574-0bf4-4d1f-9070-6c6f73e8af69 tempest-ProjectReaderTests-1685940573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2728c7b7-e012-465d-954d-b26b77de4bd8" returned: 0 in 0.949s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-723e8574-0bf4-4d1f-9070-6c6f73e8af69 tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2728c7b7-e012-465d-954d-b26b77de4bd8.0cd99e87-11aa-41c9-b53f-5eef21a5779f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:22 devstack sudo[105267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-619e8c15-919b-4c1e-b3a6-c109cc77a55f Jul 07 08:35:22 devstack sudo[105267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:22 devstack sudo[105268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2728c7b7-e012-465d-954d-b26b77de4bd8.0cd99e87-11aa-41c9-b53f-5eef21a5779f Jul 07 08:35:22 devstack sudo[105268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:22 devstack sudo[105261]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9402860f-41a0-4bac-8b8f-5095c400a50a tempest-CinderUnicodeTest-1096390883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.838s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:22 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-9402860f-41a0-4bac-8b8f-5095c400a50a tempest-CinderUnicodeTest-1096390883 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:35:22 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-9402860f-41a0-4bac-8b8f-5095c400a50a tempest-CinderUnicodeTest-1096390883 None] Deleted volume successfully. Jul 07 08:35:22 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9402860f-41a0-4bac-8b8f-5095c400a50a tempest-CinderUnicodeTest-1096390883 None] Lock "cinder-61f44cf5-7f52-4341-8d39-60f92578bcb3-delete_volume" released by "delete_volume" :: held 2.970s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:35:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ce81f07e-27a2-46bc-b5da-8562a09f2622 tempest-VolumeDependencyTests-1845104136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:35:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ce81f07e-27a2-46bc-b5da-8562a09f2622 tempest-VolumeDependencyTests-1845104136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:35:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-ce81f07e-27a2-46bc-b5da-8562a09f2622 tempest-VolumeDependencyTests-1845104136 None] Creating offline snapshot 08430f3a-1360-4aa6-836f-d97461f432d7 of volume 37b9eccf-0b7d-4b85-9885-9e7b74d66a6b {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:35:23 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89e83ce-93bb-4f57-bc26-88a2494814c3]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:35:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ce81f07e-27a2-46bc-b5da-8562a09f2622 tempest-VolumeDependencyTests-1845104136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:23 devstack sudo[105278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b Jul 07 08:35:23 devstack sudo[105278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:23 devstack sudo[105268]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-723e8574-0bf4-4d1f-9070-6c6f73e8af69 tempest-ProjectReaderTests-1685940573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2728c7b7-e012-465d-954d-b26b77de4bd8.0cd99e87-11aa-41c9-b53f-5eef21a5779f" returned: 0 in 0.930s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-723e8574-0bf4-4d1f-9070-6c6f73e8af69 tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2728c7b7-e012-465d-954d-b26b77de4bd8.0cd99e87-11aa-41c9-b53f-5eef21a5779f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:23 devstack sudo[105280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2728c7b7-e012-465d-954d-b26b77de4bd8.0cd99e87-11aa-41c9-b53f-5eef21a5779f Jul 07 08:35:23 devstack sudo[105280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:23 devstack sudo[105267]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-61605fb6-6066-4714-a150-90695ec5a8f6 tempest-CinderUnicodeTest-1096390883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-619e8c15-919b-4c1e-b3a6-c109cc77a55f" returned: 0 in 1.120s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-61605fb6-6066-4714-a150-90695ec5a8f6 tempest-CinderUnicodeTest-1096390883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-619e8c15-919b-4c1e-b3a6-c109cc77a55f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:23 devstack sudo[105282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-619e8c15-919b-4c1e-b3a6-c109cc77a55f Jul 07 08:35:23 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:23 devstack sudo[105280]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-723e8574-0bf4-4d1f-9070-6c6f73e8af69 tempest-ProjectReaderTests-1685940573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2728c7b7-e012-465d-954d-b26b77de4bd8.0cd99e87-11aa-41c9-b53f-5eef21a5779f" returned: 0 in 0.770s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:24 devstack sudo[105278]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ce81f07e-27a2-46bc-b5da-8562a09f2622 tempest-VolumeDependencyTests-1845104136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b" returned: 0 in 0.943s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ce81f07e-27a2-46bc-b5da-8562a09f2622 tempest-VolumeDependencyTests-1845104136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b.08430f3a-1360-4aa6-836f-d97461f432d7 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-723e8574-0bf4-4d1f-9070-6c6f73e8af69 tempest-ProjectReaderTests-1685940573 None] Lock "cinder-quobyte-0cd99e87-11aa-41c9-b53f-5eef21a5779f" released by "_delete_snapshot" :: held 3.721s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:35:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-723e8574-0bf4-4d1f-9070-6c6f73e8af69 tempest-ProjectReaderTests-1685940573 None] Lock "cinder-quobyte-2728c7b7-e012-465d-954d-b26b77de4bd8" released by "delete_snapshot" :: held 3.766s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:35:24 devstack sudo[105291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b.08430f3a-1360-4aa6-836f-d97461f432d7 1G Jul 07 08:35:24 devstack sudo[105291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:24 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-61605fb6-6066-4714-a150-90695ec5a8f6 tempest-CinderUnicodeTest-1096390883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-619e8c15-919b-4c1e-b3a6-c109cc77a55f" returned: 0 in 0.897s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-61605fb6-6066-4714-a150-90695ec5a8f6 tempest-CinderUnicodeTest-1096390883 None] Lock "cinder-quobyte-619e8c15-919b-4c1e-b3a6-c109cc77a55f" released by "delete_volume" :: held 2.067s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:35:24 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-723e8574-0bf4-4d1f-9070-6c6f73e8af69 tempest-ProjectReaderTests-1685940573 None] Created reservations ['7ac23273-4486-4d47-a1bf-c6617c53300a', '3439c52e-74ed-4f09-9f01-e942cb267fb4', '9296e85d-8adf-496c-a358-0a3fb7a723d7', '3f515aea-9c2f-4662-99cb-d6f435be6ec9'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:35:24 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-61605fb6-6066-4714-a150-90695ec5a8f6 tempest-CinderUnicodeTest-1096390883 None] Created reservations ['e3c82741-1431-4b40-af51-ab61038759dc', '87ad1bca-3d83-479f-bfd1-f61c3bc05b83', 'fbd46833-9461-4a8e-b66f-23e6e6dfdc37', '816f0ac7-bb7b-42ad-a0b0-2da1a2e3020e'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:35:24 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-723e8574-0bf4-4d1f-9070-6c6f73e8af69 tempest-ProjectReaderTests-1685940573 None] Delete snapshot completed successfully. Jul 07 08:35:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-723e8574-0bf4-4d1f-9070-6c6f73e8af69 tempest-ProjectReaderTests-1685940573 None] Lock "cinder-0cd99e87-11aa-41c9-b53f-5eef21a5779f-delete_snapshot" released by "delete_snapshot" :: held 4.085s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:35:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-61605fb6-6066-4714-a150-90695ec5a8f6 tempest-CinderUnicodeTest-1096390883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:35:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-61605fb6-6066-4714-a150-90695ec5a8f6 tempest-CinderUnicodeTest-1096390883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:35:24 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-61605fb6-6066-4714-a150-90695ec5a8f6 tempest-CinderUnicodeTest-1096390883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:35:24 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-61605fb6-6066-4714-a150-90695ec5a8f6 tempest-CinderUnicodeTest-1096390883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:35:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-61605fb6-6066-4714-a150-90695ec5a8f6 tempest-CinderUnicodeTest-1096390883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:35:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-61605fb6-6066-4714-a150-90695ec5a8f6 tempest-CinderUnicodeTest-1096390883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:24 devstack sudo[105293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:35:24 devstack sudo[105293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d1f108a0-9ade-4a8f-8d5d-a95cd28071a1 tempest-ProjectReaderTests-1685940573 None] Acquiring lock "cinder-2728c7b7-e012-465d-954d-b26b77de4bd8-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:35:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d1f108a0-9ade-4a8f-8d5d-a95cd28071a1 tempest-ProjectReaderTests-1685940573 None] Lock "cinder-2728c7b7-e012-465d-954d-b26b77de4bd8-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:35:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d1f108a0-9ade-4a8f-8d5d-a95cd28071a1 tempest-ProjectReaderTests-1685940573 None] Acquiring lock "cinder-quobyte-2728c7b7-e012-465d-954d-b26b77de4bd8" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:35:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d1f108a0-9ade-4a8f-8d5d-a95cd28071a1 tempest-ProjectReaderTests-1685940573 None] Lock "cinder-quobyte-2728c7b7-e012-465d-954d-b26b77de4bd8" acquired by "delete_volume" :: waited 0.020s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:35:24 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b70f418-ac83-456f-a4ce-a7c46d299b4c]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:35:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d1f108a0-9ade-4a8f-8d5d-a95cd28071a1 tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2728c7b7-e012-465d-954d-b26b77de4bd8 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:24 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:35:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] Flow 'volume_create_manager' (86f1dfff-a59c-40bc-a5e3-588cad795250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:35:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf198ff8-ddd7-49df-a13b-d6523082dffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:35:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf198ff8-ddd7-49df-a13b-d6523082dffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:35:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7225066-7442-4d19-92c8-12090330f5f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6f4a3e6d6f1442c84ed95f054770f05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:35:25Z,use_quota=True,user_id='09e2f2e33333447497de56142b35f806',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:35:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87c890e0-8cf6-4909-95e5-af1e28a9a725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:35:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87c890e0-8cf6-4909-95e5-af1e28a9a725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:35:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cac038c2-9bdb-488b-b1df-428796cd5f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:35:24 devstack cinder-volume[87199]: DEBUG cinder.image.glance [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] Creating Keystone auth plugin from conf {{(pid=87199) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 08:35:24 devstack sudo[105295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2728c7b7-e012-465d-954d-b26b77de4bd8 Jul 07 08:35:24 devstack sudo[105295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:25 devstack sudo[105291]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:25 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cac038c2-9bdb-488b-b1df-428796cd5f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c7225066-7442-4d19-92c8-12090330f5f0', 'volume_name': 'volume-c7225066-7442-4d19-92c8-12090330f5f0', 'volume_size': 1, 'image_id': '174b55e7-4068-4ad3-8453-ae11bea1dea8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/174b55e7-4068-4ad3-8453-ae11bea1dea8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '44b5c5c622655203a3ed1bc0054b36c1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd6f4a3e6d6f1442c84ed95f054770f05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bc23814da343304017f66f159a9d74702926173d4c0193428d1fc16aeef0a91e87917eba588b47f8eb7a322bb48ba42c26542546b7347393188425373476f27a', 'id': '174b55e7-4068-4ad3-8453-ae11bea1dea8', 'created_at': datetime.datetime(2026, 7, 7, 6, 35, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 6, 35, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/174b55e7-4068-4ad3-8453-ae11bea1dea8/file', 'properties': {}}, 'image_service': }' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:35:25 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71e8f263-fac5-4e10-91a2-63d773c00059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:35:25 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71e8f263-fac5-4e10-91a2-63d773c00059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:35:25 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb78b934-2d80-45d9-b72c-1e52ce320cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:35:25 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] Volume c7225066-7442-4d19-92c8-12090330f5f0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c7225066-7442-4d19-92c8-12090330f5f0', 'volume_size': 1, 'image_id': '174b55e7-4068-4ad3-8453-ae11bea1dea8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/174b55e7-4068-4ad3-8453-ae11bea1dea8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '44b5c5c622655203a3ed1bc0054b36c1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd6f4a3e6d6f1442c84ed95f054770f05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bc23814da343304017f66f159a9d74702926173d4c0193428d1fc16aeef0a91e87917eba588b47f8eb7a322bb48ba42c26542546b7347393188425373476f27a', 'id': '174b55e7-4068-4ad3-8453-ae11bea1dea8', 'created_at': datetime.datetime(2026, 7, 7, 6, 35, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 6, 35, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/174b55e7-4068-4ad3-8453-ae11bea1dea8/file', 'properties': {}}, 'image_service': } Jul 07 08:35:25 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] Trying to clone c7225066-7442-4d19-92c8-12090330f5f0 from image 174b55e7-4068-4ad3-8453-ae11bea1dea8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/174b55e7-4068-4ad3-8453-ae11bea1dea8', 'metadata': {}}]). {{(pid=87199) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 08:35:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ce81f07e-27a2-46bc-b5da-8562a09f2622 tempest-VolumeDependencyTests-1845104136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b.08430f3a-1360-4aa6-836f-d97461f432d7 1G" returned: 0 in 1.100s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ce81f07e-27a2-46bc-b5da-8562a09f2622 tempest-VolumeDependencyTests-1845104136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b.08430f3a-1360-4aa6-836f-d97461f432d7 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:25 devstack sudo[105302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b.08430f3a-1360-4aa6-836f-d97461f432d7 Jul 07 08:35:25 devstack sudo[105302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:25 devstack sudo[105293]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-61605fb6-6066-4714-a150-90695ec5a8f6 tempest-CinderUnicodeTest-1096390883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.848s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:25 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-61605fb6-6066-4714-a150-90695ec5a8f6 tempest-CinderUnicodeTest-1096390883 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:35:25 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_174b55e7-4068-4ad3-8453-ae11bea1dea8_iclarue9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87199) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 08:35:25 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] Image download 0.00 MB at 0.00 MB/s Jul 07 08:35:25 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-61605fb6-6066-4714-a150-90695ec5a8f6 tempest-CinderUnicodeTest-1096390883 None] Deleted volume successfully. Jul 07 08:35:25 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-61605fb6-6066-4714-a150-90695ec5a8f6 tempest-CinderUnicodeTest-1096390883 None] Lock "cinder-619e8c15-919b-4c1e-b3a6-c109cc77a55f-delete_volume" released by "delete_volume" :: held 3.194s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:35:25 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39eac5e-0da5-4319-8958-e6b846c576cc]: (4, 'raw') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:35:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_174b55e7-4068-4ad3-8453-ae11bea1dea8_iclarue9devstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:25 devstack sudo[105304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_174b55e7-4068-4ad3-8453-ae11bea1dea8_iclarue9devstack@QuobyteHD Jul 07 08:35:25 devstack sudo[105304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:25 devstack sudo[105295]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d1f108a0-9ade-4a8f-8d5d-a95cd28071a1 tempest-ProjectReaderTests-1685940573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2728c7b7-e012-465d-954d-b26b77de4bd8" returned: 0 in 0.916s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d1f108a0-9ade-4a8f-8d5d-a95cd28071a1 tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2728c7b7-e012-465d-954d-b26b77de4bd8 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:25 devstack sudo[105310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2728c7b7-e012-465d-954d-b26b77de4bd8 Jul 07 08:35:25 devstack sudo[105310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:25 devstack sudo[105302]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ce81f07e-27a2-46bc-b5da-8562a09f2622 tempest-VolumeDependencyTests-1845104136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b.08430f3a-1360-4aa6-836f-d97461f432d7" returned: 0 in 0.836s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:25 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-ce81f07e-27a2-46bc-b5da-8562a09f2622 tempest-VolumeDependencyTests-1845104136 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b.08430f3a-1360-4aa6-836f-d97461f432d7 is being set with open permissions: ugo+rw Jul 07 08:35:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ce81f07e-27a2-46bc-b5da-8562a09f2622 tempest-VolumeDependencyTests-1845104136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b.08430f3a-1360-4aa6-836f-d97461f432d7 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:26 devstack sudo[105315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b.08430f3a-1360-4aa6-836f-d97461f432d7 Jul 07 08:35:26 devstack sudo[105315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:26 devstack sudo[105304]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_174b55e7-4068-4ad3-8453-ae11bea1dea8_iclarue9devstack@QuobyteHD" returned: 0 in 0.890s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_174b55e7-4068-4ad3-8453-ae11bea1dea8_iclarue9devstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:26 devstack sudo[105319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_174b55e7-4068-4ad3-8453-ae11bea1dea8_iclarue9devstack@QuobyteHD Jul 07 08:35:26 devstack sudo[105319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:26 devstack sudo[105310]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d1f108a0-9ade-4a8f-8d5d-a95cd28071a1 tempest-ProjectReaderTests-1685940573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-2728c7b7-e012-465d-954d-b26b77de4bd8" returned: 0 in 0.792s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:26 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d1f108a0-9ade-4a8f-8d5d-a95cd28071a1 tempest-ProjectReaderTests-1685940573 None] Lock "cinder-quobyte-2728c7b7-e012-465d-954d-b26b77de4bd8" released by "delete_volume" :: held 1.794s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:35:26 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-d1f108a0-9ade-4a8f-8d5d-a95cd28071a1 tempest-ProjectReaderTests-1685940573 None] Created reservations ['4ed1b348-2a10-4f08-802b-1d8c48e161aa', 'da668fbf-1f97-4e00-9714-afd7cfde2096', 'cf3752e6-8842-4ee5-ab02-b9984237007e', '4b2df5d0-2ba2-4ff2-9f61-fed15868c0e2'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:35:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d1f108a0-9ade-4a8f-8d5d-a95cd28071a1 tempest-ProjectReaderTests-1685940573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:35:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d1f108a0-9ade-4a8f-8d5d-a95cd28071a1 tempest-ProjectReaderTests-1685940573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:35:26 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d1f108a0-9ade-4a8f-8d5d-a95cd28071a1 tempest-ProjectReaderTests-1685940573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:35:26 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d1f108a0-9ade-4a8f-8d5d-a95cd28071a1 tempest-ProjectReaderTests-1685940573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:35:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d1f108a0-9ade-4a8f-8d5d-a95cd28071a1 tempest-ProjectReaderTests-1685940573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:35:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d1f108a0-9ade-4a8f-8d5d-a95cd28071a1 tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:26 devstack sudo[105322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:35:26 devstack sudo[105322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:26 devstack sudo[105315]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ce81f07e-27a2-46bc-b5da-8562a09f2622 tempest-VolumeDependencyTests-1845104136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b.08430f3a-1360-4aa6-836f-d97461f432d7" returned: 0 in 0.860s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ce81f07e-27a2-46bc-b5da-8562a09f2622 tempest-VolumeDependencyTests-1845104136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:26 devstack sudo[105325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b.info Jul 07 08:35:26 devstack sudo[105325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:27 devstack sudo[105319]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_174b55e7-4068-4ad3-8453-ae11bea1dea8_iclarue9devstack@QuobyteHD" returned: 1 in 1.159s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_174b55e7-4068-4ad3-8453-ae11bea1dea8_iclarue9devstack@QuobyteHD' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:35:27 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] Temporary image 174b55e7-4068-4ad3-8453-ae11bea1dea8 is fetched for user 09e2f2e33333447497de56142b35f806. {{(pid=87199) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 08:35:27 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a9d64a-a3d9-4c0f-9db4-b4cc03bde516]: (4, 'raw') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:35:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_174b55e7-4068-4ad3-8453-ae11bea1dea8_iclarue9devstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:27 devstack sudo[105322]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d1f108a0-9ade-4a8f-8d5d-a95cd28071a1 tempest-ProjectReaderTests-1685940573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.929s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:27 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-d1f108a0-9ade-4a8f-8d5d-a95cd28071a1 tempest-ProjectReaderTests-1685940573 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:35:27 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-d1f108a0-9ade-4a8f-8d5d-a95cd28071a1 tempest-ProjectReaderTests-1685940573 None] Deleted volume successfully. Jul 07 08:35:27 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-892e50b5-6823-4332-abe2-c4dbb19cfecf tempest-ProjectReaderTests-1685940573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:35:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-892e50b5-6823-4332-abe2-c4dbb19cfecf tempest-ProjectReaderTests-1685940573 None] Flow 'volume_create_manager' (7f046d70-0f7b-4e86-9bc8-fd14f6cfcfdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:35:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-892e50b5-6823-4332-abe2-c4dbb19cfecf tempest-ProjectReaderTests-1685940573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04be4e4d-5b07-4764-943e-ba45414e20bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:35:27 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d1f108a0-9ade-4a8f-8d5d-a95cd28071a1 tempest-ProjectReaderTests-1685940573 None] Lock "cinder-2728c7b7-e012-465d-954d-b26b77de4bd8-delete_volume" released by "delete_volume" :: held 3.039s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:35:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-892e50b5-6823-4332-abe2-c4dbb19cfecf tempest-ProjectReaderTests-1685940573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04be4e4d-5b07-4764-943e-ba45414e20bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:35:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1072009517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56ce7c1b-bbb3-4d3a-972b-900563b361d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06330941a308447a9ec29b93464314b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:35:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:35:28Z,use_quota=True,user_id='7e7152ed33e44a5a937717a4c518b2d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:35:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-892e50b5-6823-4332-abe2-c4dbb19cfecf tempest-ProjectReaderTests-1685940573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9982c0a-f433-44f2-9e4f-d96556b47509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:35:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-892e50b5-6823-4332-abe2-c4dbb19cfecf tempest-ProjectReaderTests-1685940573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9982c0a-f433-44f2-9e4f-d96556b47509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:35:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-892e50b5-6823-4332-abe2-c4dbb19cfecf tempest-ProjectReaderTests-1685940573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64e8c072-6bba-4657-b79a-8d079f343ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:35:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-892e50b5-6823-4332-abe2-c4dbb19cfecf tempest-ProjectReaderTests-1685940573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64e8c072-6bba-4657-b79a-8d079f343ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56ce7c1b-bbb3-4d3a-972b-900563b361d8', 'volume_name': 'volume-56ce7c1b-bbb3-4d3a-972b-900563b361d8', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:35:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-892e50b5-6823-4332-abe2-c4dbb19cfecf tempest-ProjectReaderTests-1685940573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d5fcc87-274a-4aa8-9e1a-37a33775f5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:35:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-892e50b5-6823-4332-abe2-c4dbb19cfecf tempest-ProjectReaderTests-1685940573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d5fcc87-274a-4aa8-9e1a-37a33775f5b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:35:27 devstack sudo[105331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_174b55e7-4068-4ad3-8453-ae11bea1dea8_iclarue9devstack@QuobyteHD Jul 07 08:35:27 devstack sudo[105331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-892e50b5-6823-4332-abe2-c4dbb19cfecf tempest-ProjectReaderTests-1685940573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ba129c6-bbb3-4dc9-9c74-500554b374b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:35:27 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-892e50b5-6823-4332-abe2-c4dbb19cfecf tempest-ProjectReaderTests-1685940573 None] Volume 56ce7c1b-bbb3-4d3a-972b-900563b361d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56ce7c1b-bbb3-4d3a-972b-900563b361d8', 'volume_size': 1} Jul 07 08:35:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-892e50b5-6823-4332-abe2-c4dbb19cfecf tempest-ProjectReaderTests-1685940573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:35:27 devstack sudo[105325]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ce81f07e-27a2-46bc-b5da-8562a09f2622 tempest-VolumeDependencyTests-1845104136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b.info" returned: 0 in 1.100s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:27 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-ce81f07e-27a2-46bc-b5da-8562a09f2622 tempest-VolumeDependencyTests-1845104136 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b.info is being set with open permissions: ugo+rw Jul 07 08:35:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ce81f07e-27a2-46bc-b5da-8562a09f2622 tempest-VolumeDependencyTests-1845104136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:28 devstack sudo[105334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b.info Jul 07 08:35:28 devstack sudo[105334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:28 devstack sudo[105331]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_174b55e7-4068-4ad3-8453-ae11bea1dea8_iclarue9devstack@QuobyteHD" returned: 0 in 0.828s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_174b55e7-4068-4ad3-8453-ae11bea1dea8_iclarue9devstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:28 devstack sudo[105338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_174b55e7-4068-4ad3-8453-ae11bea1dea8_iclarue9devstack@QuobyteHD Jul 07 08:35:28 devstack sudo[105338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:28 devstack sudo[105334]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ce81f07e-27a2-46bc-b5da-8562a09f2622 tempest-VolumeDependencyTests-1845104136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b.info" returned: 0 in 0.672s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ce81f07e-27a2-46bc-b5da-8562a09f2622 tempest-VolumeDependencyTests-1845104136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.625s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:35:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-892e50b5-6823-4332-abe2-c4dbb19cfecf tempest-ProjectReaderTests-1685940573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.996s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:35:28 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-892e50b5-6823-4332-abe2-c4dbb19cfecf tempest-ProjectReaderTests-1685940573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:35:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1072009517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56ce7c1b-bbb3-4d3a-972b-900563b361d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06330941a308447a9ec29b93464314b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:35:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:35:28Z,use_quota=True,user_id='7e7152ed33e44a5a937717a4c518b2d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:35:28 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-892e50b5-6823-4332-abe2-c4dbb19cfecf tempest-ProjectReaderTests-1685940573 None] Creating volume 56ce7c1b-bbb3-4d3a-972b-900563b361d8 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:35:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-892e50b5-6823-4332-abe2-c4dbb19cfecf tempest-ProjectReaderTests-1685940573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:35:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-892e50b5-6823-4332-abe2-c4dbb19cfecf tempest-ProjectReaderTests-1685940573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:35:28 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-892e50b5-6823-4332-abe2-c4dbb19cfecf tempest-ProjectReaderTests-1685940573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:35:28 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-892e50b5-6823-4332-abe2-c4dbb19cfecf tempest-ProjectReaderTests-1685940573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:35:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-892e50b5-6823-4332-abe2-c4dbb19cfecf tempest-ProjectReaderTests-1685940573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:35:28 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-892e50b5-6823-4332-abe2-c4dbb19cfecf tempest-ProjectReaderTests-1685940573 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:35:28 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-892e50b5-6823-4332-abe2-c4dbb19cfecf tempest-ProjectReaderTests-1685940573 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:35:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-892e50b5-6823-4332-abe2-c4dbb19cfecf tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-56ce7c1b-bbb3-4d3a-972b-900563b361d8 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:28 devstack sudo[105341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-56ce7c1b-bbb3-4d3a-972b-900563b361d8 1073741824 Jul 07 08:35:28 devstack sudo[105341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:28 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-ce81f07e-27a2-46bc-b5da-8562a09f2622 tempest-VolumeDependencyTests-1845104136 None] Create snapshot completed successfully Jul 07 08:35:29 devstack sudo[105338]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_174b55e7-4068-4ad3-8453-ae11bea1dea8_iclarue9devstack@QuobyteHD" returned: 1 in 0.804s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_174b55e7-4068-4ad3-8453-ae11bea1dea8_iclarue9devstack@QuobyteHD' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:35:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:35:29 devstack sudo[105341]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-892e50b5-6823-4332-abe2-c4dbb19cfecf tempest-ProjectReaderTests-1685940573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-56ce7c1b-bbb3-4d3a-972b-900563b361d8 1073741824" returned: 0 in 0.947s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-892e50b5-6823-4332-abe2-c4dbb19cfecf tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-56ce7c1b-bbb3-4d3a-972b-900563b361d8 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:29 devstack sudo[105350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-56ce7c1b-bbb3-4d3a-972b-900563b361d8 Jul 07 08:35:29 devstack sudo[105350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:29 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0b5ae9c-ebe7-498a-8a10-f8956640bbef tempest-VolumeDependencyTests-1845104136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:35:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d0b5ae9c-ebe7-498a-8a10-f8956640bbef tempest-VolumeDependencyTests-1845104136 None] Flow 'volume_create_manager' (48c82f89-714b-495b-ba83-16fad9033212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:35:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d0b5ae9c-ebe7-498a-8a10-f8956640bbef tempest-VolumeDependencyTests-1845104136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e2acd54-54ea-41ac-b5fe-1dc7c90d93cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:35:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d0b5ae9c-ebe7-498a-8a10-f8956640bbef tempest-VolumeDependencyTests-1845104136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e2acd54-54ea-41ac-b5fe-1dc7c90d93cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:35:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-653980581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81d57e27-3bb0-49e8-8b36-f5f7e35d42e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7da866dad32f42bd93c9551dfa09aad8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:35:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=08430f3a-1360-4aa6-836f-d97461f432d7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:35:30Z,use_quota=True,user_id='d430fbd4e046491dbb0ca0cdff586591',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:35:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d0b5ae9c-ebe7-498a-8a10-f8956640bbef tempest-VolumeDependencyTests-1845104136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f2393ab-704a-46d5-8d8f-63e438f9b40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:35:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d0b5ae9c-ebe7-498a-8a10-f8956640bbef tempest-VolumeDependencyTests-1845104136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f2393ab-704a-46d5-8d8f-63e438f9b40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:35:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d0b5ae9c-ebe7-498a-8a10-f8956640bbef tempest-VolumeDependencyTests-1845104136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccbcf8ea-1dd7-48ef-bb27-a0a96ef1a752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:35:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d0b5ae9c-ebe7-498a-8a10-f8956640bbef tempest-VolumeDependencyTests-1845104136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccbcf8ea-1dd7-48ef-bb27-a0a96ef1a752) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '81d57e27-3bb0-49e8-8b36-f5f7e35d42e4', 'volume_name': 'volume-81d57e27-3bb0-49e8-8b36-f5f7e35d42e4', 'volume_size': 1, 'snapshot_id': '08430f3a-1360-4aa6-836f-d97461f432d7'}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:35:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d0b5ae9c-ebe7-498a-8a10-f8956640bbef tempest-VolumeDependencyTests-1845104136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f4fffad-714f-4ecb-9cdb-5d2d61c5247a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:35:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d0b5ae9c-ebe7-498a-8a10-f8956640bbef tempest-VolumeDependencyTests-1845104136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f4fffad-714f-4ecb-9cdb-5d2d61c5247a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:35:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d0b5ae9c-ebe7-498a-8a10-f8956640bbef tempest-VolumeDependencyTests-1845104136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5172f7ba-cbf8-4fe3-9953-e2174e2a52c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:35:30 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-d0b5ae9c-ebe7-498a-8a10-f8956640bbef tempest-VolumeDependencyTests-1845104136 None] Volume 81d57e27-3bb0-49e8-8b36-f5f7e35d42e4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-81d57e27-3bb0-49e8-8b36-f5f7e35d42e4', 'volume_size': 1, 'snapshot_id': '08430f3a-1360-4aa6-836f-d97461f432d7'} Jul 07 08:35:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d0b5ae9c-ebe7-498a-8a10-f8956640bbef tempest-VolumeDependencyTests-1845104136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:35:30 devstack sudo[105350]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-892e50b5-6823-4332-abe2-c4dbb19cfecf tempest-ProjectReaderTests-1685940573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-56ce7c1b-bbb3-4d3a-972b-900563b361d8" returned: 0 in 0.698s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:30 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-892e50b5-6823-4332-abe2-c4dbb19cfecf tempest-ProjectReaderTests-1685940573 None] <== create_volume: return (1698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:35:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-892e50b5-6823-4332-abe2-c4dbb19cfecf tempest-ProjectReaderTests-1685940573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.701s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:35:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.229s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:35:30 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:35:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7225066-7442-4d19-92c8-12090330f5f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6f4a3e6d6f1442c84ed95f054770f05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:35:25Z,use_quota=True,user_id='09e2f2e33333447497de56142b35f806',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:35:30 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] Creating volume c7225066-7442-4d19-92c8-12090330f5f0 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:35:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:35:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:35:30 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:35:30 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:35:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:35:30 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:35:30 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:35:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c7225066-7442-4d19-92c8-12090330f5f0 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-892e50b5-6823-4332-abe2-c4dbb19cfecf tempest-ProjectReaderTests-1685940573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ba129c6-bbb3-4dc9-9c74-500554b374b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56ce7c1b-bbb3-4d3a-972b-900563b361d8', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:35:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-892e50b5-6823-4332-abe2-c4dbb19cfecf tempest-ProjectReaderTests-1685940573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7b862ca-eaf1-4577-86f5-b662cd49b962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:35:30 devstack sudo[105353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c7225066-7442-4d19-92c8-12090330f5f0 1073741824 Jul 07 08:35:30 devstack sudo[105353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:30 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-892e50b5-6823-4332-abe2-c4dbb19cfecf tempest-ProjectReaderTests-1685940573 None] Volume volume-56ce7c1b-bbb3-4d3a-972b-900563b361d8 (56ce7c1b-bbb3-4d3a-972b-900563b361d8): created successfully Jul 07 08:35:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-892e50b5-6823-4332-abe2-c4dbb19cfecf tempest-ProjectReaderTests-1685940573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7b862ca-eaf1-4577-86f5-b662cd49b962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:35:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-892e50b5-6823-4332-abe2-c4dbb19cfecf tempest-ProjectReaderTests-1685940573 None] Flow 'volume_create_manager' (7f046d70-0f7b-4e86-9bc8-fd14f6cfcfdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:35:30 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-892e50b5-6823-4332-abe2-c4dbb19cfecf tempest-ProjectReaderTests-1685940573 None] Created volume successfully. Jul 07 08:35:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-5e0abca1-87e5-4cf5-9df3-a02b682411ef tempest-ProjectReaderTests-1685940573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:35:31 devstack sudo[105353]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c7225066-7442-4d19-92c8-12090330f5f0 1073741824" returned: 0 in 0.914s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c7225066-7442-4d19-92c8-12090330f5f0 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:31 devstack sudo[105360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c7225066-7442-4d19-92c8-12090330f5f0 Jul 07 08:35:31 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:32 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c7225066-7442-4d19-92c8-12090330f5f0" returned: 0 in 0.693s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:32 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] <== create_volume: return (1656ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:35:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.659s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:35:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d0b5ae9c-ebe7-498a-8a10-f8956640bbef tempest-VolumeDependencyTests-1845104136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.955s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:35:32 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d0b5ae9c-ebe7-498a-8a10-f8956640bbef tempest-VolumeDependencyTests-1845104136 None] Acquiring lock "cinder-quobyte-08430f3a-1360-4aa6-836f-d97461f432d7-81d57e27-3bb0-49e8-8b36-f5f7e35d42e4" by "_create_volume_from_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:35:32 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d0b5ae9c-ebe7-498a-8a10-f8956640bbef tempest-VolumeDependencyTests-1845104136 None] Lock "cinder-quobyte-08430f3a-1360-4aa6-836f-d97461f432d7-81d57e27-3bb0-49e8-8b36-f5f7e35d42e4" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:35:32 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d0b5ae9c-ebe7-498a-8a10-f8956640bbef tempest-VolumeDependencyTests-1845104136 None] Creating volume 81d57e27-3bb0-49e8-8b36-f5f7e35d42e4 from snapshot 08430f3a-1360-4aa6-836f-d97461f432d7 {{(pid=87199) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 08:35:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d0b5ae9c-ebe7-498a-8a10-f8956640bbef tempest-VolumeDependencyTests-1845104136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:35:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d0b5ae9c-ebe7-498a-8a10-f8956640bbef tempest-VolumeDependencyTests-1845104136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:35:32 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d0b5ae9c-ebe7-498a-8a10-f8956640bbef tempest-VolumeDependencyTests-1845104136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:35:32 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d0b5ae9c-ebe7-498a-8a10-f8956640bbef tempest-VolumeDependencyTests-1845104136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:35:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d0b5ae9c-ebe7-498a-8a10-f8956640bbef tempest-VolumeDependencyTests-1845104136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:35:32 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d0b5ae9c-ebe7-498a-8a10-f8956640bbef tempest-VolumeDependencyTests-1845104136 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:35:32 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d0b5ae9c-ebe7-498a-8a10-f8956640bbef tempest-VolumeDependencyTests-1845104136 None] Acquiring lock "cinder-quobyte-81d57e27-3bb0-49e8-8b36-f5f7e35d42e4" by "_copy_volume_from_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:35:32 devstack cinder-volume[87199]: DEBUG cinder.volume.volume_utils [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] Attempting download of 174b55e7-4068-4ad3-8453-ae11bea1dea8 ((None, [{'url': 'file:///opt/stack/data/glance/images/174b55e7-4068-4ad3-8453-ae11bea1dea8', 'metadata': {}}])) to volume c7225066-7442-4d19-92c8-12090330f5f0. {{(pid=87199) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 08:35:32 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d0b5ae9c-ebe7-498a-8a10-f8956640bbef tempest-VolumeDependencyTests-1845104136 None] Lock "cinder-quobyte-81d57e27-3bb0-49e8-8b36-f5f7e35d42e4" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:35:32 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d0b5ae9c-ebe7-498a-8a10-f8956640bbef tempest-VolumeDependencyTests-1845104136 None] snapshot: 08430f3a-1360-4aa6-836f-d97461f432d7, volume: 81d57e27-3bb0-49e8-8b36-f5f7e35d42e4, {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 08:35:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d0b5ae9c-ebe7-498a-8a10-f8956640bbef tempest-VolumeDependencyTests-1845104136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:35:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d0b5ae9c-ebe7-498a-8a10-f8956640bbef tempest-VolumeDependencyTests-1845104136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:35:32 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d0b5ae9c-ebe7-498a-8a10-f8956640bbef tempest-VolumeDependencyTests-1845104136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:35:32 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d0b5ae9c-ebe7-498a-8a10-f8956640bbef tempest-VolumeDependencyTests-1845104136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:35:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d0b5ae9c-ebe7-498a-8a10-f8956640bbef tempest-VolumeDependencyTests-1845104136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:35:32 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[256ff3f5-3de4-4851-a8e4-0dee6bc51fbc]: (4, 'raw') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:35:32 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[0433e691-dd29-46b0-badb-f7b2e90e7f87]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:35:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_174b55e7-4068-4ad3-8453-ae11bea1dea8_p0zknykr {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d0b5ae9c-ebe7-498a-8a10-f8956640bbef tempest-VolumeDependencyTests-1845104136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b.08430f3a-1360-4aa6-836f-d97461f432d7 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:32 devstack sudo[105364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_174b55e7-4068-4ad3-8453-ae11bea1dea8_p0zknykr Jul 07 08:35:32 devstack sudo[105364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:32 devstack sudo[105365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b.08430f3a-1360-4aa6-836f-d97461f432d7 Jul 07 08:35:32 devstack sudo[105365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:32 devstack sudo[105364]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_174b55e7-4068-4ad3-8453-ae11bea1dea8_p0zknykr" returned: 0 in 0.776s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_174b55e7-4068-4ad3-8453-ae11bea1dea8_p0zknykr {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:33 devstack sudo[105365]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d0b5ae9c-ebe7-498a-8a10-f8956640bbef tempest-VolumeDependencyTests-1845104136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b.08430f3a-1360-4aa6-836f-d97461f432d7" returned: 0 in 0.821s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:33 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-d0b5ae9c-ebe7-498a-8a10-f8956640bbef tempest-VolumeDependencyTests-1845104136 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:35:33 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d0b5ae9c-ebe7-498a-8a10-f8956640bbef tempest-VolumeDependencyTests-1845104136 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 08:35:33 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d0b5ae9c-ebe7-498a-8a10-f8956640bbef tempest-VolumeDependencyTests-1845104136 None] Creating direct copy from snapshot {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 08:35:33 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[5519c7d9-01e8-472c-8718-d205b3b37022]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:35:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d0b5ae9c-ebe7-498a-8a10-f8956640bbef tempest-VolumeDependencyTests-1845104136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:33 devstack sudo[105373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_174b55e7-4068-4ad3-8453-ae11bea1dea8_p0zknykr Jul 07 08:35:33 devstack sudo[105373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:33 devstack sudo[105374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b Jul 07 08:35:33 devstack sudo[105374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:33 devstack sudo[105373]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_174b55e7-4068-4ad3-8453-ae11bea1dea8_p0zknykr" returned: 1 in 0.806s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_174b55e7-4068-4ad3-8453-ae11bea1dea8_p0zknykr' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:35:33 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef91a516-1590-42de-b06e-b153be679785]: (4, 'raw') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:35:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_174b55e7-4068-4ad3-8453-ae11bea1dea8_iclarue9devstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:33 devstack sudo[105381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_174b55e7-4068-4ad3-8453-ae11bea1dea8_iclarue9devstack@QuobyteHD Jul 07 08:35:33 devstack sudo[105381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:33 devstack sudo[105374]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d0b5ae9c-ebe7-498a-8a10-f8956640bbef tempest-VolumeDependencyTests-1845104136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b" returned: 0 in 0.890s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:33 devstack cinder-volume[87199]: DEBUG cinder.utils [None req-d0b5ae9c-ebe7-498a-8a10-f8956640bbef tempest-VolumeDependencyTests-1845104136 None] Path /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-81d57e27-3bb0-49e8-8b36-f5f7e35d42e4 not found in is_blk_device check {{(pid=87199) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 08:35:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d0b5ae9c-ebe7-498a-8a10-f8956640bbef tempest-VolumeDependencyTests-1845104136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-81d57e27-3bb0-49e8-8b36-f5f7e35d42e4 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:33 devstack sudo[105385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-81d57e27-3bb0-49e8-8b36-f5f7e35d42e4 Jul 07 08:35:33 devstack sudo[105385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:34 devstack sudo[105381]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_174b55e7-4068-4ad3-8453-ae11bea1dea8_iclarue9devstack@QuobyteHD" returned: 0 in 0.804s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_174b55e7-4068-4ad3-8453-ae11bea1dea8_iclarue9devstack@QuobyteHD {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:34 devstack sudo[105392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_174b55e7-4068-4ad3-8453-ae11bea1dea8_iclarue9devstack@QuobyteHD Jul 07 08:35:34 devstack sudo[105392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:34 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3394e7f-7362-4977-854c-e158b3a5180d tempest-ProjectMemberTests-117232865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:35:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e3394e7f-7362-4977-854c-e158b3a5180d tempest-ProjectMemberTests-117232865 None] Flow 'volume_create_manager' (342b5d77-05bf-4d78-be50-13bc12af0bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:35:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e3394e7f-7362-4977-854c-e158b3a5180d tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d743d9d-b02f-4980-a8f7-d27d7e7390c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:35:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e3394e7f-7362-4977-854c-e158b3a5180d tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d743d9d-b02f-4980-a8f7-d27d7e7390c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:35:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-448562507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a92afa7-d444-4fcf-bdda-87460d4e418f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac2688c9df5545018de78c47a9e5a401',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:35:35Z,use_quota=True,user_id='11de70d1cfa0463dbad27ce8dcab2b39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:35:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e3394e7f-7362-4977-854c-e158b3a5180d tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c6b73e1-4b6c-4727-84fb-56df325aef34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:35:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e3394e7f-7362-4977-854c-e158b3a5180d tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c6b73e1-4b6c-4727-84fb-56df325aef34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:35:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e3394e7f-7362-4977-854c-e158b3a5180d tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (758dc118-5df0-422e-a115-93434fa7c52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:35:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e3394e7f-7362-4977-854c-e158b3a5180d tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (758dc118-5df0-422e-a115-93434fa7c52e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a92afa7-d444-4fcf-bdda-87460d4e418f', 'volume_name': 'volume-1a92afa7-d444-4fcf-bdda-87460d4e418f', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:35:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e3394e7f-7362-4977-854c-e158b3a5180d tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9a4da27-76d1-431d-8af5-74d12960e8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:35:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e3394e7f-7362-4977-854c-e158b3a5180d tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9a4da27-76d1-431d-8af5-74d12960e8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:35:34 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e3394e7f-7362-4977-854c-e158b3a5180d tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78ff0def-8b76-4b9b-8549-0608d24390f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:35:34 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-e3394e7f-7362-4977-854c-e158b3a5180d tempest-ProjectMemberTests-117232865 None] Volume 1a92afa7-d444-4fcf-bdda-87460d4e418f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a92afa7-d444-4fcf-bdda-87460d4e418f', 'volume_size': 1} Jul 07 08:35:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e3394e7f-7362-4977-854c-e158b3a5180d tempest-ProjectMemberTests-117232865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:35:35 devstack sudo[105392]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_174b55e7-4068-4ad3-8453-ae11bea1dea8_iclarue9devstack@QuobyteHD" returned: 1 in 1.274s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_174b55e7-4068-4ad3-8453-ae11bea1dea8_iclarue9devstack@QuobyteHD' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:35:35 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] 174b55e7-4068-4ad3-8453-ae11bea1dea8 was raw, converting to raw {{(pid=87199) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 08:35:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_174b55e7-4068-4ad3-8453-ae11bea1dea8_iclarue9devstack@QuobyteHD /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c7225066-7442-4d19-92c8-12090330f5f0 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:35 devstack sudo[105404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_174b55e7-4068-4ad3-8453-ae11bea1dea8_iclarue9devstack@QuobyteHD /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c7225066-7442-4d19-92c8-12090330f5f0 Jul 07 08:35:35 devstack sudo[105404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:37 devstack sudo[105404]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_174b55e7-4068-4ad3-8453-ae11bea1dea8_iclarue9devstack@QuobyteHD /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c7225066-7442-4d19-92c8-12090330f5f0" returned: 0 in 1.445s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:37 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_174b55e7-4068-4ad3-8453-ae11bea1dea8_iclarue9devstack@QuobyteHD, size 0.00 MB, duration 1.45 sec, destination /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c7225066-7442-4d19-92c8-12090330f5f0 {{(pid=87199) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 08:35:37 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] Converted 0.00 MB image at 0.00 MB/s Jul 07 08:35:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c7225066-7442-4d19-92c8-12090330f5f0 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:37 devstack sudo[105444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c7225066-7442-4d19-92c8-12090330f5f0 1G Jul 07 08:35:37 devstack sudo[105444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:38 devstack sudo[105444]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c7225066-7442-4d19-92c8-12090330f5f0 1G" returned: 0 in 1.274s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:38 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec768f2f-2d46-4080-bb49-359f8b2b5a57]: (4, 'raw') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:35:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c7225066-7442-4d19-92c8-12090330f5f0 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:39 devstack sudo[105451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c7225066-7442-4d19-92c8-12090330f5f0 Jul 07 08:35:39 devstack sudo[105451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:39 devstack sudo[105385]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d0b5ae9c-ebe7-498a-8a10-f8956640bbef tempest-VolumeDependencyTests-1845104136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-81d57e27-3bb0-49e8-8b36-f5f7e35d42e4" returned: 0 in 5.419s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:39 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5baff06-2dee-4ede-b947-b98329d32002]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:35:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d0b5ae9c-ebe7-498a-8a10-f8956640bbef tempest-VolumeDependencyTests-1845104136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:39 devstack sudo[105453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b Jul 07 08:35:39 devstack sudo[105453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:39 devstack sudo[105451]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c7225066-7442-4d19-92c8-12090330f5f0" returned: 0 in 1.132s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c7225066-7442-4d19-92c8-12090330f5f0 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:39 devstack sudo[105457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c7225066-7442-4d19-92c8-12090330f5f0 Jul 07 08:35:39 devstack sudo[105457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:40 devstack sudo[105453]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d0b5ae9c-ebe7-498a-8a10-f8956640bbef tempest-VolumeDependencyTests-1845104136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b" returned: 0 in 0.957s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:40 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-d0b5ae9c-ebe7-498a-8a10-f8956640bbef tempest-VolumeDependencyTests-1845104136 None] Image conversion details: src /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b, size 1024.00 MB, duration 5.42 sec, destination /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-81d57e27-3bb0-49e8-8b36-f5f7e35d42e4 {{(pid=87199) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 08:35:40 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-d0b5ae9c-ebe7-498a-8a10-f8956640bbef tempest-VolumeDependencyTests-1845104136 None] Converted 1024.00 MB image at 188.93 MB/s Jul 07 08:35:40 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-d0b5ae9c-ebe7-498a-8a10-f8956640bbef tempest-VolumeDependencyTests-1845104136 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-81d57e27-3bb0-49e8-8b36-f5f7e35d42e4 is being set with open permissions: ugo+rw Jul 07 08:35:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d0b5ae9c-ebe7-498a-8a10-f8956640bbef tempest-VolumeDependencyTests-1845104136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-81d57e27-3bb0-49e8-8b36-f5f7e35d42e4 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:40 devstack sudo[105463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-81d57e27-3bb0-49e8-8b36-f5f7e35d42e4 Jul 07 08:35:40 devstack sudo[105463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:40 devstack sudo[105457]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c7225066-7442-4d19-92c8-12090330f5f0" returned: 1 in 0.812s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c7225066-7442-4d19-92c8-12090330f5f0' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:35:40 devstack cinder-volume[87199]: DEBUG cinder.volume.volume_utils [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] Downloaded image 174b55e7-4068-4ad3-8453-ae11bea1dea8 ((None, [{'url': 'file:///opt/stack/data/glance/images/174b55e7-4068-4ad3-8453-ae11bea1dea8', 'metadata': {}}])) to volume c7225066-7442-4d19-92c8-12090330f5f0 successfully. {{(pid=87199) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 08:35:40 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] Temporary image 174b55e7-4068-4ad3-8453-ae11bea1dea8 for user 09e2f2e33333447497de56142b35f806 is deleted. {{(pid=87199) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 08:35:40 devstack cinder-volume[87199]: DEBUG cinder.volume.volume_utils [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] Marking volume c7225066-7442-4d19-92c8-12090330f5f0 as bootable. {{(pid=87199) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 08:35:40 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] Copying metadata from image 174b55e7-4068-4ad3-8453-ae11bea1dea8 to c7225066-7442-4d19-92c8-12090330f5f0. {{(pid=87199) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 08:35:40 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] Creating volume glance metadata for volume c7225066-7442-4d19-92c8-12090330f5f0 backed by image 174b55e7-4068-4ad3-8453-ae11bea1dea8 with: {'image_id': '174b55e7-4068-4ad3-8453-ae11bea1dea8', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '44b5c5c622655203a3ed1bc0054b36c1', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87199) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 08:35:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb78b934-2d80-45d9-b72c-1e52ce320cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7225066-7442-4d19-92c8-12090330f5f0', 'volume_size': 1, 'image_id': '174b55e7-4068-4ad3-8453-ae11bea1dea8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/174b55e7-4068-4ad3-8453-ae11bea1dea8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '44b5c5c622655203a3ed1bc0054b36c1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd6f4a3e6d6f1442c84ed95f054770f05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bc23814da343304017f66f159a9d74702926173d4c0193428d1fc16aeef0a91e87917eba588b47f8eb7a322bb48ba42c26542546b7347393188425373476f27a', 'id': '174b55e7-4068-4ad3-8453-ae11bea1dea8', 'created_at': datetime.datetime(2026, 7, 7, 6, 35, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 6, 35, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/174b55e7-4068-4ad3-8453-ae11bea1dea8/file', 'properties': {}}, 'image_service': }' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:35:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41ca8bc9-7374-4521-bc8f-e74ed4ae1fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:35:40 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] Volume volume-c7225066-7442-4d19-92c8-12090330f5f0 (c7225066-7442-4d19-92c8-12090330f5f0): created successfully Jul 07 08:35:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41ca8bc9-7374-4521-bc8f-e74ed4ae1fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:35:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] Flow 'volume_create_manager' (86f1dfff-a59c-40bc-a5e3-588cad795250) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:35:40 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-d88a1f00-c1e7-478e-bf5f-58cc56db56c4 tempest-VolumeImageDependencyTests-2054562168 None] Created volume successfully. Jul 07 08:35:41 devstack sudo[105463]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d0b5ae9c-ebe7-498a-8a10-f8956640bbef tempest-VolumeDependencyTests-1845104136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-81d57e27-3bb0-49e8-8b36-f5f7e35d42e4" returned: 0 in 0.702s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:41 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d0b5ae9c-ebe7-498a-8a10-f8956640bbef tempest-VolumeDependencyTests-1845104136 None] Lock "cinder-quobyte-81d57e27-3bb0-49e8-8b36-f5f7e35d42e4" released by "_copy_volume_from_snapshot" :: held 8.927s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:35:41 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d0b5ae9c-ebe7-498a-8a10-f8956640bbef tempest-VolumeDependencyTests-1845104136 None] Lock "cinder-quobyte-08430f3a-1360-4aa6-836f-d97461f432d7-81d57e27-3bb0-49e8-8b36-f5f7e35d42e4" released by "_create_volume_from_snapshot" :: held 8.979s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:35:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d0b5ae9c-ebe7-498a-8a10-f8956640bbef tempest-VolumeDependencyTests-1845104136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:35:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-5e0abca1-87e5-4cf5-9df3-a02b682411ef tempest-ProjectReaderTests-1685940573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.219s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:35:41 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-5e0abca1-87e5-4cf5-9df3-a02b682411ef tempest-ProjectReaderTests-1685940573 None] Creating offline snapshot fb34e724-d219-4193-9e16-7c10f1fe0a03 of volume 56ce7c1b-bbb3-4d3a-972b-900563b361d8 {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:35:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d0b5ae9c-ebe7-498a-8a10-f8956640bbef tempest-VolumeDependencyTests-1845104136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5172f7ba-cbf8-4fe3-9953-e2174e2a52c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81d57e27-3bb0-49e8-8b36-f5f7e35d42e4', 'volume_size': 1, 'snapshot_id': '08430f3a-1360-4aa6-836f-d97461f432d7'}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:35:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d0b5ae9c-ebe7-498a-8a10-f8956640bbef tempest-VolumeDependencyTests-1845104136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35a02c04-f8fe-40a1-b8b5-5267c938e700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:35:41 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a781e7-d165-4b7e-aaf8-7265b3c8a3fb]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:35:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5e0abca1-87e5-4cf5-9df3-a02b682411ef tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-56ce7c1b-bbb3-4d3a-972b-900563b361d8 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:41 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-d0b5ae9c-ebe7-498a-8a10-f8956640bbef tempest-VolumeDependencyTests-1845104136 None] Volume volume-81d57e27-3bb0-49e8-8b36-f5f7e35d42e4 (81d57e27-3bb0-49e8-8b36-f5f7e35d42e4): created successfully Jul 07 08:35:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d0b5ae9c-ebe7-498a-8a10-f8956640bbef tempest-VolumeDependencyTests-1845104136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35a02c04-f8fe-40a1-b8b5-5267c938e700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:35:41 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d0b5ae9c-ebe7-498a-8a10-f8956640bbef tempest-VolumeDependencyTests-1845104136 None] Flow 'volume_create_manager' (48c82f89-714b-495b-ba83-16fad9033212) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:35:41 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-d0b5ae9c-ebe7-498a-8a10-f8956640bbef tempest-VolumeDependencyTests-1845104136 None] Created volume successfully. Jul 07 08:35:41 devstack sudo[105469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-56ce7c1b-bbb3-4d3a-972b-900563b361d8 Jul 07 08:35:41 devstack sudo[105469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:41 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-63f93394-e98c-4571-a6b7-68f1d41fb092 tempest-VolumeImageDependencyTests-2054562168 None] Acquiring lock "cinder-c7225066-7442-4d19-92c8-12090330f5f0-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:35:41 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-63f93394-e98c-4571-a6b7-68f1d41fb092 tempest-VolumeImageDependencyTests-2054562168 None] Lock "cinder-c7225066-7442-4d19-92c8-12090330f5f0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:35:41 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-63f93394-e98c-4571-a6b7-68f1d41fb092 tempest-VolumeImageDependencyTests-2054562168 None] Acquiring lock "cinder-quobyte-c7225066-7442-4d19-92c8-12090330f5f0" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:35:41 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-63f93394-e98c-4571-a6b7-68f1d41fb092 tempest-VolumeImageDependencyTests-2054562168 None] Lock "cinder-quobyte-c7225066-7442-4d19-92c8-12090330f5f0" acquired by "delete_volume" :: waited 0.018s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:35:41 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ac8de1-85fa-4b51-a805-06b60450d0b7]: (4, 'raw') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:35:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-63f93394-e98c-4571-a6b7-68f1d41fb092 tempest-VolumeImageDependencyTests-2054562168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c7225066-7442-4d19-92c8-12090330f5f0 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:41 devstack sudo[105472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c7225066-7442-4d19-92c8-12090330f5f0 Jul 07 08:35:41 devstack sudo[105472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:41 devstack sudo[105469]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5e0abca1-87e5-4cf5-9df3-a02b682411ef tempest-ProjectReaderTests-1685940573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-56ce7c1b-bbb3-4d3a-972b-900563b361d8" returned: 0 in 0.805s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5e0abca1-87e5-4cf5-9df3-a02b682411ef tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-56ce7c1b-bbb3-4d3a-972b-900563b361d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-56ce7c1b-bbb3-4d3a-972b-900563b361d8.fb34e724-d219-4193-9e16-7c10f1fe0a03 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:41 devstack sudo[105477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-56ce7c1b-bbb3-4d3a-972b-900563b361d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-56ce7c1b-bbb3-4d3a-972b-900563b361d8.fb34e724-d219-4193-9e16-7c10f1fe0a03 1G Jul 07 08:35:41 devstack sudo[105477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:42 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8259354f-6c13-453b-a008-8ca4fa6fe67b tempest-VolumeDependencyTests-1845104136 None] Acquiring lock "cinder-08430f3a-1360-4aa6-836f-d97461f432d7-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:35:42 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8259354f-6c13-453b-a008-8ca4fa6fe67b tempest-VolumeDependencyTests-1845104136 None] Lock "cinder-08430f3a-1360-4aa6-836f-d97461f432d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:35:42 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8259354f-6c13-453b-a008-8ca4fa6fe67b tempest-VolumeDependencyTests-1845104136 None] Acquiring lock "cinder-quobyte-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:35:42 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8259354f-6c13-453b-a008-8ca4fa6fe67b tempest-VolumeDependencyTests-1845104136 None] Lock "cinder-quobyte-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:35:42 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8259354f-6c13-453b-a008-8ca4fa6fe67b tempest-VolumeDependencyTests-1845104136 None] Acquiring lock "cinder-quobyte-08430f3a-1360-4aa6-836f-d97461f432d7" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:35:42 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8259354f-6c13-453b-a008-8ca4fa6fe67b tempest-VolumeDependencyTests-1845104136 None] Lock "cinder-quobyte-08430f3a-1360-4aa6-836f-d97461f432d7" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:35:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-8259354f-6c13-453b-a008-8ca4fa6fe67b tempest-VolumeDependencyTests-1845104136 None] Deleting offline snapshot 08430f3a-1360-4aa6-836f-d97461f432d7 of volume 37b9eccf-0b7d-4b85-9885-9e7b74d66a6b {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:35:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-8259354f-6c13-453b-a008-8ca4fa6fe67b tempest-VolumeDependencyTests-1845104136 None] snapshot_file for this snap is: volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b.08430f3a-1360-4aa6-836f-d97461f432d7 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:35:42 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5a35b3-e593-4a7e-9da8-a363e1e9a02c]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:35:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8259354f-6c13-453b-a008-8ca4fa6fe67b tempest-VolumeDependencyTests-1845104136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b.08430f3a-1360-4aa6-836f-d97461f432d7 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:42 devstack sudo[105479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b.08430f3a-1360-4aa6-836f-d97461f432d7 Jul 07 08:35:42 devstack sudo[105479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:42 devstack sudo[105472]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-63f93394-e98c-4571-a6b7-68f1d41fb092 tempest-VolumeImageDependencyTests-2054562168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c7225066-7442-4d19-92c8-12090330f5f0" returned: 0 in 0.864s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-63f93394-e98c-4571-a6b7-68f1d41fb092 tempest-VolumeImageDependencyTests-2054562168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c7225066-7442-4d19-92c8-12090330f5f0 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:42 devstack sudo[105486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c7225066-7442-4d19-92c8-12090330f5f0 Jul 07 08:35:42 devstack sudo[105486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:42 devstack sudo[105477]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5e0abca1-87e5-4cf5-9df3-a02b682411ef tempest-ProjectReaderTests-1685940573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-56ce7c1b-bbb3-4d3a-972b-900563b361d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-56ce7c1b-bbb3-4d3a-972b-900563b361d8.fb34e724-d219-4193-9e16-7c10f1fe0a03 1G" returned: 0 in 0.886s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5e0abca1-87e5-4cf5-9df3-a02b682411ef tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56ce7c1b-bbb3-4d3a-972b-900563b361d8 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-56ce7c1b-bbb3-4d3a-972b-900563b361d8.fb34e724-d219-4193-9e16-7c10f1fe0a03 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:42 devstack sudo[105489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56ce7c1b-bbb3-4d3a-972b-900563b361d8 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-56ce7c1b-bbb3-4d3a-972b-900563b361d8.fb34e724-d219-4193-9e16-7c10f1fe0a03 Jul 07 08:35:42 devstack sudo[105489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:43 devstack sudo[105479]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8259354f-6c13-453b-a008-8ca4fa6fe67b tempest-VolumeDependencyTests-1845104136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b.08430f3a-1360-4aa6-836f-d97461f432d7" returned: 0 in 0.856s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:43 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-8259354f-6c13-453b-a008-8ca4fa6fe67b tempest-VolumeDependencyTests-1845104136 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:35:43 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[533bb87e-a343-4bd0-b92e-d1c96790798b]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:35:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8259354f-6c13-453b-a008-8ca4fa6fe67b tempest-VolumeDependencyTests-1845104136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:43 devstack sudo[105494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b Jul 07 08:35:43 devstack sudo[105494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:43 devstack sudo[105486]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-63f93394-e98c-4571-a6b7-68f1d41fb092 tempest-VolumeImageDependencyTests-2054562168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c7225066-7442-4d19-92c8-12090330f5f0" returned: 1 in 0.872s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-63f93394-e98c-4571-a6b7-68f1d41fb092 tempest-VolumeImageDependencyTests-2054562168 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c7225066-7442-4d19-92c8-12090330f5f0' failed. Not Retrying. {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:35:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-63f93394-e98c-4571-a6b7-68f1d41fb092 tempest-VolumeImageDependencyTests-2054562168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c7225066-7442-4d19-92c8-12090330f5f0 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:43 devstack sudo[105502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c7225066-7442-4d19-92c8-12090330f5f0 Jul 07 08:35:43 devstack sudo[105502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:43 devstack sudo[105489]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5e0abca1-87e5-4cf5-9df3-a02b682411ef tempest-ProjectReaderTests-1685940573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56ce7c1b-bbb3-4d3a-972b-900563b361d8 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-56ce7c1b-bbb3-4d3a-972b-900563b361d8.fb34e724-d219-4193-9e16-7c10f1fe0a03" returned: 0 in 0.688s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:43 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-5e0abca1-87e5-4cf5-9df3-a02b682411ef tempest-ProjectReaderTests-1685940573 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-56ce7c1b-bbb3-4d3a-972b-900563b361d8.fb34e724-d219-4193-9e16-7c10f1fe0a03 is being set with open permissions: ugo+rw Jul 07 08:35:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5e0abca1-87e5-4cf5-9df3-a02b682411ef tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-56ce7c1b-bbb3-4d3a-972b-900563b361d8.fb34e724-d219-4193-9e16-7c10f1fe0a03 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:43 devstack sudo[105504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-56ce7c1b-bbb3-4d3a-972b-900563b361d8.fb34e724-d219-4193-9e16-7c10f1fe0a03 Jul 07 08:35:43 devstack sudo[105504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:43 devstack sudo[105494]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8259354f-6c13-453b-a008-8ca4fa6fe67b tempest-VolumeDependencyTests-1845104136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b" returned: 0 in 0.811s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8259354f-6c13-453b-a008-8ca4fa6fe67b tempest-VolumeDependencyTests-1845104136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b.08430f3a-1360-4aa6-836f-d97461f432d7 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:43 devstack sudo[105509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b.08430f3a-1360-4aa6-836f-d97461f432d7 Jul 07 08:35:43 devstack sudo[105509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:44 devstack sudo[105502]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-63f93394-e98c-4571-a6b7-68f1d41fb092 tempest-VolumeImageDependencyTests-2054562168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-c7225066-7442-4d19-92c8-12090330f5f0" returned: 0 in 0.726s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:44 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-63f93394-e98c-4571-a6b7-68f1d41fb092 tempest-VolumeImageDependencyTests-2054562168 None] Lock "cinder-quobyte-c7225066-7442-4d19-92c8-12090330f5f0" released by "delete_volume" :: held 2.542s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:35:44 devstack sudo[105504]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5e0abca1-87e5-4cf5-9df3-a02b682411ef tempest-ProjectReaderTests-1685940573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-56ce7c1b-bbb3-4d3a-972b-900563b361d8.fb34e724-d219-4193-9e16-7c10f1fe0a03" returned: 0 in 0.738s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5e0abca1-87e5-4cf5-9df3-a02b682411ef tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-56ce7c1b-bbb3-4d3a-972b-900563b361d8.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:44 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-63f93394-e98c-4571-a6b7-68f1d41fb092 tempest-VolumeImageDependencyTests-2054562168 None] Created reservations ['39ccfe5c-110e-48b5-9bdd-4a3931e17bf1', 'e1f19a13-f010-4f22-9607-2a3e99a9f187', 'a93402c2-0f57-4915-b2f8-55b8712e8dd8', '86abb1e2-9463-40b2-984c-54e2a6b1ec0d'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:35:44 devstack sudo[105513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-56ce7c1b-bbb3-4d3a-972b-900563b361d8.info Jul 07 08:35:44 devstack sudo[105513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-63f93394-e98c-4571-a6b7-68f1d41fb092 tempest-VolumeImageDependencyTests-2054562168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:35:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-63f93394-e98c-4571-a6b7-68f1d41fb092 tempest-VolumeImageDependencyTests-2054562168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:35:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-63f93394-e98c-4571-a6b7-68f1d41fb092 tempest-VolumeImageDependencyTests-2054562168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:35:44 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-63f93394-e98c-4571-a6b7-68f1d41fb092 tempest-VolumeImageDependencyTests-2054562168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:35:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-63f93394-e98c-4571-a6b7-68f1d41fb092 tempest-VolumeImageDependencyTests-2054562168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:35:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-63f93394-e98c-4571-a6b7-68f1d41fb092 tempest-VolumeImageDependencyTests-2054562168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:44 devstack sudo[105515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:35:44 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:44 devstack sudo[105509]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8259354f-6c13-453b-a008-8ca4fa6fe67b tempest-VolumeDependencyTests-1845104136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b.08430f3a-1360-4aa6-836f-d97461f432d7" returned: 0 in 0.824s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8259354f-6c13-453b-a008-8ca4fa6fe67b tempest-VolumeDependencyTests-1845104136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b.08430f3a-1360-4aa6-836f-d97461f432d7 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:44 devstack sudo[105521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b.08430f3a-1360-4aa6-836f-d97461f432d7 Jul 07 08:35:44 devstack sudo[105521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:44 devstack sudo[105513]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5e0abca1-87e5-4cf5-9df3-a02b682411ef tempest-ProjectReaderTests-1685940573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-56ce7c1b-bbb3-4d3a-972b-900563b361d8.info" returned: 0 in 0.734s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:45 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-5e0abca1-87e5-4cf5-9df3-a02b682411ef tempest-ProjectReaderTests-1685940573 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-56ce7c1b-bbb3-4d3a-972b-900563b361d8.info is being set with open permissions: ugo+rw Jul 07 08:35:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5e0abca1-87e5-4cf5-9df3-a02b682411ef tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-56ce7c1b-bbb3-4d3a-972b-900563b361d8.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:45 devstack sudo[105525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-56ce7c1b-bbb3-4d3a-972b-900563b361d8.info Jul 07 08:35:45 devstack sudo[105525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:45 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-63f93394-e98c-4571-a6b7-68f1d41fb092 tempest-VolumeImageDependencyTests-2054562168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.773s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:45 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-63f93394-e98c-4571-a6b7-68f1d41fb092 tempest-VolumeImageDependencyTests-2054562168 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:35:45 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-63f93394-e98c-4571-a6b7-68f1d41fb092 tempest-VolumeImageDependencyTests-2054562168 None] Deleted volume successfully. Jul 07 08:35:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-63f93394-e98c-4571-a6b7-68f1d41fb092 tempest-VolumeImageDependencyTests-2054562168 None] Lock "cinder-c7225066-7442-4d19-92c8-12090330f5f0-delete_volume" released by "delete_volume" :: held 3.598s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:35:45 devstack sudo[105521]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8259354f-6c13-453b-a008-8ca4fa6fe67b tempest-VolumeDependencyTests-1845104136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b.08430f3a-1360-4aa6-836f-d97461f432d7" returned: 0 in 0.754s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8259354f-6c13-453b-a008-8ca4fa6fe67b tempest-VolumeDependencyTests-1845104136 None] Lock "cinder-quobyte-08430f3a-1360-4aa6-836f-d97461f432d7" released by "_delete_snapshot" :: held 3.365s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:35:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8259354f-6c13-453b-a008-8ca4fa6fe67b tempest-VolumeDependencyTests-1845104136 None] Lock "cinder-quobyte-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b" released by "delete_snapshot" :: held 3.392s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:35:45 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-8259354f-6c13-453b-a008-8ca4fa6fe67b tempest-VolumeDependencyTests-1845104136 None] Created reservations ['93143852-e621-4d3c-b773-d1b2e1cceb18', '702c6c79-7fa5-4cff-b045-edd99835fbf5', '21239007-e77d-4022-bf0c-c3bbb75fa358', 'eb12bea3-7aed-4ab8-bd0b-537eceb4ec04'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:35:45 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-8259354f-6c13-453b-a008-8ca4fa6fe67b tempest-VolumeDependencyTests-1845104136 None] Delete snapshot completed successfully. Jul 07 08:35:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8259354f-6c13-453b-a008-8ca4fa6fe67b tempest-VolumeDependencyTests-1845104136 None] Lock "cinder-08430f3a-1360-4aa6-836f-d97461f432d7-delete_snapshot" released by "delete_snapshot" :: held 3.550s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:35:45 devstack sudo[105525]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5e0abca1-87e5-4cf5-9df3-a02b682411ef tempest-ProjectReaderTests-1685940573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-56ce7c1b-bbb3-4d3a-972b-900563b361d8.info" returned: 0 in 0.670s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-5e0abca1-87e5-4cf5-9df3-a02b682411ef tempest-ProjectReaderTests-1685940573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.639s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:35:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e3394e7f-7362-4977-854c-e158b3a5180d tempest-ProjectMemberTests-117232865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.795s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:35:45 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e3394e7f-7362-4977-854c-e158b3a5180d tempest-ProjectMemberTests-117232865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:35:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-448562507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a92afa7-d444-4fcf-bdda-87460d4e418f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac2688c9df5545018de78c47a9e5a401',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:35:35Z,use_quota=True,user_id='11de70d1cfa0463dbad27ce8dcab2b39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:35:45 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-e3394e7f-7362-4977-854c-e158b3a5180d tempest-ProjectMemberTests-117232865 None] Creating volume 1a92afa7-d444-4fcf-bdda-87460d4e418f {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:35:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e3394e7f-7362-4977-854c-e158b3a5180d tempest-ProjectMemberTests-117232865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:35:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e3394e7f-7362-4977-854c-e158b3a5180d tempest-ProjectMemberTests-117232865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:35:45 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e3394e7f-7362-4977-854c-e158b3a5180d tempest-ProjectMemberTests-117232865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:35:45 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e3394e7f-7362-4977-854c-e158b3a5180d tempest-ProjectMemberTests-117232865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:35:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e3394e7f-7362-4977-854c-e158b3a5180d tempest-ProjectMemberTests-117232865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:35:45 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e3394e7f-7362-4977-854c-e158b3a5180d tempest-ProjectMemberTests-117232865 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:35:45 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-e3394e7f-7362-4977-854c-e158b3a5180d tempest-ProjectMemberTests-117232865 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:35:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e3394e7f-7362-4977-854c-e158b3a5180d tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a92afa7-d444-4fcf-bdda-87460d4e418f 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:45 devstack sudo[105529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a92afa7-d444-4fcf-bdda-87460d4e418f 1073741824 Jul 07 08:35:45 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:45 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-5e0abca1-87e5-4cf5-9df3-a02b682411ef tempest-ProjectReaderTests-1685940573 None] Create snapshot completed successfully Jul 07 08:35:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-445a3717-50df-4250-8c80-317ae92a4e23 tempest-VolumeDependencyTests-1845104136 None] Acquiring lock "cinder-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:35:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-445a3717-50df-4250-8c80-317ae92a4e23 tempest-VolumeDependencyTests-1845104136 None] Lock "cinder-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:35:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-445a3717-50df-4250-8c80-317ae92a4e23 tempest-VolumeDependencyTests-1845104136 None] Acquiring lock "cinder-quobyte-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:35:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-445a3717-50df-4250-8c80-317ae92a4e23 tempest-VolumeDependencyTests-1845104136 None] Lock "cinder-quobyte-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b" acquired by "delete_volume" :: waited 0.018s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:35:46 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc07892a-9ddd-4bf5-b63a-505df9184e29]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:35:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-445a3717-50df-4250-8c80-317ae92a4e23 tempest-VolumeDependencyTests-1845104136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:46 devstack sudo[105535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b Jul 07 08:35:46 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:46 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e3394e7f-7362-4977-854c-e158b3a5180d tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a92afa7-d444-4fcf-bdda-87460d4e418f 1073741824" returned: 0 in 0.933s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e3394e7f-7362-4977-854c-e158b3a5180d tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a92afa7-d444-4fcf-bdda-87460d4e418f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:46 devstack sudo[105537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a92afa7-d444-4fcf-bdda-87460d4e418f Jul 07 08:35:46 devstack sudo[105537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3d5e2c6e-7825-446c-898e-b6e39e08cce7 tempest-ProjectReaderTests-1685940573 None] Acquiring lock "cinder-fb34e724-d219-4193-9e16-7c10f1fe0a03-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:35:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3d5e2c6e-7825-446c-898e-b6e39e08cce7 tempest-ProjectReaderTests-1685940573 None] Lock "cinder-fb34e724-d219-4193-9e16-7c10f1fe0a03-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:35:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3d5e2c6e-7825-446c-898e-b6e39e08cce7 tempest-ProjectReaderTests-1685940573 None] Acquiring lock "cinder-quobyte-56ce7c1b-bbb3-4d3a-972b-900563b361d8" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:35:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3d5e2c6e-7825-446c-898e-b6e39e08cce7 tempest-ProjectReaderTests-1685940573 None] Lock "cinder-quobyte-56ce7c1b-bbb3-4d3a-972b-900563b361d8" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:35:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3d5e2c6e-7825-446c-898e-b6e39e08cce7 tempest-ProjectReaderTests-1685940573 None] Acquiring lock "cinder-quobyte-fb34e724-d219-4193-9e16-7c10f1fe0a03" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:35:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3d5e2c6e-7825-446c-898e-b6e39e08cce7 tempest-ProjectReaderTests-1685940573 None] Lock "cinder-quobyte-fb34e724-d219-4193-9e16-7c10f1fe0a03" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:35:46 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-3d5e2c6e-7825-446c-898e-b6e39e08cce7 tempest-ProjectReaderTests-1685940573 None] Deleting offline snapshot fb34e724-d219-4193-9e16-7c10f1fe0a03 of volume 56ce7c1b-bbb3-4d3a-972b-900563b361d8 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:35:46 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-3d5e2c6e-7825-446c-898e-b6e39e08cce7 tempest-ProjectReaderTests-1685940573 None] snapshot_file for this snap is: volume-56ce7c1b-bbb3-4d3a-972b-900563b361d8.fb34e724-d219-4193-9e16-7c10f1fe0a03 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:35:46 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f38487-b61c-431e-a0dc-b8784cfe8bca]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:35:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3d5e2c6e-7825-446c-898e-b6e39e08cce7 tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-56ce7c1b-bbb3-4d3a-972b-900563b361d8.fb34e724-d219-4193-9e16-7c10f1fe0a03 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:47 devstack sudo[105539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-56ce7c1b-bbb3-4d3a-972b-900563b361d8.fb34e724-d219-4193-9e16-7c10f1fe0a03 Jul 07 08:35:47 devstack sudo[105539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:47 devstack sudo[105537]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e3394e7f-7362-4977-854c-e158b3a5180d tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a92afa7-d444-4fcf-bdda-87460d4e418f" returned: 0 in 0.861s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:47 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e3394e7f-7362-4977-854c-e158b3a5180d tempest-ProjectMemberTests-117232865 None] <== create_volume: return (1861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:35:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e3394e7f-7362-4977-854c-e158b3a5180d tempest-ProjectMemberTests-117232865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.867s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:35:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-445a3717-50df-4250-8c80-317ae92a4e23 tempest-VolumeDependencyTests-1845104136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b" returned: 0 in 1.086s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-445a3717-50df-4250-8c80-317ae92a4e23 tempest-VolumeDependencyTests-1845104136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e3394e7f-7362-4977-854c-e158b3a5180d tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78ff0def-8b76-4b9b-8549-0608d24390f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a92afa7-d444-4fcf-bdda-87460d4e418f', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:35:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e3394e7f-7362-4977-854c-e158b3a5180d tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c2bf86d-8b03-406a-aabe-74dcdb5fcb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:35:47 devstack sudo[105546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b Jul 07 08:35:47 devstack sudo[105546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:47 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-e3394e7f-7362-4977-854c-e158b3a5180d tempest-ProjectMemberTests-117232865 None] Volume volume-1a92afa7-d444-4fcf-bdda-87460d4e418f (1a92afa7-d444-4fcf-bdda-87460d4e418f): created successfully Jul 07 08:35:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e3394e7f-7362-4977-854c-e158b3a5180d tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c2bf86d-8b03-406a-aabe-74dcdb5fcb77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:35:47 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e3394e7f-7362-4977-854c-e158b3a5180d tempest-ProjectMemberTests-117232865 None] Flow 'volume_create_manager' (342b5d77-05bf-4d78-be50-13bc12af0bc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:35:47 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-e3394e7f-7362-4977-854c-e158b3a5180d tempest-ProjectMemberTests-117232865 None] Created volume successfully. Jul 07 08:35:47 devstack sudo[105539]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3d5e2c6e-7825-446c-898e-b6e39e08cce7 tempest-ProjectReaderTests-1685940573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-56ce7c1b-bbb3-4d3a-972b-900563b361d8.fb34e724-d219-4193-9e16-7c10f1fe0a03" returned: 0 in 0.909s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-3d5e2c6e-7825-446c-898e-b6e39e08cce7 tempest-ProjectReaderTests-1685940573 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56ce7c1b-bbb3-4d3a-972b-900563b361d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:35:47 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d919652-6964-49ec-9514-358e8f358b38]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:35:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3d5e2c6e-7825-446c-898e-b6e39e08cce7 tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-56ce7c1b-bbb3-4d3a-972b-900563b361d8 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:48 devstack sudo[105557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-56ce7c1b-bbb3-4d3a-972b-900563b361d8 Jul 07 08:35:48 devstack sudo[105557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:48 devstack sudo[105546]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-445a3717-50df-4250-8c80-317ae92a4e23 tempest-VolumeDependencyTests-1845104136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b" returned: 0 in 0.840s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-445a3717-50df-4250-8c80-317ae92a4e23 tempest-VolumeDependencyTests-1845104136 None] Lock "cinder-quobyte-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b" released by "delete_volume" :: held 2.001s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:35:48 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-445a3717-50df-4250-8c80-317ae92a4e23 tempest-VolumeDependencyTests-1845104136 None] Created reservations ['c4ad93ef-1383-4d61-a852-e4c2ab120bcb', '43499b1a-9d29-4b45-92f0-3bf64c6e76cd', 'd7fdfbdf-311e-4008-8c97-8dc52d3366be', 'b4e89a8d-fb1e-4a9b-9893-d0aa4bfbe51c'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:35:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-de7d4ebf-7b9a-4708-a245-594ceaa71833 tempest-ProjectMemberTests-117232865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:35:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-de7d4ebf-7b9a-4708-a245-594ceaa71833 tempest-ProjectMemberTests-117232865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:35:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-de7d4ebf-7b9a-4708-a245-594ceaa71833 tempest-ProjectMemberTests-117232865 None] Creating offline snapshot ed63808f-f56b-460c-8ef4-643fd10df583 of volume 1a92afa7-d444-4fcf-bdda-87460d4e418f {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:35:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-445a3717-50df-4250-8c80-317ae92a4e23 tempest-VolumeDependencyTests-1845104136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:35:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-445a3717-50df-4250-8c80-317ae92a4e23 tempest-VolumeDependencyTests-1845104136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:35:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-445a3717-50df-4250-8c80-317ae92a4e23 tempest-VolumeDependencyTests-1845104136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:35:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-445a3717-50df-4250-8c80-317ae92a4e23 tempest-VolumeDependencyTests-1845104136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:35:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-445a3717-50df-4250-8c80-317ae92a4e23 tempest-VolumeDependencyTests-1845104136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:35:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-445a3717-50df-4250-8c80-317ae92a4e23 tempest-VolumeDependencyTests-1845104136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:48 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae98b8b9-ba2d-49a6-a40d-5820f9df28e0]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:35:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-de7d4ebf-7b9a-4708-a245-594ceaa71833 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a92afa7-d444-4fcf-bdda-87460d4e418f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:48 devstack sudo[105563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:35:48 devstack sudo[105563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:48 devstack sudo[105557]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3d5e2c6e-7825-446c-898e-b6e39e08cce7 tempest-ProjectReaderTests-1685940573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-56ce7c1b-bbb3-4d3a-972b-900563b361d8" returned: 0 in 0.975s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3d5e2c6e-7825-446c-898e-b6e39e08cce7 tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-56ce7c1b-bbb3-4d3a-972b-900563b361d8.fb34e724-d219-4193-9e16-7c10f1fe0a03 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:48 devstack sudo[105564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a92afa7-d444-4fcf-bdda-87460d4e418f Jul 07 08:35:48 devstack sudo[105564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:48 devstack sudo[105566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-56ce7c1b-bbb3-4d3a-972b-900563b361d8.fb34e724-d219-4193-9e16-7c10f1fe0a03 Jul 07 08:35:48 devstack sudo[105566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:49 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cfe2ed11-296d-4939-8e62-c0b9f0ee05c8 tempest-ProjectAdminTests-750220198 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.75777053833, 'free_capacity_gb': 1775.75777053833, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87199) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 07 08:35:49 devstack sudo[105563]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-445a3717-50df-4250-8c80-317ae92a4e23 tempest-VolumeDependencyTests-1845104136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.768s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:49 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-445a3717-50df-4250-8c80-317ae92a4e23 tempest-VolumeDependencyTests-1845104136 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:35:49 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-445a3717-50df-4250-8c80-317ae92a4e23 tempest-VolumeDependencyTests-1845104136 None] Deleted volume successfully. Jul 07 08:35:49 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-445a3717-50df-4250-8c80-317ae92a4e23 tempest-VolumeDependencyTests-1845104136 None] Lock "cinder-37b9eccf-0b7d-4b85-9885-9e7b74d66a6b-delete_volume" released by "delete_volume" :: held 3.153s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:35:49 devstack sudo[105564]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-de7d4ebf-7b9a-4708-a245-594ceaa71833 tempest-ProjectMemberTests-117232865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a92afa7-d444-4fcf-bdda-87460d4e418f" returned: 0 in 0.825s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-de7d4ebf-7b9a-4708-a245-594ceaa71833 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a92afa7-d444-4fcf-bdda-87460d4e418f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a92afa7-d444-4fcf-bdda-87460d4e418f.ed63808f-f56b-460c-8ef4-643fd10df583 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:49 devstack sudo[105576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a92afa7-d444-4fcf-bdda-87460d4e418f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a92afa7-d444-4fcf-bdda-87460d4e418f.ed63808f-f56b-460c-8ef4-643fd10df583 1G Jul 07 08:35:49 devstack sudo[105576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:49 devstack sudo[105566]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3d5e2c6e-7825-446c-898e-b6e39e08cce7 tempest-ProjectReaderTests-1685940573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-56ce7c1b-bbb3-4d3a-972b-900563b361d8.fb34e724-d219-4193-9e16-7c10f1fe0a03" returned: 0 in 0.820s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3d5e2c6e-7825-446c-898e-b6e39e08cce7 tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-56ce7c1b-bbb3-4d3a-972b-900563b361d8.fb34e724-d219-4193-9e16-7c10f1fe0a03 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:49 devstack sudo[105578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-56ce7c1b-bbb3-4d3a-972b-900563b361d8.fb34e724-d219-4193-9e16-7c10f1fe0a03 Jul 07 08:35:49 devstack sudo[105578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:49 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c053b6dc-4b0e-4d1d-b8c8-49ddc0564ed9 tempest-VolumeDependencyTests-1845104136 None] Acquiring lock "cinder-81d57e27-3bb0-49e8-8b36-f5f7e35d42e4-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:35:49 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c053b6dc-4b0e-4d1d-b8c8-49ddc0564ed9 tempest-VolumeDependencyTests-1845104136 None] Lock "cinder-81d57e27-3bb0-49e8-8b36-f5f7e35d42e4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:35:49 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c053b6dc-4b0e-4d1d-b8c8-49ddc0564ed9 tempest-VolumeDependencyTests-1845104136 None] Acquiring lock "cinder-quobyte-81d57e27-3bb0-49e8-8b36-f5f7e35d42e4" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:35:49 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c053b6dc-4b0e-4d1d-b8c8-49ddc0564ed9 tempest-VolumeDependencyTests-1845104136 None] Lock "cinder-quobyte-81d57e27-3bb0-49e8-8b36-f5f7e35d42e4" acquired by "delete_volume" :: waited 0.030s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:35:49 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37bb27a-dd90-4730-957a-c2f1f22440ca]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:35:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c053b6dc-4b0e-4d1d-b8c8-49ddc0564ed9 tempest-VolumeDependencyTests-1845104136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-81d57e27-3bb0-49e8-8b36-f5f7e35d42e4 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:50 devstack sudo[105580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-81d57e27-3bb0-49e8-8b36-f5f7e35d42e4 Jul 07 08:35:50 devstack sudo[105580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:50 devstack sudo[105578]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3d5e2c6e-7825-446c-898e-b6e39e08cce7 tempest-ProjectReaderTests-1685940573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-56ce7c1b-bbb3-4d3a-972b-900563b361d8.fb34e724-d219-4193-9e16-7c10f1fe0a03" returned: 0 in 0.795s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:50 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3d5e2c6e-7825-446c-898e-b6e39e08cce7 tempest-ProjectReaderTests-1685940573 None] Lock "cinder-quobyte-fb34e724-d219-4193-9e16-7c10f1fe0a03" released by "_delete_snapshot" :: held 3.671s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:35:50 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3d5e2c6e-7825-446c-898e-b6e39e08cce7 tempest-ProjectReaderTests-1685940573 None] Lock "cinder-quobyte-56ce7c1b-bbb3-4d3a-972b-900563b361d8" released by "delete_snapshot" :: held 3.724s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:35:50 devstack sudo[105576]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-de7d4ebf-7b9a-4708-a245-594ceaa71833 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a92afa7-d444-4fcf-bdda-87460d4e418f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a92afa7-d444-4fcf-bdda-87460d4e418f.ed63808f-f56b-460c-8ef4-643fd10df583 1G" returned: 0 in 0.987s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-de7d4ebf-7b9a-4708-a245-594ceaa71833 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a92afa7-d444-4fcf-bdda-87460d4e418f -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a92afa7-d444-4fcf-bdda-87460d4e418f.ed63808f-f56b-460c-8ef4-643fd10df583 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:50 devstack sudo[105587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a92afa7-d444-4fcf-bdda-87460d4e418f -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a92afa7-d444-4fcf-bdda-87460d4e418f.ed63808f-f56b-460c-8ef4-643fd10df583 Jul 07 08:35:50 devstack sudo[105587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:50 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-3d5e2c6e-7825-446c-898e-b6e39e08cce7 tempest-ProjectReaderTests-1685940573 None] Created reservations ['9553b615-6694-467b-96fa-9da5fa68bcf2', 'e065d696-fcc8-43dd-9a76-65d1ad8782fd', '893f8c69-f1e8-4b14-9822-db5dbdb88369', '076eb9e4-b0a3-4956-9640-bf11c98eab2f'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:35:50 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-3d5e2c6e-7825-446c-898e-b6e39e08cce7 tempest-ProjectReaderTests-1685940573 None] Delete snapshot completed successfully. Jul 07 08:35:50 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3d5e2c6e-7825-446c-898e-b6e39e08cce7 tempest-ProjectReaderTests-1685940573 None] Lock "cinder-fb34e724-d219-4193-9e16-7c10f1fe0a03-delete_snapshot" released by "delete_snapshot" :: held 3.971s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:35:50 devstack sudo[105580]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c053b6dc-4b0e-4d1d-b8c8-49ddc0564ed9 tempest-VolumeDependencyTests-1845104136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-81d57e27-3bb0-49e8-8b36-f5f7e35d42e4" returned: 0 in 0.959s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c053b6dc-4b0e-4d1d-b8c8-49ddc0564ed9 tempest-VolumeDependencyTests-1845104136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-81d57e27-3bb0-49e8-8b36-f5f7e35d42e4 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:50 devstack sudo[105593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-81d57e27-3bb0-49e8-8b36-f5f7e35d42e4 Jul 07 08:35:50 devstack sudo[105593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:51 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b8a4db99-c1a7-435a-9df8-087a0e77ace3 tempest-ProjectReaderTests-1685940573 None] Acquiring lock "cinder-56ce7c1b-bbb3-4d3a-972b-900563b361d8-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:35:51 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b8a4db99-c1a7-435a-9df8-087a0e77ace3 tempest-ProjectReaderTests-1685940573 None] Lock "cinder-56ce7c1b-bbb3-4d3a-972b-900563b361d8-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:35:51 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b8a4db99-c1a7-435a-9df8-087a0e77ace3 tempest-ProjectReaderTests-1685940573 None] Acquiring lock "cinder-quobyte-56ce7c1b-bbb3-4d3a-972b-900563b361d8" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:35:51 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b8a4db99-c1a7-435a-9df8-087a0e77ace3 tempest-ProjectReaderTests-1685940573 None] Lock "cinder-quobyte-56ce7c1b-bbb3-4d3a-972b-900563b361d8" acquired by "delete_volume" :: waited 0.028s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:35:51 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[18fe1b2e-bc90-41f8-b7aa-a9ae412ff109]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:35:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b8a4db99-c1a7-435a-9df8-087a0e77ace3 tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-56ce7c1b-bbb3-4d3a-972b-900563b361d8 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:51 devstack sudo[105587]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:51 devstack sudo[105598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-56ce7c1b-bbb3-4d3a-972b-900563b361d8 Jul 07 08:35:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-de7d4ebf-7b9a-4708-a245-594ceaa71833 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a92afa7-d444-4fcf-bdda-87460d4e418f -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a92afa7-d444-4fcf-bdda-87460d4e418f.ed63808f-f56b-460c-8ef4-643fd10df583" returned: 0 in 0.872s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:51 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-de7d4ebf-7b9a-4708-a245-594ceaa71833 tempest-ProjectMemberTests-117232865 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a92afa7-d444-4fcf-bdda-87460d4e418f.ed63808f-f56b-460c-8ef4-643fd10df583 is being set with open permissions: ugo+rw Jul 07 08:35:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-de7d4ebf-7b9a-4708-a245-594ceaa71833 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a92afa7-d444-4fcf-bdda-87460d4e418f.ed63808f-f56b-460c-8ef4-643fd10df583 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:51 devstack sudo[105598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:51 devstack sudo[105602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a92afa7-d444-4fcf-bdda-87460d4e418f.ed63808f-f56b-460c-8ef4-643fd10df583 Jul 07 08:35:51 devstack sudo[105602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:51 devstack sudo[105593]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c053b6dc-4b0e-4d1d-b8c8-49ddc0564ed9 tempest-VolumeDependencyTests-1845104136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-81d57e27-3bb0-49e8-8b36-f5f7e35d42e4" returned: 0 in 0.978s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:51 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c053b6dc-4b0e-4d1d-b8c8-49ddc0564ed9 tempest-VolumeDependencyTests-1845104136 None] Lock "cinder-quobyte-81d57e27-3bb0-49e8-8b36-f5f7e35d42e4" released by "delete_volume" :: held 2.013s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:35:51 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-c053b6dc-4b0e-4d1d-b8c8-49ddc0564ed9 tempest-VolumeDependencyTests-1845104136 None] Created reservations ['5ccbc3eb-9d10-40a3-a284-a1670f1f6a8e', '9ffcac34-cfed-4784-b8e3-f97535826407', '8d42f74d-c746-4043-b429-462049e90c5f', '4bd7fdb8-3099-47d4-b6ba-9539850c1047'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:35:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c053b6dc-4b0e-4d1d-b8c8-49ddc0564ed9 tempest-VolumeDependencyTests-1845104136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:35:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c053b6dc-4b0e-4d1d-b8c8-49ddc0564ed9 tempest-VolumeDependencyTests-1845104136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:35:52 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c053b6dc-4b0e-4d1d-b8c8-49ddc0564ed9 tempest-VolumeDependencyTests-1845104136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:35:52 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c053b6dc-4b0e-4d1d-b8c8-49ddc0564ed9 tempest-VolumeDependencyTests-1845104136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:35:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c053b6dc-4b0e-4d1d-b8c8-49ddc0564ed9 tempest-VolumeDependencyTests-1845104136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:35:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c053b6dc-4b0e-4d1d-b8c8-49ddc0564ed9 tempest-VolumeDependencyTests-1845104136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:52 devstack sudo[105608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:35:52 devstack sudo[105608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:52 devstack sudo[105602]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-de7d4ebf-7b9a-4708-a245-594ceaa71833 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a92afa7-d444-4fcf-bdda-87460d4e418f.ed63808f-f56b-460c-8ef4-643fd10df583" returned: 0 in 0.796s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:52 devstack sudo[105598]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b8a4db99-c1a7-435a-9df8-087a0e77ace3 tempest-ProjectReaderTests-1685940573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-56ce7c1b-bbb3-4d3a-972b-900563b361d8" returned: 0 in 0.993s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b8a4db99-c1a7-435a-9df8-087a0e77ace3 tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-56ce7c1b-bbb3-4d3a-972b-900563b361d8 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-de7d4ebf-7b9a-4708-a245-594ceaa71833 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a92afa7-d444-4fcf-bdda-87460d4e418f.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:52 devstack sudo[105611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-56ce7c1b-bbb3-4d3a-972b-900563b361d8 Jul 07 08:35:52 devstack sudo[105611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:52 devstack sudo[105613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a92afa7-d444-4fcf-bdda-87460d4e418f.info Jul 07 08:35:52 devstack sudo[105613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:52 devstack sudo[105608]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c053b6dc-4b0e-4d1d-b8c8-49ddc0564ed9 tempest-VolumeDependencyTests-1845104136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.926s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:53 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-c053b6dc-4b0e-4d1d-b8c8-49ddc0564ed9 tempest-VolumeDependencyTests-1845104136 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:35:53 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-c053b6dc-4b0e-4d1d-b8c8-49ddc0564ed9 tempest-VolumeDependencyTests-1845104136 None] Deleted volume successfully. Jul 07 08:35:53 devstack sudo[105611]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:53 devstack sudo[105613]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b8a4db99-c1a7-435a-9df8-087a0e77ace3 tempest-ProjectReaderTests-1685940573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-56ce7c1b-bbb3-4d3a-972b-900563b361d8" returned: 0 in 0.763s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-de7d4ebf-7b9a-4708-a245-594ceaa71833 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a92afa7-d444-4fcf-bdda-87460d4e418f.info" returned: 0 in 0.752s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:53 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-de7d4ebf-7b9a-4708-a245-594ceaa71833 tempest-ProjectMemberTests-117232865 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a92afa7-d444-4fcf-bdda-87460d4e418f.info is being set with open permissions: ugo+rw Jul 07 08:35:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-de7d4ebf-7b9a-4708-a245-594ceaa71833 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a92afa7-d444-4fcf-bdda-87460d4e418f.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:53 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b8a4db99-c1a7-435a-9df8-087a0e77ace3 tempest-ProjectReaderTests-1685940573 None] Lock "cinder-quobyte-56ce7c1b-bbb3-4d3a-972b-900563b361d8" released by "delete_volume" :: held 1.839s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:35:53 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-c053b6dc-4b0e-4d1d-b8c8-49ddc0564ed9 tempest-VolumeDependencyTests-1845104136 None] Lock "cinder-81d57e27-3bb0-49e8-8b36-f5f7e35d42e4-delete_volume" released by "delete_volume" :: held 3.260s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:35:53 devstack sudo[105618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a92afa7-d444-4fcf-bdda-87460d4e418f.info Jul 07 08:35:53 devstack sudo[105618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:53 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-b8a4db99-c1a7-435a-9df8-087a0e77ace3 tempest-ProjectReaderTests-1685940573 None] Created reservations ['470ae387-7c60-4219-92de-040d200e41bc', 'bfe1f258-cba3-47c3-866c-f306c764a466', 'cd547df3-00f2-4b4c-a8b5-126ff2e1f1e2', 'e725904b-d5e4-4e37-9fc2-a3d862c2a7d1'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:35:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b8a4db99-c1a7-435a-9df8-087a0e77ace3 tempest-ProjectReaderTests-1685940573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:35:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b8a4db99-c1a7-435a-9df8-087a0e77ace3 tempest-ProjectReaderTests-1685940573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:35:53 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b8a4db99-c1a7-435a-9df8-087a0e77ace3 tempest-ProjectReaderTests-1685940573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:35:53 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b8a4db99-c1a7-435a-9df8-087a0e77ace3 tempest-ProjectReaderTests-1685940573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:35:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b8a4db99-c1a7-435a-9df8-087a0e77ace3 tempest-ProjectReaderTests-1685940573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:35:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b8a4db99-c1a7-435a-9df8-087a0e77ace3 tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:53 devstack sudo[105620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:35:53 devstack sudo[105620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:54 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc312cab-f23d-4954-8260-53d51a29741c tempest-ProjectReaderTests-1685940573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:35:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cc312cab-f23d-4954-8260-53d51a29741c tempest-ProjectReaderTests-1685940573 None] Flow 'volume_create_manager' (c6c0d61c-0a29-4bb0-aa8c-2a6de7bab6a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:35:54 devstack sudo[105620]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cc312cab-f23d-4954-8260-53d51a29741c tempest-ProjectReaderTests-1685940573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f92d2c1-35f6-4f50-84b1-68f9d895c747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:35:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b8a4db99-c1a7-435a-9df8-087a0e77ace3 tempest-ProjectReaderTests-1685940573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.847s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:54 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-b8a4db99-c1a7-435a-9df8-087a0e77ace3 tempest-ProjectReaderTests-1685940573 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:35:54 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-b8a4db99-c1a7-435a-9df8-087a0e77ace3 tempest-ProjectReaderTests-1685940573 None] Deleted volume successfully. Jul 07 08:35:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cc312cab-f23d-4954-8260-53d51a29741c tempest-ProjectReaderTests-1685940573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f92d2c1-35f6-4f50-84b1-68f9d895c747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:35:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1582709216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8091c7f9-2290-4baf-a9b9-a6034061609c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06330941a308447a9ec29b93464314b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:35:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:35:54Z,use_quota=True,user_id='7e7152ed33e44a5a937717a4c518b2d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:35:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cc312cab-f23d-4954-8260-53d51a29741c tempest-ProjectReaderTests-1685940573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57a04f78-8e51-40cf-b35f-8ecfcf3234d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:35:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cc312cab-f23d-4954-8260-53d51a29741c tempest-ProjectReaderTests-1685940573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57a04f78-8e51-40cf-b35f-8ecfcf3234d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:35:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cc312cab-f23d-4954-8260-53d51a29741c tempest-ProjectReaderTests-1685940573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b136b192-129b-4f33-a3fe-2e200df35734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:35:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cc312cab-f23d-4954-8260-53d51a29741c tempest-ProjectReaderTests-1685940573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b136b192-129b-4f33-a3fe-2e200df35734) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8091c7f9-2290-4baf-a9b9-a6034061609c', 'volume_name': 'volume-8091c7f9-2290-4baf-a9b9-a6034061609c', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:35:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cc312cab-f23d-4954-8260-53d51a29741c tempest-ProjectReaderTests-1685940573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1774104-e0cd-4a8f-bacf-b041d9b3653d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:35:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cc312cab-f23d-4954-8260-53d51a29741c tempest-ProjectReaderTests-1685940573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1774104-e0cd-4a8f-bacf-b041d9b3653d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:35:54 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cc312cab-f23d-4954-8260-53d51a29741c tempest-ProjectReaderTests-1685940573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44d2d100-8836-498a-a7da-a90f7b44b730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:35:54 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-cc312cab-f23d-4954-8260-53d51a29741c tempest-ProjectReaderTests-1685940573 None] Volume 8091c7f9-2290-4baf-a9b9-a6034061609c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8091c7f9-2290-4baf-a9b9-a6034061609c', 'volume_size': 1} Jul 07 08:35:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cc312cab-f23d-4954-8260-53d51a29741c tempest-ProjectReaderTests-1685940573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:35:54 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b8a4db99-c1a7-435a-9df8-087a0e77ace3 tempest-ProjectReaderTests-1685940573 None] Lock "cinder-56ce7c1b-bbb3-4d3a-972b-900563b361d8-delete_volume" released by "delete_volume" :: held 3.046s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:35:54 devstack sudo[105618]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-de7d4ebf-7b9a-4708-a245-594ceaa71833 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a92afa7-d444-4fcf-bdda-87460d4e418f.info" returned: 0 in 1.126s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-de7d4ebf-7b9a-4708-a245-594ceaa71833 tempest-ProjectMemberTests-117232865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.536s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:35:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cc312cab-f23d-4954-8260-53d51a29741c tempest-ProjectReaderTests-1685940573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.061s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:35:54 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-cc312cab-f23d-4954-8260-53d51a29741c tempest-ProjectReaderTests-1685940573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:35:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1582709216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8091c7f9-2290-4baf-a9b9-a6034061609c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06330941a308447a9ec29b93464314b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:35:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:35:54Z,use_quota=True,user_id='7e7152ed33e44a5a937717a4c518b2d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:35:54 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-cc312cab-f23d-4954-8260-53d51a29741c tempest-ProjectReaderTests-1685940573 None] Creating volume 8091c7f9-2290-4baf-a9b9-a6034061609c {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:35:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cc312cab-f23d-4954-8260-53d51a29741c tempest-ProjectReaderTests-1685940573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:35:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cc312cab-f23d-4954-8260-53d51a29741c tempest-ProjectReaderTests-1685940573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:35:54 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-cc312cab-f23d-4954-8260-53d51a29741c tempest-ProjectReaderTests-1685940573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:35:54 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-cc312cab-f23d-4954-8260-53d51a29741c tempest-ProjectReaderTests-1685940573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:35:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cc312cab-f23d-4954-8260-53d51a29741c tempest-ProjectReaderTests-1685940573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:35:54 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-cc312cab-f23d-4954-8260-53d51a29741c tempest-ProjectReaderTests-1685940573 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:35:54 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-cc312cab-f23d-4954-8260-53d51a29741c tempest-ProjectReaderTests-1685940573 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:35:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cc312cab-f23d-4954-8260-53d51a29741c tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8091c7f9-2290-4baf-a9b9-a6034061609c 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:54 devstack sudo[105624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8091c7f9-2290-4baf-a9b9-a6034061609c 1073741824 Jul 07 08:35:54 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:54 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-de7d4ebf-7b9a-4708-a245-594ceaa71833 tempest-ProjectMemberTests-117232865 None] Create snapshot completed successfully Jul 07 08:35:55 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3b1998fe-78c3-4608-9837-b289fe64cc77 tempest-ProjectMemberTests-117232865 None] Acquiring lock "cinder-ed63808f-f56b-460c-8ef4-643fd10df583-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:35:55 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3b1998fe-78c3-4608-9837-b289fe64cc77 tempest-ProjectMemberTests-117232865 None] Lock "cinder-ed63808f-f56b-460c-8ef4-643fd10df583-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:35:55 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3b1998fe-78c3-4608-9837-b289fe64cc77 tempest-ProjectMemberTests-117232865 None] Acquiring lock "cinder-quobyte-1a92afa7-d444-4fcf-bdda-87460d4e418f" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:35:55 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3b1998fe-78c3-4608-9837-b289fe64cc77 tempest-ProjectMemberTests-117232865 None] Lock "cinder-quobyte-1a92afa7-d444-4fcf-bdda-87460d4e418f" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:35:55 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3b1998fe-78c3-4608-9837-b289fe64cc77 tempest-ProjectMemberTests-117232865 None] Acquiring lock "cinder-quobyte-ed63808f-f56b-460c-8ef4-643fd10df583" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:35:55 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3b1998fe-78c3-4608-9837-b289fe64cc77 tempest-ProjectMemberTests-117232865 None] Lock "cinder-quobyte-ed63808f-f56b-460c-8ef4-643fd10df583" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:35:55 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-3b1998fe-78c3-4608-9837-b289fe64cc77 tempest-ProjectMemberTests-117232865 None] Deleting offline snapshot ed63808f-f56b-460c-8ef4-643fd10df583 of volume 1a92afa7-d444-4fcf-bdda-87460d4e418f {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:35:55 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-3b1998fe-78c3-4608-9837-b289fe64cc77 tempest-ProjectMemberTests-117232865 None] snapshot_file for this snap is: volume-1a92afa7-d444-4fcf-bdda-87460d4e418f.ed63808f-f56b-460c-8ef4-643fd10df583 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:35:55 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[004d706b-1f73-4be6-9809-eabf9610a740]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:35:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3b1998fe-78c3-4608-9837-b289fe64cc77 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a92afa7-d444-4fcf-bdda-87460d4e418f.ed63808f-f56b-460c-8ef4-643fd10df583 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:55 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cc312cab-f23d-4954-8260-53d51a29741c tempest-ProjectReaderTests-1685940573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8091c7f9-2290-4baf-a9b9-a6034061609c 1073741824" returned: 0 in 1.124s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:55 devstack sudo[105631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a92afa7-d444-4fcf-bdda-87460d4e418f.ed63808f-f56b-460c-8ef4-643fd10df583 Jul 07 08:35:55 devstack sudo[105631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cc312cab-f23d-4954-8260-53d51a29741c tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8091c7f9-2290-4baf-a9b9-a6034061609c {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:55 devstack sudo[105633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8091c7f9-2290-4baf-a9b9-a6034061609c Jul 07 08:35:55 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:56 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cc312cab-f23d-4954-8260-53d51a29741c tempest-ProjectReaderTests-1685940573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8091c7f9-2290-4baf-a9b9-a6034061609c" returned: 0 in 0.713s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-cc312cab-f23d-4954-8260-53d51a29741c tempest-ProjectReaderTests-1685940573 None] <== create_volume: return (1889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:35:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cc312cab-f23d-4954-8260-53d51a29741c tempest-ProjectReaderTests-1685940573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.893s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:35:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cc312cab-f23d-4954-8260-53d51a29741c tempest-ProjectReaderTests-1685940573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44d2d100-8836-498a-a7da-a90f7b44b730) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8091c7f9-2290-4baf-a9b9-a6034061609c', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:35:56 devstack sudo[105631]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cc312cab-f23d-4954-8260-53d51a29741c tempest-ProjectReaderTests-1685940573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f15523a7-e1db-4633-8358-d2e854fe691e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:35:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3b1998fe-78c3-4608-9837-b289fe64cc77 tempest-ProjectMemberTests-117232865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a92afa7-d444-4fcf-bdda-87460d4e418f.ed63808f-f56b-460c-8ef4-643fd10df583" returned: 0 in 0.901s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:56 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-3b1998fe-78c3-4608-9837-b289fe64cc77 tempest-ProjectMemberTests-117232865 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a92afa7-d444-4fcf-bdda-87460d4e418f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:35:56 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-cc312cab-f23d-4954-8260-53d51a29741c tempest-ProjectReaderTests-1685940573 None] Volume volume-8091c7f9-2290-4baf-a9b9-a6034061609c (8091c7f9-2290-4baf-a9b9-a6034061609c): created successfully Jul 07 08:35:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cc312cab-f23d-4954-8260-53d51a29741c tempest-ProjectReaderTests-1685940573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f15523a7-e1db-4633-8358-d2e854fe691e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:35:56 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-cc312cab-f23d-4954-8260-53d51a29741c tempest-ProjectReaderTests-1685940573 None] Flow 'volume_create_manager' (c6c0d61c-0a29-4bb0-aa8c-2a6de7bab6a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:35:56 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f367edc-68b1-46d2-84ed-9a97f0c6ef82]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:35:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3b1998fe-78c3-4608-9837-b289fe64cc77 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a92afa7-d444-4fcf-bdda-87460d4e418f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:56 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-cc312cab-f23d-4954-8260-53d51a29741c tempest-ProjectReaderTests-1685940573 None] Created volume successfully. Jul 07 08:35:56 devstack sudo[105639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a92afa7-d444-4fcf-bdda-87460d4e418f Jul 07 08:35:56 devstack sudo[105639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:57 devstack sudo[105639]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3b1998fe-78c3-4608-9837-b289fe64cc77 tempest-ProjectMemberTests-117232865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a92afa7-d444-4fcf-bdda-87460d4e418f" returned: 0 in 0.875s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3b1998fe-78c3-4608-9837-b289fe64cc77 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a92afa7-d444-4fcf-bdda-87460d4e418f.ed63808f-f56b-460c-8ef4-643fd10df583 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:57 devstack sudo[105645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a92afa7-d444-4fcf-bdda-87460d4e418f.ed63808f-f56b-460c-8ef4-643fd10df583 Jul 07 08:35:57 devstack sudo[105645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cd34637b-ee14-4905-b9ad-042da2ae1b66 tempest-ProjectReaderTests-1685940573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:35:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cd34637b-ee14-4905-b9ad-042da2ae1b66 tempest-ProjectReaderTests-1685940573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:35:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-cd34637b-ee14-4905-b9ad-042da2ae1b66 tempest-ProjectReaderTests-1685940573 None] Creating offline snapshot 9d3f4c96-27e6-4bda-a7ba-474ba7a993f8 of volume 8091c7f9-2290-4baf-a9b9-a6034061609c {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:35:57 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a33ef89-b8ab-4ad5-849f-60c748567e48]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:35:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cd34637b-ee14-4905-b9ad-042da2ae1b66 tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8091c7f9-2290-4baf-a9b9-a6034061609c {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:57 devstack sudo[105647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8091c7f9-2290-4baf-a9b9-a6034061609c Jul 07 08:35:57 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:57 devstack sudo[105645]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3b1998fe-78c3-4608-9837-b289fe64cc77 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a92afa7-d444-4fcf-bdda-87460d4e418f.ed63808f-f56b-460c-8ef4-643fd10df583" returned: 0 in 0.922s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3b1998fe-78c3-4608-9837-b289fe64cc77 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a92afa7-d444-4fcf-bdda-87460d4e418f.ed63808f-f56b-460c-8ef4-643fd10df583 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:58 devstack sudo[105652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a92afa7-d444-4fcf-bdda-87460d4e418f.ed63808f-f56b-460c-8ef4-643fd10df583 Jul 07 08:35:58 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:58 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cd34637b-ee14-4905-b9ad-042da2ae1b66 tempest-ProjectReaderTests-1685940573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8091c7f9-2290-4baf-a9b9-a6034061609c" returned: 0 in 0.842s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cd34637b-ee14-4905-b9ad-042da2ae1b66 tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8091c7f9-2290-4baf-a9b9-a6034061609c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8091c7f9-2290-4baf-a9b9-a6034061609c.9d3f4c96-27e6-4bda-a7ba-474ba7a993f8 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:58 devstack sudo[105658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8091c7f9-2290-4baf-a9b9-a6034061609c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8091c7f9-2290-4baf-a9b9-a6034061609c.9d3f4c96-27e6-4bda-a7ba-474ba7a993f8 1G Jul 07 08:35:58 devstack sudo[105658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:58 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-3b1998fe-78c3-4608-9837-b289fe64cc77 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a92afa7-d444-4fcf-bdda-87460d4e418f.ed63808f-f56b-460c-8ef4-643fd10df583" returned: 0 in 0.846s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:58 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3b1998fe-78c3-4608-9837-b289fe64cc77 tempest-ProjectMemberTests-117232865 None] Lock "cinder-quobyte-ed63808f-f56b-460c-8ef4-643fd10df583" released by "_delete_snapshot" :: held 3.727s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:35:58 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3b1998fe-78c3-4608-9837-b289fe64cc77 tempest-ProjectMemberTests-117232865 None] Lock "cinder-quobyte-1a92afa7-d444-4fcf-bdda-87460d4e418f" released by "delete_snapshot" :: held 3.757s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:35:59 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-3b1998fe-78c3-4608-9837-b289fe64cc77 tempest-ProjectMemberTests-117232865 None] Created reservations ['9991a79c-173b-46bd-9199-004c154ad2b6', '4f97af0c-7ba3-4c0a-ab3c-18eac8005ffb', '759dbcb2-eb3b-4bc4-95c4-eb5773debd36', '6461a719-c23e-4f73-a607-fb7d9e44ab6b'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:35:59 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-3b1998fe-78c3-4608-9837-b289fe64cc77 tempest-ProjectMemberTests-117232865 None] Delete snapshot completed successfully. Jul 07 08:35:59 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-3b1998fe-78c3-4608-9837-b289fe64cc77 tempest-ProjectMemberTests-117232865 None] Lock "cinder-ed63808f-f56b-460c-8ef4-643fd10df583-delete_snapshot" released by "delete_snapshot" :: held 3.981s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:35:59 devstack sudo[105658]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cd34637b-ee14-4905-b9ad-042da2ae1b66 tempest-ProjectReaderTests-1685940573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8091c7f9-2290-4baf-a9b9-a6034061609c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8091c7f9-2290-4baf-a9b9-a6034061609c.9d3f4c96-27e6-4bda-a7ba-474ba7a993f8 1G" returned: 0 in 1.037s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cd34637b-ee14-4905-b9ad-042da2ae1b66 tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8091c7f9-2290-4baf-a9b9-a6034061609c -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8091c7f9-2290-4baf-a9b9-a6034061609c.9d3f4c96-27e6-4bda-a7ba-474ba7a993f8 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:59 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-253a9b84-3445-4583-bd9c-cd7a4fb3fed8 tempest-ProjectMemberTests-117232865 None] Acquiring lock "cinder-1a92afa7-d444-4fcf-bdda-87460d4e418f-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:35:59 devstack sudo[105666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8091c7f9-2290-4baf-a9b9-a6034061609c -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8091c7f9-2290-4baf-a9b9-a6034061609c.9d3f4c96-27e6-4bda-a7ba-474ba7a993f8 Jul 07 08:35:59 devstack sudo[105666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:59 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-253a9b84-3445-4583-bd9c-cd7a4fb3fed8 tempest-ProjectMemberTests-117232865 None] Lock "cinder-1a92afa7-d444-4fcf-bdda-87460d4e418f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:35:59 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-253a9b84-3445-4583-bd9c-cd7a4fb3fed8 tempest-ProjectMemberTests-117232865 None] Acquiring lock "cinder-quobyte-1a92afa7-d444-4fcf-bdda-87460d4e418f" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:35:59 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-253a9b84-3445-4583-bd9c-cd7a4fb3fed8 tempest-ProjectMemberTests-117232865 None] Lock "cinder-quobyte-1a92afa7-d444-4fcf-bdda-87460d4e418f" acquired by "delete_volume" :: waited 0.021s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:35:59 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ccbe3d9-aef5-45dd-938f-528f1a4f271c]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:35:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-253a9b84-3445-4583-bd9c-cd7a4fb3fed8 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a92afa7-d444-4fcf-bdda-87460d4e418f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:59 devstack sudo[105668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a92afa7-d444-4fcf-bdda-87460d4e418f Jul 07 08:35:59 devstack sudo[105668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:00 devstack sudo[105666]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cd34637b-ee14-4905-b9ad-042da2ae1b66 tempest-ProjectReaderTests-1685940573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8091c7f9-2290-4baf-a9b9-a6034061609c -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8091c7f9-2290-4baf-a9b9-a6034061609c.9d3f4c96-27e6-4bda-a7ba-474ba7a993f8" returned: 0 in 0.776s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:00 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-cd34637b-ee14-4905-b9ad-042da2ae1b66 tempest-ProjectReaderTests-1685940573 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8091c7f9-2290-4baf-a9b9-a6034061609c.9d3f4c96-27e6-4bda-a7ba-474ba7a993f8 is being set with open permissions: ugo+rw Jul 07 08:36:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cd34637b-ee14-4905-b9ad-042da2ae1b66 tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8091c7f9-2290-4baf-a9b9-a6034061609c.9d3f4c96-27e6-4bda-a7ba-474ba7a993f8 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:00 devstack sudo[105674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8091c7f9-2290-4baf-a9b9-a6034061609c.9d3f4c96-27e6-4bda-a7ba-474ba7a993f8 Jul 07 08:36:00 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:00 devstack sudo[105668]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-253a9b84-3445-4583-bd9c-cd7a4fb3fed8 tempest-ProjectMemberTests-117232865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a92afa7-d444-4fcf-bdda-87460d4e418f" returned: 0 in 0.855s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-253a9b84-3445-4583-bd9c-cd7a4fb3fed8 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a92afa7-d444-4fcf-bdda-87460d4e418f {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:00 devstack sudo[105679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a92afa7-d444-4fcf-bdda-87460d4e418f Jul 07 08:36:00 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:01 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cd34637b-ee14-4905-b9ad-042da2ae1b66 tempest-ProjectReaderTests-1685940573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8091c7f9-2290-4baf-a9b9-a6034061609c.9d3f4c96-27e6-4bda-a7ba-474ba7a993f8" returned: 0 in 0.795s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cd34637b-ee14-4905-b9ad-042da2ae1b66 tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8091c7f9-2290-4baf-a9b9-a6034061609c.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:01 devstack sudo[105682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8091c7f9-2290-4baf-a9b9-a6034061609c.info Jul 07 08:36:01 devstack sudo[105682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:01 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-253a9b84-3445-4583-bd9c-cd7a4fb3fed8 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-1a92afa7-d444-4fcf-bdda-87460d4e418f" returned: 0 in 0.895s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:01 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-253a9b84-3445-4583-bd9c-cd7a4fb3fed8 tempest-ProjectMemberTests-117232865 None] Lock "cinder-quobyte-1a92afa7-d444-4fcf-bdda-87460d4e418f" released by "delete_volume" :: held 1.845s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:36:01 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-253a9b84-3445-4583-bd9c-cd7a4fb3fed8 tempest-ProjectMemberTests-117232865 None] Created reservations ['61c3c6a3-bbe1-48fb-b00d-cfa575c1dc9a', '46bfc8cb-c6a5-4912-ae1c-8de71d078da9', '0a192af1-05b5-427e-9e25-058058459897', '63c5bcca-f1b4-4303-9ef0-c6e5687363ee'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:36:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-253a9b84-3445-4583-bd9c-cd7a4fb3fed8 tempest-ProjectMemberTests-117232865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:36:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-253a9b84-3445-4583-bd9c-cd7a4fb3fed8 tempest-ProjectMemberTests-117232865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:36:01 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-253a9b84-3445-4583-bd9c-cd7a4fb3fed8 tempest-ProjectMemberTests-117232865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:36:01 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-253a9b84-3445-4583-bd9c-cd7a4fb3fed8 tempest-ProjectMemberTests-117232865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:36:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-253a9b84-3445-4583-bd9c-cd7a4fb3fed8 tempest-ProjectMemberTests-117232865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:36:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-253a9b84-3445-4583-bd9c-cd7a4fb3fed8 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:01 devstack sudo[105688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:36:01 devstack sudo[105688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:02 devstack sudo[105682]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cd34637b-ee14-4905-b9ad-042da2ae1b66 tempest-ProjectReaderTests-1685940573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8091c7f9-2290-4baf-a9b9-a6034061609c.info" returned: 0 in 0.895s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:02 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-cd34637b-ee14-4905-b9ad-042da2ae1b66 tempest-ProjectReaderTests-1685940573 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8091c7f9-2290-4baf-a9b9-a6034061609c.info is being set with open permissions: ugo+rw Jul 07 08:36:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cd34637b-ee14-4905-b9ad-042da2ae1b66 tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8091c7f9-2290-4baf-a9b9-a6034061609c.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:02 devstack sudo[105691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8091c7f9-2290-4baf-a9b9-a6034061609c.info Jul 07 08:36:02 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:02 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9e89000-59e5-410f-bdf6-4c5bc4306a63 tempest-ProjectMemberTests-117232865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:36:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b9e89000-59e5-410f-bdf6-4c5bc4306a63 tempest-ProjectMemberTests-117232865 None] Flow 'volume_create_manager' (aa514a5f-cdef-414b-a4d9-ac2b76b4d4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:36:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b9e89000-59e5-410f-bdf6-4c5bc4306a63 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40d98881-75de-48d5-a610-df5dded51b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:36:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b9e89000-59e5-410f-bdf6-4c5bc4306a63 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40d98881-75de-48d5-a610-df5dded51b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1312873584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eac72472-0c48-4c3e-8283-3c0057bea6ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac2688c9df5545018de78c47a9e5a401',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:36:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:36:03Z,use_quota=True,user_id='11de70d1cfa0463dbad27ce8dcab2b39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:36:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b9e89000-59e5-410f-bdf6-4c5bc4306a63 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a765e006-49aa-45c2-bfc2-31ea1f501ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:36:02 devstack sudo[105688]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b9e89000-59e5-410f-bdf6-4c5bc4306a63 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a765e006-49aa-45c2-bfc2-31ea1f501ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:36:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b9e89000-59e5-410f-bdf6-4c5bc4306a63 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ab5d63b-b616-4119-8af8-90734a89b477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:36:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b9e89000-59e5-410f-bdf6-4c5bc4306a63 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ab5d63b-b616-4119-8af8-90734a89b477) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eac72472-0c48-4c3e-8283-3c0057bea6ba', 'volume_name': 'volume-eac72472-0c48-4c3e-8283-3c0057bea6ba', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:36:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b9e89000-59e5-410f-bdf6-4c5bc4306a63 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb8596d1-8987-4c4f-87eb-23543419dbc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:36:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b9e89000-59e5-410f-bdf6-4c5bc4306a63 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb8596d1-8987-4c4f-87eb-23543419dbc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:36:02 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b9e89000-59e5-410f-bdf6-4c5bc4306a63 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90d4b10b-a27f-4fd5-a52f-fabfe90213e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:36:02 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-b9e89000-59e5-410f-bdf6-4c5bc4306a63 tempest-ProjectMemberTests-117232865 None] Volume eac72472-0c48-4c3e-8283-3c0057bea6ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eac72472-0c48-4c3e-8283-3c0057bea6ba', 'volume_size': 1} Jul 07 08:36:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b9e89000-59e5-410f-bdf6-4c5bc4306a63 tempest-ProjectMemberTests-117232865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:36:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-253a9b84-3445-4583-bd9c-cd7a4fb3fed8 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.941s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:02 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-253a9b84-3445-4583-bd9c-cd7a4fb3fed8 tempest-ProjectMemberTests-117232865 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:36:02 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-253a9b84-3445-4583-bd9c-cd7a4fb3fed8 tempest-ProjectMemberTests-117232865 None] Deleted volume successfully. Jul 07 08:36:02 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-253a9b84-3445-4583-bd9c-cd7a4fb3fed8 tempest-ProjectMemberTests-117232865 None] Lock "cinder-1a92afa7-d444-4fcf-bdda-87460d4e418f-delete_volume" released by "delete_volume" :: held 3.143s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:36:03 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-cd34637b-ee14-4905-b9ad-042da2ae1b66 tempest-ProjectReaderTests-1685940573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8091c7f9-2290-4baf-a9b9-a6034061609c.info" returned: 0 in 0.967s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-cd34637b-ee14-4905-b9ad-042da2ae1b66 tempest-ProjectReaderTests-1685940573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.427s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:36:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b9e89000-59e5-410f-bdf6-4c5bc4306a63 tempest-ProjectMemberTests-117232865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.324s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:36:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b9e89000-59e5-410f-bdf6-4c5bc4306a63 tempest-ProjectMemberTests-117232865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1312873584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eac72472-0c48-4c3e-8283-3c0057bea6ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac2688c9df5545018de78c47a9e5a401',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:36:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:36:03Z,use_quota=True,user_id='11de70d1cfa0463dbad27ce8dcab2b39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:36:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-b9e89000-59e5-410f-bdf6-4c5bc4306a63 tempest-ProjectMemberTests-117232865 None] Creating volume eac72472-0c48-4c3e-8283-3c0057bea6ba {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:36:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b9e89000-59e5-410f-bdf6-4c5bc4306a63 tempest-ProjectMemberTests-117232865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:36:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b9e89000-59e5-410f-bdf6-4c5bc4306a63 tempest-ProjectMemberTests-117232865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:36:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b9e89000-59e5-410f-bdf6-4c5bc4306a63 tempest-ProjectMemberTests-117232865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:36:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b9e89000-59e5-410f-bdf6-4c5bc4306a63 tempest-ProjectMemberTests-117232865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:36:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b9e89000-59e5-410f-bdf6-4c5bc4306a63 tempest-ProjectMemberTests-117232865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:36:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b9e89000-59e5-410f-bdf6-4c5bc4306a63 tempest-ProjectMemberTests-117232865 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:36:03 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-b9e89000-59e5-410f-bdf6-4c5bc4306a63 tempest-ProjectMemberTests-117232865 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:36:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b9e89000-59e5-410f-bdf6-4c5bc4306a63 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-eac72472-0c48-4c3e-8283-3c0057bea6ba 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:03 devstack sudo[105695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-eac72472-0c48-4c3e-8283-3c0057bea6ba 1073741824 Jul 07 08:36:03 devstack sudo[105695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:03 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-cd34637b-ee14-4905-b9ad-042da2ae1b66 tempest-ProjectReaderTests-1685940573 None] Create snapshot completed successfully Jul 07 08:36:03 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-002e9992-aec9-4b44-a370-6fd5decd83c0 tempest-ProjectReaderTests-1685940573 None] Acquiring lock "cinder-9d3f4c96-27e6-4bda-a7ba-474ba7a993f8-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:36:03 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-002e9992-aec9-4b44-a370-6fd5decd83c0 tempest-ProjectReaderTests-1685940573 None] Lock "cinder-9d3f4c96-27e6-4bda-a7ba-474ba7a993f8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:36:03 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-002e9992-aec9-4b44-a370-6fd5decd83c0 tempest-ProjectReaderTests-1685940573 None] Acquiring lock "cinder-quobyte-8091c7f9-2290-4baf-a9b9-a6034061609c" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:36:03 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-002e9992-aec9-4b44-a370-6fd5decd83c0 tempest-ProjectReaderTests-1685940573 None] Lock "cinder-quobyte-8091c7f9-2290-4baf-a9b9-a6034061609c" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:36:03 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-002e9992-aec9-4b44-a370-6fd5decd83c0 tempest-ProjectReaderTests-1685940573 None] Acquiring lock "cinder-quobyte-9d3f4c96-27e6-4bda-a7ba-474ba7a993f8" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:36:03 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-002e9992-aec9-4b44-a370-6fd5decd83c0 tempest-ProjectReaderTests-1685940573 None] Lock "cinder-quobyte-9d3f4c96-27e6-4bda-a7ba-474ba7a993f8" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:36:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-002e9992-aec9-4b44-a370-6fd5decd83c0 tempest-ProjectReaderTests-1685940573 None] Deleting offline snapshot 9d3f4c96-27e6-4bda-a7ba-474ba7a993f8 of volume 8091c7f9-2290-4baf-a9b9-a6034061609c {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:36:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-002e9992-aec9-4b44-a370-6fd5decd83c0 tempest-ProjectReaderTests-1685940573 None] snapshot_file for this snap is: volume-8091c7f9-2290-4baf-a9b9-a6034061609c.9d3f4c96-27e6-4bda-a7ba-474ba7a993f8 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:36:03 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7aefdf2-d7b1-48e8-a924-c736596d8d48]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:36:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-002e9992-aec9-4b44-a370-6fd5decd83c0 tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8091c7f9-2290-4baf-a9b9-a6034061609c.9d3f4c96-27e6-4bda-a7ba-474ba7a993f8 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:03 devstack sudo[105695]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b9e89000-59e5-410f-bdf6-4c5bc4306a63 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-eac72472-0c48-4c3e-8283-3c0057bea6ba 1073741824" returned: 0 in 0.956s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b9e89000-59e5-410f-bdf6-4c5bc4306a63 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-eac72472-0c48-4c3e-8283-3c0057bea6ba {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:04 devstack sudo[105702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-eac72472-0c48-4c3e-8283-3c0057bea6ba Jul 07 08:36:04 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:04 devstack sudo[105701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8091c7f9-2290-4baf-a9b9-a6034061609c.9d3f4c96-27e6-4bda-a7ba-474ba7a993f8 Jul 07 08:36:04 devstack sudo[105701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:04 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b9e89000-59e5-410f-bdf6-4c5bc4306a63 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-eac72472-0c48-4c3e-8283-3c0057bea6ba" returned: 0 in 0.673s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b9e89000-59e5-410f-bdf6-4c5bc4306a63 tempest-ProjectMemberTests-117232865 None] <== create_volume: return (1675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:36:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b9e89000-59e5-410f-bdf6-4c5bc4306a63 tempest-ProjectMemberTests-117232865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.678s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:36:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b9e89000-59e5-410f-bdf6-4c5bc4306a63 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90d4b10b-a27f-4fd5-a52f-fabfe90213e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eac72472-0c48-4c3e-8283-3c0057bea6ba', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:36:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b9e89000-59e5-410f-bdf6-4c5bc4306a63 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b68dd3e-e186-4e10-aa3b-1c7e18f424fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:36:04 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=140,cinder:INSERT=56,cinder:UPDATE=188,cinder:DELETE=20 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:36:04 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-b9e89000-59e5-410f-bdf6-4c5bc4306a63 tempest-ProjectMemberTests-117232865 None] Volume volume-eac72472-0c48-4c3e-8283-3c0057bea6ba (eac72472-0c48-4c3e-8283-3c0057bea6ba): created successfully Jul 07 08:36:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b9e89000-59e5-410f-bdf6-4c5bc4306a63 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b68dd3e-e186-4e10-aa3b-1c7e18f424fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:36:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-b9e89000-59e5-410f-bdf6-4c5bc4306a63 tempest-ProjectMemberTests-117232865 None] Flow 'volume_create_manager' (aa514a5f-cdef-414b-a4d9-ac2b76b4d4a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:36:04 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-b9e89000-59e5-410f-bdf6-4c5bc4306a63 tempest-ProjectMemberTests-117232865 None] Created volume successfully. Jul 07 08:36:04 devstack sudo[105701]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-002e9992-aec9-4b44-a370-6fd5decd83c0 tempest-ProjectReaderTests-1685940573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8091c7f9-2290-4baf-a9b9-a6034061609c.9d3f4c96-27e6-4bda-a7ba-474ba7a993f8" returned: 0 in 0.828s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:04 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-002e9992-aec9-4b44-a370-6fd5decd83c0 tempest-ProjectReaderTests-1685940573 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8091c7f9-2290-4baf-a9b9-a6034061609c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:36:04 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0de61d-04b7-4910-a5d2-5941798937a5]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:36:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-002e9992-aec9-4b44-a370-6fd5decd83c0 tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8091c7f9-2290-4baf-a9b9-a6034061609c {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:04 devstack sudo[105709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8091c7f9-2290-4baf-a9b9-a6034061609c Jul 07 08:36:04 devstack sudo[105709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:05 devstack sudo[105709]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-002e9992-aec9-4b44-a370-6fd5decd83c0 tempest-ProjectReaderTests-1685940573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8091c7f9-2290-4baf-a9b9-a6034061609c" returned: 0 in 0.779s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-002e9992-aec9-4b44-a370-6fd5decd83c0 tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8091c7f9-2290-4baf-a9b9-a6034061609c.9d3f4c96-27e6-4bda-a7ba-474ba7a993f8 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:05 devstack sudo[105714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8091c7f9-2290-4baf-a9b9-a6034061609c.9d3f4c96-27e6-4bda-a7ba-474ba7a993f8 Jul 07 08:36:05 devstack sudo[105714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:05 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:UPDATE=172,cinder:DELETE=11,cinder:SELECT=138,cinder:INSERT=45 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:36:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-956de371-1081-48c1-b75e-506f8345e163 tempest-ProjectMemberTests-117232865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:36:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-956de371-1081-48c1-b75e-506f8345e163 tempest-ProjectMemberTests-117232865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:36:05 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:36:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:36:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:36:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:36:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:36:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:36:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-956de371-1081-48c1-b75e-506f8345e163 tempest-ProjectMemberTests-117232865 None] Creating offline snapshot 22cd9553-5bd5-481d-8f93-ee45bd2dc849 of volume eac72472-0c48-4c3e-8283-3c0057bea6ba {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:36:05 devstack sudo[105716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:36:05 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:05 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[e331ed7f-a88a-48e7-8412-a127167bdfd1]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:36:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-956de371-1081-48c1-b75e-506f8345e163 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-eac72472-0c48-4c3e-8283-3c0057bea6ba {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:06 devstack sudo[105718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-eac72472-0c48-4c3e-8283-3c0057bea6ba Jul 07 08:36:06 devstack sudo[105718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:06 devstack sudo[105714]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-002e9992-aec9-4b44-a370-6fd5decd83c0 tempest-ProjectReaderTests-1685940573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8091c7f9-2290-4baf-a9b9-a6034061609c.9d3f4c96-27e6-4bda-a7ba-474ba7a993f8" returned: 0 in 0.846s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-002e9992-aec9-4b44-a370-6fd5decd83c0 tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8091c7f9-2290-4baf-a9b9-a6034061609c.9d3f4c96-27e6-4bda-a7ba-474ba7a993f8 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:06 devstack sudo[105723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8091c7f9-2290-4baf-a9b9-a6034061609c.9d3f4c96-27e6-4bda-a7ba-474ba7a993f8 Jul 07 08:36:06 devstack sudo[105723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:06 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.737s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:06 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:36:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running periodic task VolumeManager._thread_info {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:36:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] thread count: 29 {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 08:36:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] thread info: [<_MainThread(MainThread, started 133056092332160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 08:36:06 devstack sudo[105718]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-956de371-1081-48c1-b75e-506f8345e163 tempest-ProjectMemberTests-117232865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-eac72472-0c48-4c3e-8283-3c0057bea6ba" returned: 0 in 0.846s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-956de371-1081-48c1-b75e-506f8345e163 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-eac72472-0c48-4c3e-8283-3c0057bea6ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-eac72472-0c48-4c3e-8283-3c0057bea6ba.22cd9553-5bd5-481d-8f93-ee45bd2dc849 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:06 devstack sudo[105729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-eac72472-0c48-4c3e-8283-3c0057bea6ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-eac72472-0c48-4c3e-8283-3c0057bea6ba.22cd9553-5bd5-481d-8f93-ee45bd2dc849 1G Jul 07 08:36:06 devstack sudo[105729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:07 devstack sudo[105723]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-002e9992-aec9-4b44-a370-6fd5decd83c0 tempest-ProjectReaderTests-1685940573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8091c7f9-2290-4baf-a9b9-a6034061609c.9d3f4c96-27e6-4bda-a7ba-474ba7a993f8" returned: 0 in 0.785s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:07 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-002e9992-aec9-4b44-a370-6fd5decd83c0 tempest-ProjectReaderTests-1685940573 None] Lock "cinder-quobyte-9d3f4c96-27e6-4bda-a7ba-474ba7a993f8" released by "_delete_snapshot" :: held 3.349s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:36:07 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-002e9992-aec9-4b44-a370-6fd5decd83c0 tempest-ProjectReaderTests-1685940573 None] Lock "cinder-quobyte-8091c7f9-2290-4baf-a9b9-a6034061609c" released by "delete_snapshot" :: held 3.377s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:36:07 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-002e9992-aec9-4b44-a370-6fd5decd83c0 tempest-ProjectReaderTests-1685940573 None] Created reservations ['1589cd74-1612-4405-bb34-e0b19be4ea62', '6dd63583-3319-464c-985f-b036f2fc303e', 'fb229f63-0a61-46fd-b4ef-cbe97df52e23', '134e98a1-4f8e-447f-b940-e85db5c53408'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:36:07 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-002e9992-aec9-4b44-a370-6fd5decd83c0 tempest-ProjectReaderTests-1685940573 None] Delete snapshot completed successfully. Jul 07 08:36:07 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-002e9992-aec9-4b44-a370-6fd5decd83c0 tempest-ProjectReaderTests-1685940573 None] Lock "cinder-9d3f4c96-27e6-4bda-a7ba-474ba7a993f8-delete_snapshot" released by "delete_snapshot" :: held 3.534s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:36:07 devstack sudo[105729]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-956de371-1081-48c1-b75e-506f8345e163 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-eac72472-0c48-4c3e-8283-3c0057bea6ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-eac72472-0c48-4c3e-8283-3c0057bea6ba.22cd9553-5bd5-481d-8f93-ee45bd2dc849 1G" returned: 0 in 0.913s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-956de371-1081-48c1-b75e-506f8345e163 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eac72472-0c48-4c3e-8283-3c0057bea6ba -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-eac72472-0c48-4c3e-8283-3c0057bea6ba.22cd9553-5bd5-481d-8f93-ee45bd2dc849 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:07 devstack sudo[105736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eac72472-0c48-4c3e-8283-3c0057bea6ba -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-eac72472-0c48-4c3e-8283-3c0057bea6ba.22cd9553-5bd5-481d-8f93-ee45bd2dc849 Jul 07 08:36:07 devstack sudo[105736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:08 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0ea56917-6e64-406e-aeb0-6fc7dd9dbe63 tempest-ProjectReaderTests-1685940573 None] Acquiring lock "cinder-8091c7f9-2290-4baf-a9b9-a6034061609c-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:36:08 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0ea56917-6e64-406e-aeb0-6fc7dd9dbe63 tempest-ProjectReaderTests-1685940573 None] Lock "cinder-8091c7f9-2290-4baf-a9b9-a6034061609c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:36:08 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0ea56917-6e64-406e-aeb0-6fc7dd9dbe63 tempest-ProjectReaderTests-1685940573 None] Acquiring lock "cinder-quobyte-8091c7f9-2290-4baf-a9b9-a6034061609c" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:36:08 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0ea56917-6e64-406e-aeb0-6fc7dd9dbe63 tempest-ProjectReaderTests-1685940573 None] Lock "cinder-quobyte-8091c7f9-2290-4baf-a9b9-a6034061609c" acquired by "delete_volume" :: waited 0.016s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:36:08 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[9352a334-79f6-493f-8c4e-d270e3b97bf9]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:36:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0ea56917-6e64-406e-aeb0-6fc7dd9dbe63 tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8091c7f9-2290-4baf-a9b9-a6034061609c {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:08 devstack sudo[105741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8091c7f9-2290-4baf-a9b9-a6034061609c Jul 07 08:36:08 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:08 devstack sudo[105736]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-956de371-1081-48c1-b75e-506f8345e163 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eac72472-0c48-4c3e-8283-3c0057bea6ba -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-eac72472-0c48-4c3e-8283-3c0057bea6ba.22cd9553-5bd5-481d-8f93-ee45bd2dc849" returned: 0 in 0.698s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:08 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-956de371-1081-48c1-b75e-506f8345e163 tempest-ProjectMemberTests-117232865 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-eac72472-0c48-4c3e-8283-3c0057bea6ba.22cd9553-5bd5-481d-8f93-ee45bd2dc849 is being set with open permissions: ugo+rw Jul 07 08:36:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-956de371-1081-48c1-b75e-506f8345e163 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-eac72472-0c48-4c3e-8283-3c0057bea6ba.22cd9553-5bd5-481d-8f93-ee45bd2dc849 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:08 devstack sudo[105744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-eac72472-0c48-4c3e-8283-3c0057bea6ba.22cd9553-5bd5-481d-8f93-ee45bd2dc849 Jul 07 08:36:08 devstack sudo[105744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:09 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0ea56917-6e64-406e-aeb0-6fc7dd9dbe63 tempest-ProjectReaderTests-1685940573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8091c7f9-2290-4baf-a9b9-a6034061609c" returned: 0 in 0.827s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0ea56917-6e64-406e-aeb0-6fc7dd9dbe63 tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8091c7f9-2290-4baf-a9b9-a6034061609c {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:09 devstack sudo[105750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8091c7f9-2290-4baf-a9b9-a6034061609c Jul 07 08:36:09 devstack sudo[105750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:09 devstack sudo[105744]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-956de371-1081-48c1-b75e-506f8345e163 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-eac72472-0c48-4c3e-8283-3c0057bea6ba.22cd9553-5bd5-481d-8f93-ee45bd2dc849" returned: 0 in 0.750s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-956de371-1081-48c1-b75e-506f8345e163 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-eac72472-0c48-4c3e-8283-3c0057bea6ba.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:09 devstack sudo[105752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-eac72472-0c48-4c3e-8283-3c0057bea6ba.info Jul 07 08:36:09 devstack sudo[105752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:09 devstack sudo[105752]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:09 devstack sudo[105750]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0ea56917-6e64-406e-aeb0-6fc7dd9dbe63 tempest-ProjectReaderTests-1685940573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8091c7f9-2290-4baf-a9b9-a6034061609c" returned: 0 in 0.774s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-956de371-1081-48c1-b75e-506f8345e163 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-eac72472-0c48-4c3e-8283-3c0057bea6ba.info" returned: 0 in 0.691s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:09 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-956de371-1081-48c1-b75e-506f8345e163 tempest-ProjectMemberTests-117232865 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-eac72472-0c48-4c3e-8283-3c0057bea6ba.info is being set with open permissions: ugo+rw Jul 07 08:36:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-956de371-1081-48c1-b75e-506f8345e163 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-eac72472-0c48-4c3e-8283-3c0057bea6ba.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:09 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0ea56917-6e64-406e-aeb0-6fc7dd9dbe63 tempest-ProjectReaderTests-1685940573 None] Lock "cinder-quobyte-8091c7f9-2290-4baf-a9b9-a6034061609c" released by "delete_volume" :: held 1.680s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:36:09 devstack sudo[105756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-eac72472-0c48-4c3e-8283-3c0057bea6ba.info Jul 07 08:36:09 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:09 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-0ea56917-6e64-406e-aeb0-6fc7dd9dbe63 tempest-ProjectReaderTests-1685940573 None] Created reservations ['16e4ec74-dfba-41e5-8c08-71dd4e07e4d7', 'a84cc28a-39e4-4ba6-a061-11f11ddf7931', '25bed492-8a50-4af7-ae21-c6e750d90a0e', 'a4f36f7f-45a7-486e-b241-b5117d9d1291'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:36:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0ea56917-6e64-406e-aeb0-6fc7dd9dbe63 tempest-ProjectReaderTests-1685940573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:36:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0ea56917-6e64-406e-aeb0-6fc7dd9dbe63 tempest-ProjectReaderTests-1685940573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:36:10 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-0ea56917-6e64-406e-aeb0-6fc7dd9dbe63 tempest-ProjectReaderTests-1685940573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:36:10 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-0ea56917-6e64-406e-aeb0-6fc7dd9dbe63 tempest-ProjectReaderTests-1685940573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:36:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-0ea56917-6e64-406e-aeb0-6fc7dd9dbe63 tempest-ProjectReaderTests-1685940573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:36:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0ea56917-6e64-406e-aeb0-6fc7dd9dbe63 tempest-ProjectReaderTests-1685940573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:10 devstack sudo[105758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:36:10 devstack sudo[105758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:10 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-956de371-1081-48c1-b75e-506f8345e163 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-eac72472-0c48-4c3e-8283-3c0057bea6ba.info" returned: 0 in 0.846s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-956de371-1081-48c1-b75e-506f8345e163 tempest-ProjectMemberTests-117232865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.874s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:36:10 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-956de371-1081-48c1-b75e-506f8345e163 tempest-ProjectMemberTests-117232865 None] Create snapshot completed successfully Jul 07 08:36:10 devstack sudo[105758]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-0ea56917-6e64-406e-aeb0-6fc7dd9dbe63 tempest-ProjectReaderTests-1685940573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.811s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:10 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-0ea56917-6e64-406e-aeb0-6fc7dd9dbe63 tempest-ProjectReaderTests-1685940573 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:36:10 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-0ea56917-6e64-406e-aeb0-6fc7dd9dbe63 tempest-ProjectReaderTests-1685940573 None] Deleted volume successfully. Jul 07 08:36:10 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-0ea56917-6e64-406e-aeb0-6fc7dd9dbe63 tempest-ProjectReaderTests-1685940573 None] Lock "cinder-8091c7f9-2290-4baf-a9b9-a6034061609c-delete_volume" released by "delete_volume" :: held 2.748s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:36:11 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-93eaca7f-2c63-4422-b195-722a63e93fd6 tempest-ProjectMemberTests-117232865 None] Acquiring lock "cinder-22cd9553-5bd5-481d-8f93-ee45bd2dc849-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:36:11 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-93eaca7f-2c63-4422-b195-722a63e93fd6 tempest-ProjectMemberTests-117232865 None] Lock "cinder-22cd9553-5bd5-481d-8f93-ee45bd2dc849-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:36:11 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-93eaca7f-2c63-4422-b195-722a63e93fd6 tempest-ProjectMemberTests-117232865 None] Acquiring lock "cinder-quobyte-eac72472-0c48-4c3e-8283-3c0057bea6ba" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:36:11 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-93eaca7f-2c63-4422-b195-722a63e93fd6 tempest-ProjectMemberTests-117232865 None] Lock "cinder-quobyte-eac72472-0c48-4c3e-8283-3c0057bea6ba" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:36:11 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-93eaca7f-2c63-4422-b195-722a63e93fd6 tempest-ProjectMemberTests-117232865 None] Acquiring lock "cinder-quobyte-22cd9553-5bd5-481d-8f93-ee45bd2dc849" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:36:11 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-93eaca7f-2c63-4422-b195-722a63e93fd6 tempest-ProjectMemberTests-117232865 None] Lock "cinder-quobyte-22cd9553-5bd5-481d-8f93-ee45bd2dc849" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:36:11 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-93eaca7f-2c63-4422-b195-722a63e93fd6 tempest-ProjectMemberTests-117232865 None] Deleting offline snapshot 22cd9553-5bd5-481d-8f93-ee45bd2dc849 of volume eac72472-0c48-4c3e-8283-3c0057bea6ba {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:36:11 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-93eaca7f-2c63-4422-b195-722a63e93fd6 tempest-ProjectMemberTests-117232865 None] snapshot_file for this snap is: volume-eac72472-0c48-4c3e-8283-3c0057bea6ba.22cd9553-5bd5-481d-8f93-ee45bd2dc849 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:36:11 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2fbc447-e82b-43eb-9e88-b8791a1bcde8]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:36:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-93eaca7f-2c63-4422-b195-722a63e93fd6 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-eac72472-0c48-4c3e-8283-3c0057bea6ba.22cd9553-5bd5-481d-8f93-ee45bd2dc849 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:11 devstack sudo[105762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-eac72472-0c48-4c3e-8283-3c0057bea6ba.22cd9553-5bd5-481d-8f93-ee45bd2dc849 Jul 07 08:36:11 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:12 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-93eaca7f-2c63-4422-b195-722a63e93fd6 tempest-ProjectMemberTests-117232865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-eac72472-0c48-4c3e-8283-3c0057bea6ba.22cd9553-5bd5-481d-8f93-ee45bd2dc849" returned: 0 in 0.879s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:12 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-93eaca7f-2c63-4422-b195-722a63e93fd6 tempest-ProjectMemberTests-117232865 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eac72472-0c48-4c3e-8283-3c0057bea6ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:36:12 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e23325d-c445-4e91-b0d1-fca94aaff396]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:36:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-93eaca7f-2c63-4422-b195-722a63e93fd6 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-eac72472-0c48-4c3e-8283-3c0057bea6ba {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:12 devstack sudo[105768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-eac72472-0c48-4c3e-8283-3c0057bea6ba Jul 07 08:36:12 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:13 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-93eaca7f-2c63-4422-b195-722a63e93fd6 tempest-ProjectMemberTests-117232865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-eac72472-0c48-4c3e-8283-3c0057bea6ba" returned: 0 in 0.894s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-93eaca7f-2c63-4422-b195-722a63e93fd6 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-eac72472-0c48-4c3e-8283-3c0057bea6ba.22cd9553-5bd5-481d-8f93-ee45bd2dc849 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:13 devstack sudo[105773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-eac72472-0c48-4c3e-8283-3c0057bea6ba.22cd9553-5bd5-481d-8f93-ee45bd2dc849 Jul 07 08:36:13 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:13 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-93eaca7f-2c63-4422-b195-722a63e93fd6 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-eac72472-0c48-4c3e-8283-3c0057bea6ba.22cd9553-5bd5-481d-8f93-ee45bd2dc849" returned: 0 in 0.841s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-93eaca7f-2c63-4422-b195-722a63e93fd6 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-eac72472-0c48-4c3e-8283-3c0057bea6ba.22cd9553-5bd5-481d-8f93-ee45bd2dc849 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:13 devstack sudo[105778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-eac72472-0c48-4c3e-8283-3c0057bea6ba.22cd9553-5bd5-481d-8f93-ee45bd2dc849 Jul 07 08:36:13 devstack sudo[105778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:14 devstack sudo[105778]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-93eaca7f-2c63-4422-b195-722a63e93fd6 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-eac72472-0c48-4c3e-8283-3c0057bea6ba.22cd9553-5bd5-481d-8f93-ee45bd2dc849" returned: 0 in 0.676s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:14 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-93eaca7f-2c63-4422-b195-722a63e93fd6 tempest-ProjectMemberTests-117232865 None] Lock "cinder-quobyte-22cd9553-5bd5-481d-8f93-ee45bd2dc849" released by "_delete_snapshot" :: held 3.438s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:36:14 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-93eaca7f-2c63-4422-b195-722a63e93fd6 tempest-ProjectMemberTests-117232865 None] Lock "cinder-quobyte-eac72472-0c48-4c3e-8283-3c0057bea6ba" released by "delete_snapshot" :: held 3.467s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:36:14 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-93eaca7f-2c63-4422-b195-722a63e93fd6 tempest-ProjectMemberTests-117232865 None] Created reservations ['740e0cbc-0cab-4377-9c08-e2c42bb0574b', '5128c36a-34f5-4528-9dd0-0cbdf4554c03', '9b414dd0-8f08-4e26-88f2-706b7d239dbf', '4dd3352d-427f-4400-9942-4fb508f5cdff'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:36:14 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-93eaca7f-2c63-4422-b195-722a63e93fd6 tempest-ProjectMemberTests-117232865 None] Delete snapshot completed successfully. Jul 07 08:36:14 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-93eaca7f-2c63-4422-b195-722a63e93fd6 tempest-ProjectMemberTests-117232865 None] Lock "cinder-22cd9553-5bd5-481d-8f93-ee45bd2dc849-delete_snapshot" released by "delete_snapshot" :: held 3.652s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:36:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8aa040ba-62e7-49e5-b2d3-4a183662c4a6 tempest-ProjectMemberTests-117232865 None] Acquiring lock "cinder-eac72472-0c48-4c3e-8283-3c0057bea6ba-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:36:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8aa040ba-62e7-49e5-b2d3-4a183662c4a6 tempest-ProjectMemberTests-117232865 None] Lock "cinder-eac72472-0c48-4c3e-8283-3c0057bea6ba-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:36:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8aa040ba-62e7-49e5-b2d3-4a183662c4a6 tempest-ProjectMemberTests-117232865 None] Acquiring lock "cinder-quobyte-eac72472-0c48-4c3e-8283-3c0057bea6ba" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:36:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8aa040ba-62e7-49e5-b2d3-4a183662c4a6 tempest-ProjectMemberTests-117232865 None] Lock "cinder-quobyte-eac72472-0c48-4c3e-8283-3c0057bea6ba" acquired by "delete_volume" :: waited 0.020s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:36:15 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08d08e7-d8e3-4a9e-8e29-d768886e8856]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:36:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8aa040ba-62e7-49e5-b2d3-4a183662c4a6 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-eac72472-0c48-4c3e-8283-3c0057bea6ba {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:15 devstack sudo[105781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-eac72472-0c48-4c3e-8283-3c0057bea6ba Jul 07 08:36:15 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:16 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8aa040ba-62e7-49e5-b2d3-4a183662c4a6 tempest-ProjectMemberTests-117232865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-eac72472-0c48-4c3e-8283-3c0057bea6ba" returned: 0 in 0.798s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8aa040ba-62e7-49e5-b2d3-4a183662c4a6 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-eac72472-0c48-4c3e-8283-3c0057bea6ba {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:16 devstack sudo[105786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-eac72472-0c48-4c3e-8283-3c0057bea6ba Jul 07 08:36:16 devstack sudo[105786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:17 devstack sudo[105786]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8aa040ba-62e7-49e5-b2d3-4a183662c4a6 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-eac72472-0c48-4c3e-8283-3c0057bea6ba" returned: 0 in 0.826s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:17 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8aa040ba-62e7-49e5-b2d3-4a183662c4a6 tempest-ProjectMemberTests-117232865 None] Lock "cinder-quobyte-eac72472-0c48-4c3e-8283-3c0057bea6ba" released by "delete_volume" :: held 1.690s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:36:17 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-8aa040ba-62e7-49e5-b2d3-4a183662c4a6 tempest-ProjectMemberTests-117232865 None] Created reservations ['1777ecab-92d6-4b92-a240-e26caf066ef8', '90e7b155-616e-47b5-b60a-89bf0758588a', '9a431443-d5e2-4bc1-988c-658eca596b65', '8decbf40-2613-4394-80a6-e3a1cf83590d'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:36:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8aa040ba-62e7-49e5-b2d3-4a183662c4a6 tempest-ProjectMemberTests-117232865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:36:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8aa040ba-62e7-49e5-b2d3-4a183662c4a6 tempest-ProjectMemberTests-117232865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:36:17 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8aa040ba-62e7-49e5-b2d3-4a183662c4a6 tempest-ProjectMemberTests-117232865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:36:17 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8aa040ba-62e7-49e5-b2d3-4a183662c4a6 tempest-ProjectMemberTests-117232865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:36:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8aa040ba-62e7-49e5-b2d3-4a183662c4a6 tempest-ProjectMemberTests-117232865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:36:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8aa040ba-62e7-49e5-b2d3-4a183662c4a6 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:17 devstack sudo[105789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:36:17 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:18 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8aa040ba-62e7-49e5-b2d3-4a183662c4a6 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.803s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:18 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-8aa040ba-62e7-49e5-b2d3-4a183662c4a6 tempest-ProjectMemberTests-117232865 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:36:18 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-8aa040ba-62e7-49e5-b2d3-4a183662c4a6 tempest-ProjectMemberTests-117232865 None] Deleted volume successfully. Jul 07 08:36:18 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-8aa040ba-62e7-49e5-b2d3-4a183662c4a6 tempest-ProjectMemberTests-117232865 None] Lock "cinder-eac72472-0c48-4c3e-8283-3c0057bea6ba-delete_volume" released by "delete_volume" :: held 2.797s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:36:18 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-980e83a9-2e03-445a-8cab-aeb9ef7d5f5e tempest-ProjectMemberTests-117232865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:36:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-980e83a9-2e03-445a-8cab-aeb9ef7d5f5e tempest-ProjectMemberTests-117232865 None] Flow 'volume_create_manager' (f4ed432d-20d7-4964-9f4f-7c3f5f9e1afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:36:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-980e83a9-2e03-445a-8cab-aeb9ef7d5f5e tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ebf0019-32d8-44e4-86ae-6c59f052617a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:36:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-980e83a9-2e03-445a-8cab-aeb9ef7d5f5e tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ebf0019-32d8-44e4-86ae-6c59f052617a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2057045221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07d1519f-a696-4d9e-812a-10fb614c00f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac2688c9df5545018de78c47a9e5a401',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:36:18Z,use_quota=True,user_id='11de70d1cfa0463dbad27ce8dcab2b39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:36:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-980e83a9-2e03-445a-8cab-aeb9ef7d5f5e tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5874f7f-e7bf-437d-9efb-84c88678e3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:36:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-980e83a9-2e03-445a-8cab-aeb9ef7d5f5e tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5874f7f-e7bf-437d-9efb-84c88678e3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:36:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-980e83a9-2e03-445a-8cab-aeb9ef7d5f5e tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30a6e619-b8d7-426f-96ab-a358245697ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:36:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-980e83a9-2e03-445a-8cab-aeb9ef7d5f5e tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30a6e619-b8d7-426f-96ab-a358245697ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07d1519f-a696-4d9e-812a-10fb614c00f9', 'volume_name': 'volume-07d1519f-a696-4d9e-812a-10fb614c00f9', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:36:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-980e83a9-2e03-445a-8cab-aeb9ef7d5f5e tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a546ad23-3674-4fe5-9d69-c4b548772236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:36:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-980e83a9-2e03-445a-8cab-aeb9ef7d5f5e tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a546ad23-3674-4fe5-9d69-c4b548772236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:36:18 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-980e83a9-2e03-445a-8cab-aeb9ef7d5f5e tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef3a5676-03bd-44dc-a33c-34a836cbd844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:36:18 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-980e83a9-2e03-445a-8cab-aeb9ef7d5f5e tempest-ProjectMemberTests-117232865 None] Volume 07d1519f-a696-4d9e-812a-10fb614c00f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07d1519f-a696-4d9e-812a-10fb614c00f9', 'volume_size': 1} Jul 07 08:36:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-980e83a9-2e03-445a-8cab-aeb9ef7d5f5e tempest-ProjectMemberTests-117232865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:36:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-980e83a9-2e03-445a-8cab-aeb9ef7d5f5e tempest-ProjectMemberTests-117232865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:36:18 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-980e83a9-2e03-445a-8cab-aeb9ef7d5f5e tempest-ProjectMemberTests-117232865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2057045221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07d1519f-a696-4d9e-812a-10fb614c00f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac2688c9df5545018de78c47a9e5a401',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:36:18Z,use_quota=True,user_id='11de70d1cfa0463dbad27ce8dcab2b39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:36:18 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-980e83a9-2e03-445a-8cab-aeb9ef7d5f5e tempest-ProjectMemberTests-117232865 None] Creating volume 07d1519f-a696-4d9e-812a-10fb614c00f9 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:36:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-980e83a9-2e03-445a-8cab-aeb9ef7d5f5e tempest-ProjectMemberTests-117232865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:36:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-980e83a9-2e03-445a-8cab-aeb9ef7d5f5e tempest-ProjectMemberTests-117232865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:36:18 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-980e83a9-2e03-445a-8cab-aeb9ef7d5f5e tempest-ProjectMemberTests-117232865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:36:18 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-980e83a9-2e03-445a-8cab-aeb9ef7d5f5e tempest-ProjectMemberTests-117232865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:36:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-980e83a9-2e03-445a-8cab-aeb9ef7d5f5e tempest-ProjectMemberTests-117232865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:36:18 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-980e83a9-2e03-445a-8cab-aeb9ef7d5f5e tempest-ProjectMemberTests-117232865 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:36:18 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-980e83a9-2e03-445a-8cab-aeb9ef7d5f5e tempest-ProjectMemberTests-117232865 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:36:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-980e83a9-2e03-445a-8cab-aeb9ef7d5f5e tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07d1519f-a696-4d9e-812a-10fb614c00f9 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:18 devstack sudo[105792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07d1519f-a696-4d9e-812a-10fb614c00f9 1073741824 Jul 07 08:36:18 devstack sudo[105792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:19 devstack sudo[105792]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-980e83a9-2e03-445a-8cab-aeb9ef7d5f5e tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07d1519f-a696-4d9e-812a-10fb614c00f9 1073741824" returned: 0 in 1.040s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-980e83a9-2e03-445a-8cab-aeb9ef7d5f5e tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07d1519f-a696-4d9e-812a-10fb614c00f9 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:19 devstack sudo[105798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07d1519f-a696-4d9e-812a-10fb614c00f9 Jul 07 08:36:19 devstack sudo[105798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:20 devstack sudo[105798]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-980e83a9-2e03-445a-8cab-aeb9ef7d5f5e tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07d1519f-a696-4d9e-812a-10fb614c00f9" returned: 0 in 0.738s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:20 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-980e83a9-2e03-445a-8cab-aeb9ef7d5f5e tempest-ProjectMemberTests-117232865 None] <== create_volume: return (1849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:36:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-980e83a9-2e03-445a-8cab-aeb9ef7d5f5e tempest-ProjectMemberTests-117232865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.854s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:36:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-980e83a9-2e03-445a-8cab-aeb9ef7d5f5e tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef3a5676-03bd-44dc-a33c-34a836cbd844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07d1519f-a696-4d9e-812a-10fb614c00f9', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:36:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-980e83a9-2e03-445a-8cab-aeb9ef7d5f5e tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f7565ad-be9e-4879-a7c7-1eafe614ac9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:36:20 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-980e83a9-2e03-445a-8cab-aeb9ef7d5f5e tempest-ProjectMemberTests-117232865 None] Volume volume-07d1519f-a696-4d9e-812a-10fb614c00f9 (07d1519f-a696-4d9e-812a-10fb614c00f9): created successfully Jul 07 08:36:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-980e83a9-2e03-445a-8cab-aeb9ef7d5f5e tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f7565ad-be9e-4879-a7c7-1eafe614ac9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:36:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-980e83a9-2e03-445a-8cab-aeb9ef7d5f5e tempest-ProjectMemberTests-117232865 None] Flow 'volume_create_manager' (f4ed432d-20d7-4964-9f4f-7c3f5f9e1afd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:36:20 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-980e83a9-2e03-445a-8cab-aeb9ef7d5f5e tempest-ProjectMemberTests-117232865 None] Created volume successfully. Jul 07 08:36:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca04788a-2c39-4969-bf75-65a0d4801777 tempest-ProjectMemberTests-117232865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:36:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca04788a-2c39-4969-bf75-65a0d4801777 tempest-ProjectMemberTests-117232865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:36:21 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-ca04788a-2c39-4969-bf75-65a0d4801777 tempest-ProjectMemberTests-117232865 None] Creating offline snapshot 0351f99f-fcb8-4684-ba45-bbc86feee710 of volume 07d1519f-a696-4d9e-812a-10fb614c00f9 {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:36:21 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[3961cc5f-dccb-4f0e-8c42-66a30064b60f]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:36:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca04788a-2c39-4969-bf75-65a0d4801777 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07d1519f-a696-4d9e-812a-10fb614c00f9 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:21 devstack sudo[105802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07d1519f-a696-4d9e-812a-10fb614c00f9 Jul 07 08:36:21 devstack sudo[105802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:22 devstack sudo[105802]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca04788a-2c39-4969-bf75-65a0d4801777 tempest-ProjectMemberTests-117232865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07d1519f-a696-4d9e-812a-10fb614c00f9" returned: 0 in 0.793s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca04788a-2c39-4969-bf75-65a0d4801777 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07d1519f-a696-4d9e-812a-10fb614c00f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07d1519f-a696-4d9e-812a-10fb614c00f9.0351f99f-fcb8-4684-ba45-bbc86feee710 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:22 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07d1519f-a696-4d9e-812a-10fb614c00f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07d1519f-a696-4d9e-812a-10fb614c00f9.0351f99f-fcb8-4684-ba45-bbc86feee710 1G Jul 07 08:36:22 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:22 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-77f6f0ed-3c4a-4934-98ee-b0cb05a85cf8 tempest-ProjectReaderTests-940530395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:36:22 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-77f6f0ed-3c4a-4934-98ee-b0cb05a85cf8 tempest-ProjectReaderTests-940530395 None] Flow 'volume_create_manager' (30e0106c-e41a-4f36-bb00-de9983ff2132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:36:22 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-77f6f0ed-3c4a-4934-98ee-b0cb05a85cf8 tempest-ProjectReaderTests-940530395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db7e44ed-71da-40f2-b87e-4655e2fd8a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:36:22 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-77f6f0ed-3c4a-4934-98ee-b0cb05a85cf8 tempest-ProjectReaderTests-940530395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db7e44ed-71da-40f2-b87e-4655e2fd8a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1003723820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92a5685f-cf05-49c0-aa36-1947d7701a89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ec2b488495a4a16bc2f6927ceda29b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:36:23Z,use_quota=True,user_id='1c9e4d863b304990aa78bebc24f8f45e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:36:22 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-77f6f0ed-3c4a-4934-98ee-b0cb05a85cf8 tempest-ProjectReaderTests-940530395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63a8f024-9ec2-42ba-b7ce-2ca0604443f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:36:22 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-77f6f0ed-3c4a-4934-98ee-b0cb05a85cf8 tempest-ProjectReaderTests-940530395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63a8f024-9ec2-42ba-b7ce-2ca0604443f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:36:22 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-77f6f0ed-3c4a-4934-98ee-b0cb05a85cf8 tempest-ProjectReaderTests-940530395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (566454d8-243c-4531-a231-4913da03f67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:36:22 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-77f6f0ed-3c4a-4934-98ee-b0cb05a85cf8 tempest-ProjectReaderTests-940530395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (566454d8-243c-4531-a231-4913da03f67d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92a5685f-cf05-49c0-aa36-1947d7701a89', 'volume_name': 'volume-92a5685f-cf05-49c0-aa36-1947d7701a89', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:36:22 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-77f6f0ed-3c4a-4934-98ee-b0cb05a85cf8 tempest-ProjectReaderTests-940530395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4a41a88-e1b5-4f7f-9c03-8d3239d6c359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:36:22 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-77f6f0ed-3c4a-4934-98ee-b0cb05a85cf8 tempest-ProjectReaderTests-940530395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4a41a88-e1b5-4f7f-9c03-8d3239d6c359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:36:22 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-77f6f0ed-3c4a-4934-98ee-b0cb05a85cf8 tempest-ProjectReaderTests-940530395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8df2620d-15a0-4efa-b294-007203a4fcd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:36:22 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-77f6f0ed-3c4a-4934-98ee-b0cb05a85cf8 tempest-ProjectReaderTests-940530395 None] Volume 92a5685f-cf05-49c0-aa36-1947d7701a89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92a5685f-cf05-49c0-aa36-1947d7701a89', 'volume_size': 1} Jul 07 08:36:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-77f6f0ed-3c4a-4934-98ee-b0cb05a85cf8 tempest-ProjectReaderTests-940530395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:36:23 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca04788a-2c39-4969-bf75-65a0d4801777 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07d1519f-a696-4d9e-812a-10fb614c00f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07d1519f-a696-4d9e-812a-10fb614c00f9.0351f99f-fcb8-4684-ba45-bbc86feee710 1G" returned: 0 in 0.809s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca04788a-2c39-4969-bf75-65a0d4801777 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07d1519f-a696-4d9e-812a-10fb614c00f9 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07d1519f-a696-4d9e-812a-10fb614c00f9.0351f99f-fcb8-4684-ba45-bbc86feee710 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:23 devstack sudo[105812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07d1519f-a696-4d9e-812a-10fb614c00f9 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07d1519f-a696-4d9e-812a-10fb614c00f9.0351f99f-fcb8-4684-ba45-bbc86feee710 Jul 07 08:36:23 devstack sudo[105812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:23 devstack sudo[105812]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca04788a-2c39-4969-bf75-65a0d4801777 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07d1519f-a696-4d9e-812a-10fb614c00f9 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07d1519f-a696-4d9e-812a-10fb614c00f9.0351f99f-fcb8-4684-ba45-bbc86feee710" returned: 0 in 0.679s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:23 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-ca04788a-2c39-4969-bf75-65a0d4801777 tempest-ProjectMemberTests-117232865 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07d1519f-a696-4d9e-812a-10fb614c00f9.0351f99f-fcb8-4684-ba45-bbc86feee710 is being set with open permissions: ugo+rw Jul 07 08:36:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca04788a-2c39-4969-bf75-65a0d4801777 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07d1519f-a696-4d9e-812a-10fb614c00f9.0351f99f-fcb8-4684-ba45-bbc86feee710 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:23 devstack sudo[105817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07d1519f-a696-4d9e-812a-10fb614c00f9.0351f99f-fcb8-4684-ba45-bbc86feee710 Jul 07 08:36:23 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:24 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca04788a-2c39-4969-bf75-65a0d4801777 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07d1519f-a696-4d9e-812a-10fb614c00f9.0351f99f-fcb8-4684-ba45-bbc86feee710" returned: 0 in 0.667s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca04788a-2c39-4969-bf75-65a0d4801777 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07d1519f-a696-4d9e-812a-10fb614c00f9.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:24 devstack sudo[105820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07d1519f-a696-4d9e-812a-10fb614c00f9.info Jul 07 08:36:24 devstack sudo[105820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:25 devstack sudo[105820]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca04788a-2c39-4969-bf75-65a0d4801777 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07d1519f-a696-4d9e-812a-10fb614c00f9.info" returned: 0 in 0.674s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:25 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-ca04788a-2c39-4969-bf75-65a0d4801777 tempest-ProjectMemberTests-117232865 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07d1519f-a696-4d9e-812a-10fb614c00f9.info is being set with open permissions: ugo+rw Jul 07 08:36:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca04788a-2c39-4969-bf75-65a0d4801777 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07d1519f-a696-4d9e-812a-10fb614c00f9.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:25 devstack sudo[105823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07d1519f-a696-4d9e-812a-10fb614c00f9.info Jul 07 08:36:25 devstack sudo[105823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:25 devstack sudo[105823]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ca04788a-2c39-4969-bf75-65a0d4801777 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07d1519f-a696-4d9e-812a-10fb614c00f9.info" returned: 0 in 0.646s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ca04788a-2c39-4969-bf75-65a0d4801777 tempest-ProjectMemberTests-117232865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.350s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:36:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-77f6f0ed-3c4a-4934-98ee-b0cb05a85cf8 tempest-ProjectReaderTests-940530395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.085s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:36:25 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-77f6f0ed-3c4a-4934-98ee-b0cb05a85cf8 tempest-ProjectReaderTests-940530395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1003723820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92a5685f-cf05-49c0-aa36-1947d7701a89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ec2b488495a4a16bc2f6927ceda29b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:36:23Z,use_quota=True,user_id='1c9e4d863b304990aa78bebc24f8f45e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:36:25 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-77f6f0ed-3c4a-4934-98ee-b0cb05a85cf8 tempest-ProjectReaderTests-940530395 None] Creating volume 92a5685f-cf05-49c0-aa36-1947d7701a89 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:36:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-77f6f0ed-3c4a-4934-98ee-b0cb05a85cf8 tempest-ProjectReaderTests-940530395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:36:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-77f6f0ed-3c4a-4934-98ee-b0cb05a85cf8 tempest-ProjectReaderTests-940530395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:36:25 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-77f6f0ed-3c4a-4934-98ee-b0cb05a85cf8 tempest-ProjectReaderTests-940530395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:36:25 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-77f6f0ed-3c4a-4934-98ee-b0cb05a85cf8 tempest-ProjectReaderTests-940530395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:36:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-77f6f0ed-3c4a-4934-98ee-b0cb05a85cf8 tempest-ProjectReaderTests-940530395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:36:25 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-77f6f0ed-3c4a-4934-98ee-b0cb05a85cf8 tempest-ProjectReaderTests-940530395 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:36:25 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-77f6f0ed-3c4a-4934-98ee-b0cb05a85cf8 tempest-ProjectReaderTests-940530395 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:36:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-77f6f0ed-3c4a-4934-98ee-b0cb05a85cf8 tempest-ProjectReaderTests-940530395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-92a5685f-cf05-49c0-aa36-1947d7701a89 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:25 devstack sudo[105826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-92a5685f-cf05-49c0-aa36-1947d7701a89 1073741824 Jul 07 08:36:25 devstack sudo[105826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:25 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-ca04788a-2c39-4969-bf75-65a0d4801777 tempest-ProjectMemberTests-117232865 None] Create snapshot completed successfully Jul 07 08:36:26 devstack sudo[105826]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-77f6f0ed-3c4a-4934-98ee-b0cb05a85cf8 tempest-ProjectReaderTests-940530395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-92a5685f-cf05-49c0-aa36-1947d7701a89 1073741824" returned: 0 in 0.795s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-77f6f0ed-3c4a-4934-98ee-b0cb05a85cf8 tempest-ProjectReaderTests-940530395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-92a5685f-cf05-49c0-aa36-1947d7701a89 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:26 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-92a5685f-cf05-49c0-aa36-1947d7701a89 Jul 07 08:36:26 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:26 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4222b1fb-6c38-4a0f-9318-f0721ab6bfad tempest-ProjectMemberTests-117232865 None] Acquiring lock "cinder-0351f99f-fcb8-4684-ba45-bbc86feee710-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:36:26 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4222b1fb-6c38-4a0f-9318-f0721ab6bfad tempest-ProjectMemberTests-117232865 None] Lock "cinder-0351f99f-fcb8-4684-ba45-bbc86feee710-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:36:26 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4222b1fb-6c38-4a0f-9318-f0721ab6bfad tempest-ProjectMemberTests-117232865 None] Acquiring lock "cinder-quobyte-07d1519f-a696-4d9e-812a-10fb614c00f9" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:36:26 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4222b1fb-6c38-4a0f-9318-f0721ab6bfad tempest-ProjectMemberTests-117232865 None] Lock "cinder-quobyte-07d1519f-a696-4d9e-812a-10fb614c00f9" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:36:26 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4222b1fb-6c38-4a0f-9318-f0721ab6bfad tempest-ProjectMemberTests-117232865 None] Acquiring lock "cinder-quobyte-0351f99f-fcb8-4684-ba45-bbc86feee710" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:36:26 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4222b1fb-6c38-4a0f-9318-f0721ab6bfad tempest-ProjectMemberTests-117232865 None] Lock "cinder-quobyte-0351f99f-fcb8-4684-ba45-bbc86feee710" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:36:26 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-4222b1fb-6c38-4a0f-9318-f0721ab6bfad tempest-ProjectMemberTests-117232865 None] Deleting offline snapshot 0351f99f-fcb8-4684-ba45-bbc86feee710 of volume 07d1519f-a696-4d9e-812a-10fb614c00f9 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:36:26 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-4222b1fb-6c38-4a0f-9318-f0721ab6bfad tempest-ProjectMemberTests-117232865 None] snapshot_file for this snap is: volume-07d1519f-a696-4d9e-812a-10fb614c00f9.0351f99f-fcb8-4684-ba45-bbc86feee710 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:36:26 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36c626d-2da7-4fad-b43c-b713508d9289]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:36:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4222b1fb-6c38-4a0f-9318-f0721ab6bfad tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07d1519f-a696-4d9e-812a-10fb614c00f9.0351f99f-fcb8-4684-ba45-bbc86feee710 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:27 devstack sudo[105833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07d1519f-a696-4d9e-812a-10fb614c00f9.0351f99f-fcb8-4684-ba45-bbc86feee710 Jul 07 08:36:27 devstack sudo[105833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:27 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-77f6f0ed-3c4a-4934-98ee-b0cb05a85cf8 tempest-ProjectReaderTests-940530395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-92a5685f-cf05-49c0-aa36-1947d7701a89" returned: 0 in 0.644s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:27 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-77f6f0ed-3c4a-4934-98ee-b0cb05a85cf8 tempest-ProjectReaderTests-940530395 None] <== create_volume: return (1479ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:36:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-77f6f0ed-3c4a-4934-98ee-b0cb05a85cf8 tempest-ProjectReaderTests-940530395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.483s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:36:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-77f6f0ed-3c4a-4934-98ee-b0cb05a85cf8 tempest-ProjectReaderTests-940530395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8df2620d-15a0-4efa-b294-007203a4fcd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92a5685f-cf05-49c0-aa36-1947d7701a89', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:36:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-77f6f0ed-3c4a-4934-98ee-b0cb05a85cf8 tempest-ProjectReaderTests-940530395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88c71e03-b3c9-47e3-9df2-866e1c0cbabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:36:27 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-77f6f0ed-3c4a-4934-98ee-b0cb05a85cf8 tempest-ProjectReaderTests-940530395 None] Volume volume-92a5685f-cf05-49c0-aa36-1947d7701a89 (92a5685f-cf05-49c0-aa36-1947d7701a89): created successfully Jul 07 08:36:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-77f6f0ed-3c4a-4934-98ee-b0cb05a85cf8 tempest-ProjectReaderTests-940530395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88c71e03-b3c9-47e3-9df2-866e1c0cbabb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:36:27 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-77f6f0ed-3c4a-4934-98ee-b0cb05a85cf8 tempest-ProjectReaderTests-940530395 None] Flow 'volume_create_manager' (30e0106c-e41a-4f36-bb00-de9983ff2132) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:36:27 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-77f6f0ed-3c4a-4934-98ee-b0cb05a85cf8 tempest-ProjectReaderTests-940530395 None] Created volume successfully. Jul 07 08:36:27 devstack sudo[105833]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4222b1fb-6c38-4a0f-9318-f0721ab6bfad tempest-ProjectMemberTests-117232865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07d1519f-a696-4d9e-812a-10fb614c00f9.0351f99f-fcb8-4684-ba45-bbc86feee710" returned: 0 in 0.742s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:27 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-4222b1fb-6c38-4a0f-9318-f0721ab6bfad tempest-ProjectMemberTests-117232865 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07d1519f-a696-4d9e-812a-10fb614c00f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:36:27 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c971da-57fa-4df2-9459-1e99d5fb510e]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:36:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4222b1fb-6c38-4a0f-9318-f0721ab6bfad tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07d1519f-a696-4d9e-812a-10fb614c00f9 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:27 devstack sudo[105839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07d1519f-a696-4d9e-812a-10fb614c00f9 Jul 07 08:36:27 devstack sudo[105839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:28 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-66e85848-8ab8-4658-ad23-5f252a58b7ef tempest-ProjectReaderTests-940530395 None] Acquiring lock "cinder-92a5685f-cf05-49c0-aa36-1947d7701a89-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:36:28 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-66e85848-8ab8-4658-ad23-5f252a58b7ef tempest-ProjectReaderTests-940530395 None] Lock "cinder-92a5685f-cf05-49c0-aa36-1947d7701a89-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:36:28 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-66e85848-8ab8-4658-ad23-5f252a58b7ef tempest-ProjectReaderTests-940530395 None] Acquiring lock "cinder-quobyte-92a5685f-cf05-49c0-aa36-1947d7701a89" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:36:28 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-66e85848-8ab8-4658-ad23-5f252a58b7ef tempest-ProjectReaderTests-940530395 None] Lock "cinder-quobyte-92a5685f-cf05-49c0-aa36-1947d7701a89" acquired by "delete_volume" :: waited 0.013s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:36:28 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[53cad978-4be4-4164-b888-41bcfa9aa375]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:36:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-66e85848-8ab8-4658-ad23-5f252a58b7ef tempest-ProjectReaderTests-940530395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-92a5685f-cf05-49c0-aa36-1947d7701a89 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:28 devstack sudo[105841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-92a5685f-cf05-49c0-aa36-1947d7701a89 Jul 07 08:36:28 devstack sudo[105841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:28 devstack sudo[105839]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4222b1fb-6c38-4a0f-9318-f0721ab6bfad tempest-ProjectMemberTests-117232865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07d1519f-a696-4d9e-812a-10fb614c00f9" returned: 0 in 0.814s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4222b1fb-6c38-4a0f-9318-f0721ab6bfad tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07d1519f-a696-4d9e-812a-10fb614c00f9.0351f99f-fcb8-4684-ba45-bbc86feee710 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:28 devstack sudo[105846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07d1519f-a696-4d9e-812a-10fb614c00f9.0351f99f-fcb8-4684-ba45-bbc86feee710 Jul 07 08:36:28 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:29 devstack sudo[105841]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-66e85848-8ab8-4658-ad23-5f252a58b7ef tempest-ProjectReaderTests-940530395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-92a5685f-cf05-49c0-aa36-1947d7701a89" returned: 0 in 0.771s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-66e85848-8ab8-4658-ad23-5f252a58b7ef tempest-ProjectReaderTests-940530395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-92a5685f-cf05-49c0-aa36-1947d7701a89 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:29 devstack sudo[105851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-92a5685f-cf05-49c0-aa36-1947d7701a89 Jul 07 08:36:29 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:29 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4222b1fb-6c38-4a0f-9318-f0721ab6bfad tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07d1519f-a696-4d9e-812a-10fb614c00f9.0351f99f-fcb8-4684-ba45-bbc86feee710" returned: 0 in 0.773s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4222b1fb-6c38-4a0f-9318-f0721ab6bfad tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07d1519f-a696-4d9e-812a-10fb614c00f9.0351f99f-fcb8-4684-ba45-bbc86feee710 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:29 devstack sudo[105856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07d1519f-a696-4d9e-812a-10fb614c00f9.0351f99f-fcb8-4684-ba45-bbc86feee710 Jul 07 08:36:29 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:29 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-66e85848-8ab8-4658-ad23-5f252a58b7ef tempest-ProjectReaderTests-940530395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-92a5685f-cf05-49c0-aa36-1947d7701a89" returned: 0 in 0.693s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:29 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-66e85848-8ab8-4658-ad23-5f252a58b7ef tempest-ProjectReaderTests-940530395 None] Lock "cinder-quobyte-92a5685f-cf05-49c0-aa36-1947d7701a89" released by "delete_volume" :: held 1.504s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:36:29 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-66e85848-8ab8-4658-ad23-5f252a58b7ef tempest-ProjectReaderTests-940530395 None] Created reservations ['29af38a5-f1d6-4936-bb6f-9b7e07458082', '90915320-f373-4299-aa4d-c7e9d279d16f', '0a915706-096e-4e2e-acd2-418c1954699c', '361a9163-73fa-4578-ae9a-6702c8b439d2'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:36:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-66e85848-8ab8-4658-ad23-5f252a58b7ef tempest-ProjectReaderTests-940530395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:36:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-66e85848-8ab8-4658-ad23-5f252a58b7ef tempest-ProjectReaderTests-940530395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:36:29 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-66e85848-8ab8-4658-ad23-5f252a58b7ef tempest-ProjectReaderTests-940530395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:36:29 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-66e85848-8ab8-4658-ad23-5f252a58b7ef tempest-ProjectReaderTests-940530395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:36:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-66e85848-8ab8-4658-ad23-5f252a58b7ef tempest-ProjectReaderTests-940530395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:36:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-66e85848-8ab8-4658-ad23-5f252a58b7ef tempest-ProjectReaderTests-940530395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:29 devstack sudo[105860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:36:29 devstack sudo[105860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:29 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4222b1fb-6c38-4a0f-9318-f0721ab6bfad tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07d1519f-a696-4d9e-812a-10fb614c00f9.0351f99f-fcb8-4684-ba45-bbc86feee710" returned: 0 in 0.661s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:29 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4222b1fb-6c38-4a0f-9318-f0721ab6bfad tempest-ProjectMemberTests-117232865 None] Lock "cinder-quobyte-0351f99f-fcb8-4684-ba45-bbc86feee710" released by "_delete_snapshot" :: held 3.087s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:36:29 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4222b1fb-6c38-4a0f-9318-f0721ab6bfad tempest-ProjectMemberTests-117232865 None] Lock "cinder-quobyte-07d1519f-a696-4d9e-812a-10fb614c00f9" released by "delete_snapshot" :: held 3.117s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:36:30 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-4222b1fb-6c38-4a0f-9318-f0721ab6bfad tempest-ProjectMemberTests-117232865 None] Created reservations ['ad05a7a0-8bf1-498a-a939-41a4fe9a2d5a', '0b807472-6d72-4a0b-aa82-01605f2f36f8', '201241b1-90be-4bac-b79d-7d5bcaa6a5c0', 'e52f065e-5cf4-441d-9228-078a50cc2e9f'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:36:30 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-4222b1fb-6c38-4a0f-9318-f0721ab6bfad tempest-ProjectMemberTests-117232865 None] Delete snapshot completed successfully. Jul 07 08:36:30 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4222b1fb-6c38-4a0f-9318-f0721ab6bfad tempest-ProjectMemberTests-117232865 None] Lock "cinder-0351f99f-fcb8-4684-ba45-bbc86feee710-delete_snapshot" released by "delete_snapshot" :: held 3.258s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:36:30 devstack sudo[105860]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-66e85848-8ab8-4658-ad23-5f252a58b7ef tempest-ProjectReaderTests-940530395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.684s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:30 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-66e85848-8ab8-4658-ad23-5f252a58b7ef tempest-ProjectReaderTests-940530395 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:36:30 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-66e85848-8ab8-4658-ad23-5f252a58b7ef tempest-ProjectReaderTests-940530395 None] Deleted volume successfully. Jul 07 08:36:30 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-66e85848-8ab8-4658-ad23-5f252a58b7ef tempest-ProjectReaderTests-940530395 None] Lock "cinder-92a5685f-cf05-49c0-aa36-1947d7701a89-delete_volume" released by "delete_volume" :: held 2.396s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:36:30 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-964ea12f-8ed1-4349-acd8-b9f2bc4c422d tempest-ProjectReaderTests-940530395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:36:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-964ea12f-8ed1-4349-acd8-b9f2bc4c422d tempest-ProjectReaderTests-940530395 None] Flow 'volume_create_manager' (b5b1e531-9bab-4cb3-834b-a01d935a01f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:36:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-964ea12f-8ed1-4349-acd8-b9f2bc4c422d tempest-ProjectReaderTests-940530395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (432f10dd-0a05-49ff-927c-a31710345b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:36:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-964ea12f-8ed1-4349-acd8-b9f2bc4c422d tempest-ProjectReaderTests-940530395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (432f10dd-0a05-49ff-927c-a31710345b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-999335135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ad693d2-ed2c-424b-9a88-f6a4f8279d6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ec2b488495a4a16bc2f6927ceda29b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:36:31Z,use_quota=True,user_id='1c9e4d863b304990aa78bebc24f8f45e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:36:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-964ea12f-8ed1-4349-acd8-b9f2bc4c422d tempest-ProjectReaderTests-940530395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef2b958b-d71f-4c52-8939-9d1c13057806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:36:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-964ea12f-8ed1-4349-acd8-b9f2bc4c422d tempest-ProjectReaderTests-940530395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef2b958b-d71f-4c52-8939-9d1c13057806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:36:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-964ea12f-8ed1-4349-acd8-b9f2bc4c422d tempest-ProjectReaderTests-940530395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fc79919-e97e-4fc0-8d6a-fdbe5aa5f868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:36:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-964ea12f-8ed1-4349-acd8-b9f2bc4c422d tempest-ProjectReaderTests-940530395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fc79919-e97e-4fc0-8d6a-fdbe5aa5f868) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ad693d2-ed2c-424b-9a88-f6a4f8279d6b', 'volume_name': 'volume-6ad693d2-ed2c-424b-9a88-f6a4f8279d6b', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:36:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-964ea12f-8ed1-4349-acd8-b9f2bc4c422d tempest-ProjectReaderTests-940530395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25e7255f-dce5-4231-b968-b4e6046d8724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:36:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-964ea12f-8ed1-4349-acd8-b9f2bc4c422d tempest-ProjectReaderTests-940530395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25e7255f-dce5-4231-b968-b4e6046d8724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:36:30 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-964ea12f-8ed1-4349-acd8-b9f2bc4c422d tempest-ProjectReaderTests-940530395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecf5dbf3-2b38-43db-8d82-e264e85a5502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:36:30 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-964ea12f-8ed1-4349-acd8-b9f2bc4c422d tempest-ProjectReaderTests-940530395 None] Volume 6ad693d2-ed2c-424b-9a88-f6a4f8279d6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ad693d2-ed2c-424b-9a88-f6a4f8279d6b', 'volume_size': 1} Jul 07 08:36:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-964ea12f-8ed1-4349-acd8-b9f2bc4c422d tempest-ProjectReaderTests-940530395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:36:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-964ea12f-8ed1-4349-acd8-b9f2bc4c422d tempest-ProjectReaderTests-940530395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:36:30 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-964ea12f-8ed1-4349-acd8-b9f2bc4c422d tempest-ProjectReaderTests-940530395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-999335135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ad693d2-ed2c-424b-9a88-f6a4f8279d6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ec2b488495a4a16bc2f6927ceda29b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:36:31Z,use_quota=True,user_id='1c9e4d863b304990aa78bebc24f8f45e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:36:30 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-964ea12f-8ed1-4349-acd8-b9f2bc4c422d tempest-ProjectReaderTests-940530395 None] Creating volume 6ad693d2-ed2c-424b-9a88-f6a4f8279d6b {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:36:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-964ea12f-8ed1-4349-acd8-b9f2bc4c422d tempest-ProjectReaderTests-940530395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:36:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-964ea12f-8ed1-4349-acd8-b9f2bc4c422d tempest-ProjectReaderTests-940530395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:36:30 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-964ea12f-8ed1-4349-acd8-b9f2bc4c422d tempest-ProjectReaderTests-940530395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:36:30 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-964ea12f-8ed1-4349-acd8-b9f2bc4c422d tempest-ProjectReaderTests-940530395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:36:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-964ea12f-8ed1-4349-acd8-b9f2bc4c422d tempest-ProjectReaderTests-940530395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:36:30 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-964ea12f-8ed1-4349-acd8-b9f2bc4c422d tempest-ProjectReaderTests-940530395 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:36:30 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-964ea12f-8ed1-4349-acd8-b9f2bc4c422d tempest-ProjectReaderTests-940530395 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:36:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-964ea12f-8ed1-4349-acd8-b9f2bc4c422d tempest-ProjectReaderTests-940530395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6ad693d2-ed2c-424b-9a88-f6a4f8279d6b 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:30 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6ad693d2-ed2c-424b-9a88-f6a4f8279d6b 1073741824 Jul 07 08:36:30 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:31 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-18744b78-a259-469e-b4e1-7c016fd8dba7 tempest-ProjectMemberTests-117232865 None] Acquiring lock "cinder-07d1519f-a696-4d9e-812a-10fb614c00f9-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:36:31 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-18744b78-a259-469e-b4e1-7c016fd8dba7 tempest-ProjectMemberTests-117232865 None] Lock "cinder-07d1519f-a696-4d9e-812a-10fb614c00f9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:36:31 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-18744b78-a259-469e-b4e1-7c016fd8dba7 tempest-ProjectMemberTests-117232865 None] Acquiring lock "cinder-quobyte-07d1519f-a696-4d9e-812a-10fb614c00f9" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:36:31 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-18744b78-a259-469e-b4e1-7c016fd8dba7 tempest-ProjectMemberTests-117232865 None] Lock "cinder-quobyte-07d1519f-a696-4d9e-812a-10fb614c00f9" acquired by "delete_volume" :: waited 0.015s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:36:31 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ff3e7a-b05e-4d8c-8027-3825e5b9dfb9]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:36:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-18744b78-a259-469e-b4e1-7c016fd8dba7 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07d1519f-a696-4d9e-812a-10fb614c00f9 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:31 devstack sudo[105865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07d1519f-a696-4d9e-812a-10fb614c00f9 Jul 07 08:36:31 devstack sudo[105865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:31 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-964ea12f-8ed1-4349-acd8-b9f2bc4c422d tempest-ProjectReaderTests-940530395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6ad693d2-ed2c-424b-9a88-f6a4f8279d6b 1073741824" returned: 0 in 0.824s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-964ea12f-8ed1-4349-acd8-b9f2bc4c422d tempest-ProjectReaderTests-940530395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6ad693d2-ed2c-424b-9a88-f6a4f8279d6b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:31 devstack sudo[105871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6ad693d2-ed2c-424b-9a88-f6a4f8279d6b Jul 07 08:36:31 devstack sudo[105871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:31 devstack sudo[105865]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-18744b78-a259-469e-b4e1-7c016fd8dba7 tempest-ProjectMemberTests-117232865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07d1519f-a696-4d9e-812a-10fb614c00f9" returned: 0 in 0.761s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-18744b78-a259-469e-b4e1-7c016fd8dba7 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07d1519f-a696-4d9e-812a-10fb614c00f9 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:31 devstack sudo[105876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07d1519f-a696-4d9e-812a-10fb614c00f9 Jul 07 08:36:31 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:32 devstack sudo[105871]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-964ea12f-8ed1-4349-acd8-b9f2bc4c422d tempest-ProjectReaderTests-940530395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6ad693d2-ed2c-424b-9a88-f6a4f8279d6b" returned: 0 in 0.633s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:32 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-964ea12f-8ed1-4349-acd8-b9f2bc4c422d tempest-ProjectReaderTests-940530395 None] <== create_volume: return (1518ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:36:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-964ea12f-8ed1-4349-acd8-b9f2bc4c422d tempest-ProjectReaderTests-940530395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.521s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:36:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-964ea12f-8ed1-4349-acd8-b9f2bc4c422d tempest-ProjectReaderTests-940530395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecf5dbf3-2b38-43db-8d82-e264e85a5502) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ad693d2-ed2c-424b-9a88-f6a4f8279d6b', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:36:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-964ea12f-8ed1-4349-acd8-b9f2bc4c422d tempest-ProjectReaderTests-940530395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (370899fd-90ab-43b7-bf18-6b6820da2f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:36:32 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-964ea12f-8ed1-4349-acd8-b9f2bc4c422d tempest-ProjectReaderTests-940530395 None] Volume volume-6ad693d2-ed2c-424b-9a88-f6a4f8279d6b (6ad693d2-ed2c-424b-9a88-f6a4f8279d6b): created successfully Jul 07 08:36:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-964ea12f-8ed1-4349-acd8-b9f2bc4c422d tempest-ProjectReaderTests-940530395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (370899fd-90ab-43b7-bf18-6b6820da2f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:36:32 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-964ea12f-8ed1-4349-acd8-b9f2bc4c422d tempest-ProjectReaderTests-940530395 None] Flow 'volume_create_manager' (b5b1e531-9bab-4cb3-834b-a01d935a01f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:36:32 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-964ea12f-8ed1-4349-acd8-b9f2bc4c422d tempest-ProjectReaderTests-940530395 None] Created volume successfully. Jul 07 08:36:32 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-18744b78-a259-469e-b4e1-7c016fd8dba7 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-07d1519f-a696-4d9e-812a-10fb614c00f9" returned: 0 in 0.672s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:32 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-18744b78-a259-469e-b4e1-7c016fd8dba7 tempest-ProjectMemberTests-117232865 None] Lock "cinder-quobyte-07d1519f-a696-4d9e-812a-10fb614c00f9" released by "delete_volume" :: held 1.492s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:36:32 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-18744b78-a259-469e-b4e1-7c016fd8dba7 tempest-ProjectMemberTests-117232865 None] Created reservations ['b6a03ee9-1dbb-4e5f-8622-0f07e477be5d', '2402f031-a57d-4d55-b6b4-1ff513c8b348', 'd428e927-ee2b-4251-b7be-b2337d7bb9e1', 'ad97adde-3bbc-4685-a7b1-4f19bb8f7207'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:36:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-18744b78-a259-469e-b4e1-7c016fd8dba7 tempest-ProjectMemberTests-117232865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:36:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-18744b78-a259-469e-b4e1-7c016fd8dba7 tempest-ProjectMemberTests-117232865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:36:32 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-18744b78-a259-469e-b4e1-7c016fd8dba7 tempest-ProjectMemberTests-117232865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:36:32 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-18744b78-a259-469e-b4e1-7c016fd8dba7 tempest-ProjectMemberTests-117232865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:36:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-18744b78-a259-469e-b4e1-7c016fd8dba7 tempest-ProjectMemberTests-117232865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:36:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-18744b78-a259-469e-b4e1-7c016fd8dba7 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:32 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:36:32 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:32 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-24677011-7d5a-463a-8428-f1dafefa7ffd tempest-ProjectReaderTests-940530395 None] Acquiring lock "cinder-6ad693d2-ed2c-424b-9a88-f6a4f8279d6b-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:36:32 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-24677011-7d5a-463a-8428-f1dafefa7ffd tempest-ProjectReaderTests-940530395 None] Lock "cinder-6ad693d2-ed2c-424b-9a88-f6a4f8279d6b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:36:33 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-24677011-7d5a-463a-8428-f1dafefa7ffd tempest-ProjectReaderTests-940530395 None] Acquiring lock "cinder-quobyte-6ad693d2-ed2c-424b-9a88-f6a4f8279d6b" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:36:33 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-24677011-7d5a-463a-8428-f1dafefa7ffd tempest-ProjectReaderTests-940530395 None] Lock "cinder-quobyte-6ad693d2-ed2c-424b-9a88-f6a4f8279d6b" acquired by "delete_volume" :: waited 0.018s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:36:33 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3b4d00-2ecc-44d1-be16-435d768e0999]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:36:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-24677011-7d5a-463a-8428-f1dafefa7ffd tempest-ProjectReaderTests-940530395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6ad693d2-ed2c-424b-9a88-f6a4f8279d6b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:33 devstack sudo[105882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6ad693d2-ed2c-424b-9a88-f6a4f8279d6b Jul 07 08:36:33 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:33 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-18744b78-a259-469e-b4e1-7c016fd8dba7 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.630s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:33 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-18744b78-a259-469e-b4e1-7c016fd8dba7 tempest-ProjectMemberTests-117232865 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:36:33 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-18744b78-a259-469e-b4e1-7c016fd8dba7 tempest-ProjectMemberTests-117232865 None] Deleted volume successfully. Jul 07 08:36:33 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-18744b78-a259-469e-b4e1-7c016fd8dba7 tempest-ProjectMemberTests-117232865 None] Lock "cinder-07d1519f-a696-4d9e-812a-10fb614c00f9-delete_volume" released by "delete_volume" :: held 2.358s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:36:33 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3feb632-ceb3-4736-935e-c9dee6562958 tempest-ProjectMemberTests-117232865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:36:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c3feb632-ceb3-4736-935e-c9dee6562958 tempest-ProjectMemberTests-117232865 None] Flow 'volume_create_manager' (1deff434-a39d-4cc0-960b-e041fd46b3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:36:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c3feb632-ceb3-4736-935e-c9dee6562958 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (606ba28f-8335-44fd-ad35-42dae35a31eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:36:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c3feb632-ceb3-4736-935e-c9dee6562958 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (606ba28f-8335-44fd-ad35-42dae35a31eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1798633329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4275c883-b4b6-438d-a0fe-a2d383cc7667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac2688c9df5545018de78c47a9e5a401',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:36:34Z,use_quota=True,user_id='11de70d1cfa0463dbad27ce8dcab2b39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:36:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c3feb632-ceb3-4736-935e-c9dee6562958 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ef2e346-0fd4-4798-b8ad-5038ee6871cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:36:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c3feb632-ceb3-4736-935e-c9dee6562958 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ef2e346-0fd4-4798-b8ad-5038ee6871cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:36:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c3feb632-ceb3-4736-935e-c9dee6562958 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f977117e-8350-4adb-a2cf-d9868d9aebcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:36:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c3feb632-ceb3-4736-935e-c9dee6562958 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f977117e-8350-4adb-a2cf-d9868d9aebcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4275c883-b4b6-438d-a0fe-a2d383cc7667', 'volume_name': 'volume-4275c883-b4b6-438d-a0fe-a2d383cc7667', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:36:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c3feb632-ceb3-4736-935e-c9dee6562958 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (174edaa6-524a-4839-ac62-4abd8f6346c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:36:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c3feb632-ceb3-4736-935e-c9dee6562958 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (174edaa6-524a-4839-ac62-4abd8f6346c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:36:33 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c3feb632-ceb3-4736-935e-c9dee6562958 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4230b31-ab6e-42e9-80a9-87b660bc4e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:36:33 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-c3feb632-ceb3-4736-935e-c9dee6562958 tempest-ProjectMemberTests-117232865 None] Volume 4275c883-b4b6-438d-a0fe-a2d383cc7667: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4275c883-b4b6-438d-a0fe-a2d383cc7667', 'volume_size': 1} Jul 07 08:36:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c3feb632-ceb3-4736-935e-c9dee6562958 tempest-ProjectMemberTests-117232865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:36:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c3feb632-ceb3-4736-935e-c9dee6562958 tempest-ProjectMemberTests-117232865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:36:33 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c3feb632-ceb3-4736-935e-c9dee6562958 tempest-ProjectMemberTests-117232865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1798633329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4275c883-b4b6-438d-a0fe-a2d383cc7667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac2688c9df5545018de78c47a9e5a401',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:36:34Z,use_quota=True,user_id='11de70d1cfa0463dbad27ce8dcab2b39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:36:33 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-c3feb632-ceb3-4736-935e-c9dee6562958 tempest-ProjectMemberTests-117232865 None] Creating volume 4275c883-b4b6-438d-a0fe-a2d383cc7667 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:36:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c3feb632-ceb3-4736-935e-c9dee6562958 tempest-ProjectMemberTests-117232865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:36:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c3feb632-ceb3-4736-935e-c9dee6562958 tempest-ProjectMemberTests-117232865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:36:33 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c3feb632-ceb3-4736-935e-c9dee6562958 tempest-ProjectMemberTests-117232865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:36:33 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c3feb632-ceb3-4736-935e-c9dee6562958 tempest-ProjectMemberTests-117232865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:36:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c3feb632-ceb3-4736-935e-c9dee6562958 tempest-ProjectMemberTests-117232865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:36:33 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c3feb632-ceb3-4736-935e-c9dee6562958 tempest-ProjectMemberTests-117232865 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:36:33 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-c3feb632-ceb3-4736-935e-c9dee6562958 tempest-ProjectMemberTests-117232865 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:36:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c3feb632-ceb3-4736-935e-c9dee6562958 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4275c883-b4b6-438d-a0fe-a2d383cc7667 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:33 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:33 devstack sudo[105888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4275c883-b4b6-438d-a0fe-a2d383cc7667 1073741824 Jul 07 08:36:33 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-24677011-7d5a-463a-8428-f1dafefa7ffd tempest-ProjectReaderTests-940530395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6ad693d2-ed2c-424b-9a88-f6a4f8279d6b" returned: 0 in 0.813s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-24677011-7d5a-463a-8428-f1dafefa7ffd tempest-ProjectReaderTests-940530395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6ad693d2-ed2c-424b-9a88-f6a4f8279d6b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:33 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6ad693d2-ed2c-424b-9a88-f6a4f8279d6b Jul 07 08:36:33 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:34 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-24677011-7d5a-463a-8428-f1dafefa7ffd tempest-ProjectReaderTests-940530395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-6ad693d2-ed2c-424b-9a88-f6a4f8279d6b" returned: 0 in 0.640s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:34 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-24677011-7d5a-463a-8428-f1dafefa7ffd tempest-ProjectReaderTests-940530395 None] Lock "cinder-quobyte-6ad693d2-ed2c-424b-9a88-f6a4f8279d6b" released by "delete_volume" :: held 1.497s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:36:34 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-24677011-7d5a-463a-8428-f1dafefa7ffd tempest-ProjectReaderTests-940530395 None] Created reservations ['67631700-e6f4-4173-b1c6-e477868d48cf', 'dd1b2b87-8b1a-484d-9c9d-5be1f9cee798', '0f03883b-d873-4444-8768-eda3378e5f0f', 'ddf1101a-628b-488c-a50d-1622e3a2c5c4'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:36:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-24677011-7d5a-463a-8428-f1dafefa7ffd tempest-ProjectReaderTests-940530395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:36:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-24677011-7d5a-463a-8428-f1dafefa7ffd tempest-ProjectReaderTests-940530395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:36:34 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-24677011-7d5a-463a-8428-f1dafefa7ffd tempest-ProjectReaderTests-940530395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:36:34 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-24677011-7d5a-463a-8428-f1dafefa7ffd tempest-ProjectReaderTests-940530395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:36:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-24677011-7d5a-463a-8428-f1dafefa7ffd tempest-ProjectReaderTests-940530395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:36:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-24677011-7d5a-463a-8428-f1dafefa7ffd tempest-ProjectReaderTests-940530395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:34 devstack sudo[105897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:36:34 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:34 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c3feb632-ceb3-4736-935e-c9dee6562958 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4275c883-b4b6-438d-a0fe-a2d383cc7667 1073741824" returned: 0 in 0.884s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c3feb632-ceb3-4736-935e-c9dee6562958 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4275c883-b4b6-438d-a0fe-a2d383cc7667 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:34 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4275c883-b4b6-438d-a0fe-a2d383cc7667 Jul 07 08:36:34 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:35 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-24677011-7d5a-463a-8428-f1dafefa7ffd tempest-ProjectReaderTests-940530395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.660s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:35 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-24677011-7d5a-463a-8428-f1dafefa7ffd tempest-ProjectReaderTests-940530395 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:36:35 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-24677011-7d5a-463a-8428-f1dafefa7ffd tempest-ProjectReaderTests-940530395 None] Deleted volume successfully. Jul 07 08:36:35 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-24677011-7d5a-463a-8428-f1dafefa7ffd tempest-ProjectReaderTests-940530395 None] Lock "cinder-6ad693d2-ed2c-424b-9a88-f6a4f8279d6b-delete_volume" released by "delete_volume" :: held 2.381s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:36:35 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c3feb632-ceb3-4736-935e-c9dee6562958 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4275c883-b4b6-438d-a0fe-a2d383cc7667" returned: 0 in 0.716s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:35 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c3feb632-ceb3-4736-935e-c9dee6562958 tempest-ProjectMemberTests-117232865 None] <== create_volume: return (1644ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:36:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c3feb632-ceb3-4736-935e-c9dee6562958 tempest-ProjectMemberTests-117232865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.647s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:36:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c3feb632-ceb3-4736-935e-c9dee6562958 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4230b31-ab6e-42e9-80a9-87b660bc4e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4275c883-b4b6-438d-a0fe-a2d383cc7667', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:36:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c3feb632-ceb3-4736-935e-c9dee6562958 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (393bfb5a-a193-40f0-be54-470f96e21fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:36:35 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-c3feb632-ceb3-4736-935e-c9dee6562958 tempest-ProjectMemberTests-117232865 None] Volume volume-4275c883-b4b6-438d-a0fe-a2d383cc7667 (4275c883-b4b6-438d-a0fe-a2d383cc7667): created successfully Jul 07 08:36:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c3feb632-ceb3-4736-935e-c9dee6562958 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (393bfb5a-a193-40f0-be54-470f96e21fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:36:35 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c3feb632-ceb3-4736-935e-c9dee6562958 tempest-ProjectMemberTests-117232865 None] Flow 'volume_create_manager' (1deff434-a39d-4cc0-960b-e041fd46b3e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:36:35 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-c3feb632-ceb3-4736-935e-c9dee6562958 tempest-ProjectMemberTests-117232865 None] Created volume successfully. Jul 07 08:36:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-05b76345-9e1e-4b1a-b84d-edfaa5465053 tempest-ProjectMemberTests-117232865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:36:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-05b76345-9e1e-4b1a-b84d-edfaa5465053 tempest-ProjectMemberTests-117232865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:36:36 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-05b76345-9e1e-4b1a-b84d-edfaa5465053 tempest-ProjectMemberTests-117232865 None] Creating offline snapshot 744c045f-561a-424e-9a6d-85e9334a3cf0 of volume 4275c883-b4b6-438d-a0fe-a2d383cc7667 {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:36:36 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd4085c-60f4-40b6-9094-ff8819582d6d]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:36:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-05b76345-9e1e-4b1a-b84d-edfaa5465053 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4275c883-b4b6-438d-a0fe-a2d383cc7667 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:36 devstack sudo[105903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4275c883-b4b6-438d-a0fe-a2d383cc7667 Jul 07 08:36:36 devstack sudo[105903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:36 devstack sudo[105903]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-05b76345-9e1e-4b1a-b84d-edfaa5465053 tempest-ProjectMemberTests-117232865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4275c883-b4b6-438d-a0fe-a2d383cc7667" returned: 0 in 0.841s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-05b76345-9e1e-4b1a-b84d-edfaa5465053 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4275c883-b4b6-438d-a0fe-a2d383cc7667,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4275c883-b4b6-438d-a0fe-a2d383cc7667.744c045f-561a-424e-9a6d-85e9334a3cf0 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:36 devstack sudo[105908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4275c883-b4b6-438d-a0fe-a2d383cc7667,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4275c883-b4b6-438d-a0fe-a2d383cc7667.744c045f-561a-424e-9a6d-85e9334a3cf0 1G Jul 07 08:36:36 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:37 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-05b76345-9e1e-4b1a-b84d-edfaa5465053 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4275c883-b4b6-438d-a0fe-a2d383cc7667,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4275c883-b4b6-438d-a0fe-a2d383cc7667.744c045f-561a-424e-9a6d-85e9334a3cf0 1G" returned: 0 in 0.839s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-05b76345-9e1e-4b1a-b84d-edfaa5465053 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4275c883-b4b6-438d-a0fe-a2d383cc7667 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4275c883-b4b6-438d-a0fe-a2d383cc7667.744c045f-561a-424e-9a6d-85e9334a3cf0 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:37 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4275c883-b4b6-438d-a0fe-a2d383cc7667 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4275c883-b4b6-438d-a0fe-a2d383cc7667.744c045f-561a-424e-9a6d-85e9334a3cf0 Jul 07 08:36:37 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:38 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-05b76345-9e1e-4b1a-b84d-edfaa5465053 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4275c883-b4b6-438d-a0fe-a2d383cc7667 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4275c883-b4b6-438d-a0fe-a2d383cc7667.744c045f-561a-424e-9a6d-85e9334a3cf0" returned: 0 in 0.781s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:38 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-05b76345-9e1e-4b1a-b84d-edfaa5465053 tempest-ProjectMemberTests-117232865 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4275c883-b4b6-438d-a0fe-a2d383cc7667.744c045f-561a-424e-9a6d-85e9334a3cf0 is being set with open permissions: ugo+rw Jul 07 08:36:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-05b76345-9e1e-4b1a-b84d-edfaa5465053 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4275c883-b4b6-438d-a0fe-a2d383cc7667.744c045f-561a-424e-9a6d-85e9334a3cf0 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:38 devstack sudo[105919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4275c883-b4b6-438d-a0fe-a2d383cc7667.744c045f-561a-424e-9a6d-85e9334a3cf0 Jul 07 08:36:38 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:39 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-05b76345-9e1e-4b1a-b84d-edfaa5465053 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4275c883-b4b6-438d-a0fe-a2d383cc7667.744c045f-561a-424e-9a6d-85e9334a3cf0" returned: 0 in 0.786s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-05b76345-9e1e-4b1a-b84d-edfaa5465053 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4275c883-b4b6-438d-a0fe-a2d383cc7667.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:39 devstack sudo[105958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4275c883-b4b6-438d-a0fe-a2d383cc7667.info Jul 07 08:36:39 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:40 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-05b76345-9e1e-4b1a-b84d-edfaa5465053 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4275c883-b4b6-438d-a0fe-a2d383cc7667.info" returned: 0 in 0.730s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:40 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-05b76345-9e1e-4b1a-b84d-edfaa5465053 tempest-ProjectMemberTests-117232865 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4275c883-b4b6-438d-a0fe-a2d383cc7667.info is being set with open permissions: ugo+rw Jul 07 08:36:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-05b76345-9e1e-4b1a-b84d-edfaa5465053 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4275c883-b4b6-438d-a0fe-a2d383cc7667.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:40 devstack sudo[105961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4275c883-b4b6-438d-a0fe-a2d383cc7667.info Jul 07 08:36:40 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:40 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-05b76345-9e1e-4b1a-b84d-edfaa5465053 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4275c883-b4b6-438d-a0fe-a2d383cc7667.info" returned: 0 in 0.712s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-05b76345-9e1e-4b1a-b84d-edfaa5465053 tempest-ProjectMemberTests-117232865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.774s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:36:40 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-05b76345-9e1e-4b1a-b84d-edfaa5465053 tempest-ProjectMemberTests-117232865 None] Create snapshot completed successfully Jul 07 08:36:41 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ac0a5c01-907c-4763-a5e8-c074626f1750 tempest-ProjectMemberTests-117232865 None] Acquiring lock "cinder-744c045f-561a-424e-9a6d-85e9334a3cf0-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:36:41 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ac0a5c01-907c-4763-a5e8-c074626f1750 tempest-ProjectMemberTests-117232865 None] Lock "cinder-744c045f-561a-424e-9a6d-85e9334a3cf0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:36:41 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ac0a5c01-907c-4763-a5e8-c074626f1750 tempest-ProjectMemberTests-117232865 None] Acquiring lock "cinder-quobyte-4275c883-b4b6-438d-a0fe-a2d383cc7667" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:36:41 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ac0a5c01-907c-4763-a5e8-c074626f1750 tempest-ProjectMemberTests-117232865 None] Lock "cinder-quobyte-4275c883-b4b6-438d-a0fe-a2d383cc7667" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:36:41 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ac0a5c01-907c-4763-a5e8-c074626f1750 tempest-ProjectMemberTests-117232865 None] Acquiring lock "cinder-quobyte-744c045f-561a-424e-9a6d-85e9334a3cf0" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:36:41 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ac0a5c01-907c-4763-a5e8-c074626f1750 tempest-ProjectMemberTests-117232865 None] Lock "cinder-quobyte-744c045f-561a-424e-9a6d-85e9334a3cf0" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:36:41 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-ac0a5c01-907c-4763-a5e8-c074626f1750 tempest-ProjectMemberTests-117232865 None] Deleting offline snapshot 744c045f-561a-424e-9a6d-85e9334a3cf0 of volume 4275c883-b4b6-438d-a0fe-a2d383cc7667 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:36:41 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-ac0a5c01-907c-4763-a5e8-c074626f1750 tempest-ProjectMemberTests-117232865 None] snapshot_file for this snap is: volume-4275c883-b4b6-438d-a0fe-a2d383cc7667.744c045f-561a-424e-9a6d-85e9334a3cf0 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:36:41 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e45c2e4-b66b-4df2-ac88-6cc0419c5e5d]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:36:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ac0a5c01-907c-4763-a5e8-c074626f1750 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4275c883-b4b6-438d-a0fe-a2d383cc7667.744c045f-561a-424e-9a6d-85e9334a3cf0 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:41 devstack sudo[105964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4275c883-b4b6-438d-a0fe-a2d383cc7667.744c045f-561a-424e-9a6d-85e9334a3cf0 Jul 07 08:36:41 devstack sudo[105964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:42 devstack sudo[105964]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ac0a5c01-907c-4763-a5e8-c074626f1750 tempest-ProjectMemberTests-117232865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4275c883-b4b6-438d-a0fe-a2d383cc7667.744c045f-561a-424e-9a6d-85e9334a3cf0" returned: 0 in 0.893s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:42 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-ac0a5c01-907c-4763-a5e8-c074626f1750 tempest-ProjectMemberTests-117232865 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4275c883-b4b6-438d-a0fe-a2d383cc7667(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:36:42 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed63b2c-6b5a-4bcf-93d3-6e50a7f60db7]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:36:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ac0a5c01-907c-4763-a5e8-c074626f1750 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4275c883-b4b6-438d-a0fe-a2d383cc7667 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:42 devstack sudo[105971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4275c883-b4b6-438d-a0fe-a2d383cc7667 Jul 07 08:36:42 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:43 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ac0a5c01-907c-4763-a5e8-c074626f1750 tempest-ProjectMemberTests-117232865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4275c883-b4b6-438d-a0fe-a2d383cc7667" returned: 0 in 0.822s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ac0a5c01-907c-4763-a5e8-c074626f1750 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4275c883-b4b6-438d-a0fe-a2d383cc7667.744c045f-561a-424e-9a6d-85e9334a3cf0 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:43 devstack sudo[105976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4275c883-b4b6-438d-a0fe-a2d383cc7667.744c045f-561a-424e-9a6d-85e9334a3cf0 Jul 07 08:36:43 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:43 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ac0a5c01-907c-4763-a5e8-c074626f1750 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4275c883-b4b6-438d-a0fe-a2d383cc7667.744c045f-561a-424e-9a6d-85e9334a3cf0" returned: 0 in 0.822s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ac0a5c01-907c-4763-a5e8-c074626f1750 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4275c883-b4b6-438d-a0fe-a2d383cc7667.744c045f-561a-424e-9a6d-85e9334a3cf0 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:43 devstack sudo[105981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4275c883-b4b6-438d-a0fe-a2d383cc7667.744c045f-561a-424e-9a6d-85e9334a3cf0 Jul 07 08:36:43 devstack sudo[105981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:44 devstack sudo[105981]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ac0a5c01-907c-4763-a5e8-c074626f1750 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4275c883-b4b6-438d-a0fe-a2d383cc7667.744c045f-561a-424e-9a6d-85e9334a3cf0" returned: 0 in 0.662s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:44 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ac0a5c01-907c-4763-a5e8-c074626f1750 tempest-ProjectMemberTests-117232865 None] Lock "cinder-quobyte-744c045f-561a-424e-9a6d-85e9334a3cf0" released by "_delete_snapshot" :: held 3.307s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:36:44 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ac0a5c01-907c-4763-a5e8-c074626f1750 tempest-ProjectMemberTests-117232865 None] Lock "cinder-quobyte-4275c883-b4b6-438d-a0fe-a2d383cc7667" released by "delete_snapshot" :: held 3.333s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:36:44 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-ac0a5c01-907c-4763-a5e8-c074626f1750 tempest-ProjectMemberTests-117232865 None] Created reservations ['f2e59ec3-66f5-41f7-8f0e-7acf8ab4aa64', '1f7411ce-c784-4ade-9f6b-4080e32b8420', 'aaabb087-fb1e-4a37-b26e-14e7b1ab131f', '7bb32bac-1f15-4128-ba51-3eeb3f624e5f'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:36:44 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-ac0a5c01-907c-4763-a5e8-c074626f1750 tempest-ProjectMemberTests-117232865 None] Delete snapshot completed successfully. Jul 07 08:36:44 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-ac0a5c01-907c-4763-a5e8-c074626f1750 tempest-ProjectMemberTests-117232865 None] Lock "cinder-744c045f-561a-424e-9a6d-85e9334a3cf0-delete_snapshot" released by "delete_snapshot" :: held 3.488s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:36:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-15d09d28-2739-4045-aa05-9e765d545ad3 tempest-ProjectMemberTests-117232865 None] Acquiring lock "cinder-4275c883-b4b6-438d-a0fe-a2d383cc7667-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:36:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-15d09d28-2739-4045-aa05-9e765d545ad3 tempest-ProjectMemberTests-117232865 None] Lock "cinder-4275c883-b4b6-438d-a0fe-a2d383cc7667-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:36:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-15d09d28-2739-4045-aa05-9e765d545ad3 tempest-ProjectMemberTests-117232865 None] Acquiring lock "cinder-quobyte-4275c883-b4b6-438d-a0fe-a2d383cc7667" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:36:45 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-15d09d28-2739-4045-aa05-9e765d545ad3 tempest-ProjectMemberTests-117232865 None] Lock "cinder-quobyte-4275c883-b4b6-438d-a0fe-a2d383cc7667" acquired by "delete_volume" :: waited 0.014s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:36:45 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ee3b6a-29c1-4a81-9fa7-5f004451437b]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:36:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-15d09d28-2739-4045-aa05-9e765d545ad3 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4275c883-b4b6-438d-a0fe-a2d383cc7667 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:45 devstack sudo[105984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4275c883-b4b6-438d-a0fe-a2d383cc7667 Jul 07 08:36:45 devstack sudo[105984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:46 devstack sudo[105984]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-15d09d28-2739-4045-aa05-9e765d545ad3 tempest-ProjectMemberTests-117232865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4275c883-b4b6-438d-a0fe-a2d383cc7667" returned: 0 in 0.756s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-15d09d28-2739-4045-aa05-9e765d545ad3 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4275c883-b4b6-438d-a0fe-a2d383cc7667 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:46 devstack sudo[105989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4275c883-b4b6-438d-a0fe-a2d383cc7667 Jul 07 08:36:46 devstack sudo[105989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:47 devstack sudo[105989]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-15d09d28-2739-4045-aa05-9e765d545ad3 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-4275c883-b4b6-438d-a0fe-a2d383cc7667" returned: 0 in 0.661s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:47 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-15d09d28-2739-4045-aa05-9e765d545ad3 tempest-ProjectMemberTests-117232865 None] Lock "cinder-quobyte-4275c883-b4b6-438d-a0fe-a2d383cc7667" released by "delete_volume" :: held 1.479s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:36:47 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-15d09d28-2739-4045-aa05-9e765d545ad3 tempest-ProjectMemberTests-117232865 None] Created reservations ['081f4317-7dec-4d13-9693-ff933ddd8611', '7611cad3-260b-4519-9eac-4ab8856cc1d1', '6f3479d4-b58d-4e3e-af61-c891a4a4356f', 'd5eed0fb-7145-4033-8854-d12637a73ef9'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:36:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-15d09d28-2739-4045-aa05-9e765d545ad3 tempest-ProjectMemberTests-117232865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:36:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-15d09d28-2739-4045-aa05-9e765d545ad3 tempest-ProjectMemberTests-117232865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:36:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-15d09d28-2739-4045-aa05-9e765d545ad3 tempest-ProjectMemberTests-117232865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:36:47 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-15d09d28-2739-4045-aa05-9e765d545ad3 tempest-ProjectMemberTests-117232865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:36:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-15d09d28-2739-4045-aa05-9e765d545ad3 tempest-ProjectMemberTests-117232865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:36:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-15d09d28-2739-4045-aa05-9e765d545ad3 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:47 devstack sudo[105992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:36:47 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:47 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-15d09d28-2739-4045-aa05-9e765d545ad3 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.785s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:47 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-15d09d28-2739-4045-aa05-9e765d545ad3 tempest-ProjectMemberTests-117232865 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:36:47 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-15d09d28-2739-4045-aa05-9e765d545ad3 tempest-ProjectMemberTests-117232865 None] Deleted volume successfully. Jul 07 08:36:47 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-15d09d28-2739-4045-aa05-9e765d545ad3 tempest-ProjectMemberTests-117232865 None] Lock "cinder-4275c883-b4b6-438d-a0fe-a2d383cc7667-delete_volume" released by "delete_volume" :: held 2.489s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:36:48 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba7fc7bc-b9d8-4b1d-8377-533933e4fdb3 tempest-ProjectMemberTests-117232865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:36:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ba7fc7bc-b9d8-4b1d-8377-533933e4fdb3 tempest-ProjectMemberTests-117232865 None] Flow 'volume_create_manager' (c0005484-cbf7-456d-a66a-2a85e307dd25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:36:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ba7fc7bc-b9d8-4b1d-8377-533933e4fdb3 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af3e2d4b-6a9f-43d2-b81d-429d946f90ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:36:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ba7fc7bc-b9d8-4b1d-8377-533933e4fdb3 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af3e2d4b-6a9f-43d2-b81d-429d946f90ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1383347950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac2688c9df5545018de78c47a9e5a401',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:36:48Z,use_quota=True,user_id='11de70d1cfa0463dbad27ce8dcab2b39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:36:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ba7fc7bc-b9d8-4b1d-8377-533933e4fdb3 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb0ce651-16e6-422c-979f-2c1e0f16d72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:36:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ba7fc7bc-b9d8-4b1d-8377-533933e4fdb3 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb0ce651-16e6-422c-979f-2c1e0f16d72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:36:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ba7fc7bc-b9d8-4b1d-8377-533933e4fdb3 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a4b7ac6-fcff-4a1d-b7de-8860075a48a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:36:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ba7fc7bc-b9d8-4b1d-8377-533933e4fdb3 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a4b7ac6-fcff-4a1d-b7de-8860075a48a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76', 'volume_name': 'volume-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:36:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ba7fc7bc-b9d8-4b1d-8377-533933e4fdb3 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07dcdd89-f803-4696-9328-00aa52306242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:36:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ba7fc7bc-b9d8-4b1d-8377-533933e4fdb3 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07dcdd89-f803-4696-9328-00aa52306242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:36:48 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ba7fc7bc-b9d8-4b1d-8377-533933e4fdb3 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edbf9dc2-ee0b-4a68-a266-20ce5a6b28b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:36:48 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-ba7fc7bc-b9d8-4b1d-8377-533933e4fdb3 tempest-ProjectMemberTests-117232865 None] Volume cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76', 'volume_size': 1} Jul 07 08:36:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ba7fc7bc-b9d8-4b1d-8377-533933e4fdb3 tempest-ProjectMemberTests-117232865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:36:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ba7fc7bc-b9d8-4b1d-8377-533933e4fdb3 tempest-ProjectMemberTests-117232865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:36:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ba7fc7bc-b9d8-4b1d-8377-533933e4fdb3 tempest-ProjectMemberTests-117232865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1383347950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac2688c9df5545018de78c47a9e5a401',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:36:48Z,use_quota=True,user_id='11de70d1cfa0463dbad27ce8dcab2b39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:36:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-ba7fc7bc-b9d8-4b1d-8377-533933e4fdb3 tempest-ProjectMemberTests-117232865 None] Creating volume cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:36:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ba7fc7bc-b9d8-4b1d-8377-533933e4fdb3 tempest-ProjectMemberTests-117232865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:36:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ba7fc7bc-b9d8-4b1d-8377-533933e4fdb3 tempest-ProjectMemberTests-117232865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:36:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ba7fc7bc-b9d8-4b1d-8377-533933e4fdb3 tempest-ProjectMemberTests-117232865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:36:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ba7fc7bc-b9d8-4b1d-8377-533933e4fdb3 tempest-ProjectMemberTests-117232865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:36:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ba7fc7bc-b9d8-4b1d-8377-533933e4fdb3 tempest-ProjectMemberTests-117232865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:36:48 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ba7fc7bc-b9d8-4b1d-8377-533933e4fdb3 tempest-ProjectMemberTests-117232865 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:36:48 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-ba7fc7bc-b9d8-4b1d-8377-533933e4fdb3 tempest-ProjectMemberTests-117232865 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:36:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ba7fc7bc-b9d8-4b1d-8377-533933e4fdb3 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:48 devstack sudo[106001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76 1073741824 Jul 07 08:36:48 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:49 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ba7fc7bc-b9d8-4b1d-8377-533933e4fdb3 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76 1073741824" returned: 0 in 0.960s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ba7fc7bc-b9d8-4b1d-8377-533933e4fdb3 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:49 devstack sudo[106007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76 Jul 07 08:36:49 devstack sudo[106007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:50 devstack sudo[106007]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ba7fc7bc-b9d8-4b1d-8377-533933e4fdb3 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76" returned: 0 in 0.816s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:50 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ba7fc7bc-b9d8-4b1d-8377-533933e4fdb3 tempest-ProjectMemberTests-117232865 None] <== create_volume: return (1847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:36:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ba7fc7bc-b9d8-4b1d-8377-533933e4fdb3 tempest-ProjectMemberTests-117232865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.850s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:36:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ba7fc7bc-b9d8-4b1d-8377-533933e4fdb3 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edbf9dc2-ee0b-4a68-a266-20ce5a6b28b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:36:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ba7fc7bc-b9d8-4b1d-8377-533933e4fdb3 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9daa4c6c-4e52-4f05-af21-53b12e62ade1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:36:50 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-ba7fc7bc-b9d8-4b1d-8377-533933e4fdb3 tempest-ProjectMemberTests-117232865 None] Volume volume-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76 (cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76): created successfully Jul 07 08:36:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ba7fc7bc-b9d8-4b1d-8377-533933e4fdb3 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9daa4c6c-4e52-4f05-af21-53b12e62ade1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:36:50 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ba7fc7bc-b9d8-4b1d-8377-533933e4fdb3 tempest-ProjectMemberTests-117232865 None] Flow 'volume_create_manager' (c0005484-cbf7-456d-a66a-2a85e307dd25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:36:50 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-ba7fc7bc-b9d8-4b1d-8377-533933e4fdb3 tempest-ProjectMemberTests-117232865 None] Created volume successfully. Jul 07 08:36:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c791940a-9e64-4548-9b6c-d710a91f2181 tempest-ProjectMemberTests-117232865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:36:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c791940a-9e64-4548-9b6c-d710a91f2181 tempest-ProjectMemberTests-117232865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:36:51 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-c791940a-9e64-4548-9b6c-d710a91f2181 tempest-ProjectMemberTests-117232865 None] Creating offline snapshot acb099e7-c8f7-4430-88a6-eda1f7c04a21 of volume cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76 {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:36:51 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e3abac-b68f-4531-9185-92eec3b971db]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:36:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c791940a-9e64-4548-9b6c-d710a91f2181 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:51 devstack sudo[106011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76 Jul 07 08:36:51 devstack sudo[106011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:52 devstack sudo[106011]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c791940a-9e64-4548-9b6c-d710a91f2181 tempest-ProjectMemberTests-117232865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76" returned: 0 in 0.868s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c791940a-9e64-4548-9b6c-d710a91f2181 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76.acb099e7-c8f7-4430-88a6-eda1f7c04a21 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:52 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76.acb099e7-c8f7-4430-88a6-eda1f7c04a21 1G Jul 07 08:36:52 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:53 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c791940a-9e64-4548-9b6c-d710a91f2181 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76.acb099e7-c8f7-4430-88a6-eda1f7c04a21 1G" returned: 0 in 0.859s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c791940a-9e64-4548-9b6c-d710a91f2181 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76.acb099e7-c8f7-4430-88a6-eda1f7c04a21 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:53 devstack sudo[106023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76.acb099e7-c8f7-4430-88a6-eda1f7c04a21 Jul 07 08:36:53 devstack sudo[106023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:54 devstack sudo[106023]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c791940a-9e64-4548-9b6c-d710a91f2181 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76.acb099e7-c8f7-4430-88a6-eda1f7c04a21" returned: 0 in 0.751s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:54 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-c791940a-9e64-4548-9b6c-d710a91f2181 tempest-ProjectMemberTests-117232865 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76.acb099e7-c8f7-4430-88a6-eda1f7c04a21 is being set with open permissions: ugo+rw Jul 07 08:36:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c791940a-9e64-4548-9b6c-d710a91f2181 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76.acb099e7-c8f7-4430-88a6-eda1f7c04a21 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:54 devstack sudo[106028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76.acb099e7-c8f7-4430-88a6-eda1f7c04a21 Jul 07 08:36:54 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:54 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c791940a-9e64-4548-9b6c-d710a91f2181 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76.acb099e7-c8f7-4430-88a6-eda1f7c04a21" returned: 0 in 0.658s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c791940a-9e64-4548-9b6c-d710a91f2181 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:54 devstack sudo[106031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76.info Jul 07 08:36:54 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:55 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c791940a-9e64-4548-9b6c-d710a91f2181 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76.info" returned: 0 in 0.674s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:55 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-c791940a-9e64-4548-9b6c-d710a91f2181 tempest-ProjectMemberTests-117232865 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76.info is being set with open permissions: ugo+rw Jul 07 08:36:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c791940a-9e64-4548-9b6c-d710a91f2181 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:55 devstack sudo[106034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76.info Jul 07 08:36:55 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:56 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c791940a-9e64-4548-9b6c-d710a91f2181 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76.info" returned: 0 in 0.691s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c791940a-9e64-4548-9b6c-d710a91f2181 tempest-ProjectMemberTests-117232865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.598s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:36:56 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-c791940a-9e64-4548-9b6c-d710a91f2181 tempest-ProjectMemberTests-117232865 None] Create snapshot completed successfully Jul 07 08:36:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4738b1b0-5c55-4615-bc6c-cd53503a44cf tempest-ProjectMemberTests-117232865 None] Acquiring lock "cinder-acb099e7-c8f7-4430-88a6-eda1f7c04a21-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:36:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4738b1b0-5c55-4615-bc6c-cd53503a44cf tempest-ProjectMemberTests-117232865 None] Lock "cinder-acb099e7-c8f7-4430-88a6-eda1f7c04a21-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:36:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4738b1b0-5c55-4615-bc6c-cd53503a44cf tempest-ProjectMemberTests-117232865 None] Acquiring lock "cinder-quobyte-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:36:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4738b1b0-5c55-4615-bc6c-cd53503a44cf tempest-ProjectMemberTests-117232865 None] Lock "cinder-quobyte-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:36:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4738b1b0-5c55-4615-bc6c-cd53503a44cf tempest-ProjectMemberTests-117232865 None] Acquiring lock "cinder-quobyte-acb099e7-c8f7-4430-88a6-eda1f7c04a21" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:36:56 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4738b1b0-5c55-4615-bc6c-cd53503a44cf tempest-ProjectMemberTests-117232865 None] Lock "cinder-quobyte-acb099e7-c8f7-4430-88a6-eda1f7c04a21" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:36:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-4738b1b0-5c55-4615-bc6c-cd53503a44cf tempest-ProjectMemberTests-117232865 None] Deleting offline snapshot acb099e7-c8f7-4430-88a6-eda1f7c04a21 of volume cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:36:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-4738b1b0-5c55-4615-bc6c-cd53503a44cf tempest-ProjectMemberTests-117232865 None] snapshot_file for this snap is: volume-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76.acb099e7-c8f7-4430-88a6-eda1f7c04a21 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:36:57 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eeb45d3-c4a8-4421-bfeb-c39a1f0c239b]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:36:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4738b1b0-5c55-4615-bc6c-cd53503a44cf tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76.acb099e7-c8f7-4430-88a6-eda1f7c04a21 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:57 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76.acb099e7-c8f7-4430-88a6-eda1f7c04a21 Jul 07 08:36:57 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:57 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4738b1b0-5c55-4615-bc6c-cd53503a44cf tempest-ProjectMemberTests-117232865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76.acb099e7-c8f7-4430-88a6-eda1f7c04a21" returned: 0 in 0.829s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:57 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-4738b1b0-5c55-4615-bc6c-cd53503a44cf tempest-ProjectMemberTests-117232865 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:36:57 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d007a0d-7646-4fb6-b5b7-9e2e9186c382]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:36:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4738b1b0-5c55-4615-bc6c-cd53503a44cf tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:58 devstack sudo[106043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76 Jul 07 08:36:58 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:58 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4738b1b0-5c55-4615-bc6c-cd53503a44cf tempest-ProjectMemberTests-117232865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76" returned: 0 in 0.775s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4738b1b0-5c55-4615-bc6c-cd53503a44cf tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76.acb099e7-c8f7-4430-88a6-eda1f7c04a21 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:58 devstack sudo[106048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76.acb099e7-c8f7-4430-88a6-eda1f7c04a21 Jul 07 08:36:58 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:59 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4738b1b0-5c55-4615-bc6c-cd53503a44cf tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76.acb099e7-c8f7-4430-88a6-eda1f7c04a21" returned: 0 in 0.764s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4738b1b0-5c55-4615-bc6c-cd53503a44cf tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76.acb099e7-c8f7-4430-88a6-eda1f7c04a21 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:59 devstack sudo[106055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76.acb099e7-c8f7-4430-88a6-eda1f7c04a21 Jul 07 08:36:59 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:00 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4738b1b0-5c55-4615-bc6c-cd53503a44cf tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76.acb099e7-c8f7-4430-88a6-eda1f7c04a21" returned: 0 in 0.710s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:00 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4738b1b0-5c55-4615-bc6c-cd53503a44cf tempest-ProjectMemberTests-117232865 None] Lock "cinder-quobyte-acb099e7-c8f7-4430-88a6-eda1f7c04a21" released by "_delete_snapshot" :: held 3.209s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:37:00 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4738b1b0-5c55-4615-bc6c-cd53503a44cf tempest-ProjectMemberTests-117232865 None] Lock "cinder-quobyte-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76" released by "delete_snapshot" :: held 3.234s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:37:00 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-4738b1b0-5c55-4615-bc6c-cd53503a44cf tempest-ProjectMemberTests-117232865 None] Created reservations ['93e1ee93-fd75-4ca7-8bea-0ed78edc83e9', '717648a4-13e8-4481-af93-5c74cb4c2941', '3b14313a-249b-41d7-9cc8-2fb8664e9e49', 'd797a96f-8ef1-48c5-9ac1-9c2ab7f10cf1'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:37:00 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-4738b1b0-5c55-4615-bc6c-cd53503a44cf tempest-ProjectMemberTests-117232865 None] Delete snapshot completed successfully. Jul 07 08:37:00 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-4738b1b0-5c55-4615-bc6c-cd53503a44cf tempest-ProjectMemberTests-117232865 None] Lock "cinder-acb099e7-c8f7-4430-88a6-eda1f7c04a21-delete_snapshot" released by "delete_snapshot" :: held 3.398s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:37:01 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-20a695db-d8fc-4058-85b4-6fa17fb19590 tempest-ProjectMemberTests-117232865 None] Acquiring lock "cinder-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:37:01 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-20a695db-d8fc-4058-85b4-6fa17fb19590 tempest-ProjectMemberTests-117232865 None] Lock "cinder-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:37:01 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-20a695db-d8fc-4058-85b4-6fa17fb19590 tempest-ProjectMemberTests-117232865 None] Acquiring lock "cinder-quobyte-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:37:01 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-20a695db-d8fc-4058-85b4-6fa17fb19590 tempest-ProjectMemberTests-117232865 None] Lock "cinder-quobyte-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76" acquired by "delete_volume" :: waited 0.017s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:37:01 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf04457-45f0-4928-af5b-f688b6249aa3]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:37:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-20a695db-d8fc-4058-85b4-6fa17fb19590 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:01 devstack sudo[106059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76 Jul 07 08:37:01 devstack sudo[106059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:02 devstack sudo[106059]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-20a695db-d8fc-4058-85b4-6fa17fb19590 tempest-ProjectMemberTests-117232865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76" returned: 0 in 0.779s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-20a695db-d8fc-4058-85b4-6fa17fb19590 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:02 devstack sudo[106066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76 Jul 07 08:37:02 devstack sudo[106066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:02 devstack sudo[106066]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-20a695db-d8fc-4058-85b4-6fa17fb19590 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76" returned: 0 in 0.845s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:02 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-20a695db-d8fc-4058-85b4-6fa17fb19590 tempest-ProjectMemberTests-117232865 None] Lock "cinder-quobyte-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76" released by "delete_volume" :: held 1.683s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:37:03 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-20a695db-d8fc-4058-85b4-6fa17fb19590 tempest-ProjectMemberTests-117232865 None] Created reservations ['cf144579-8222-4a2f-9327-7fc13eaa2858', '52157f2a-9c4f-4a30-9ff8-3e7a3b9a7491', '53f59b29-ee98-47a6-ac74-0ef2218a3b1c', '24da3e39-a0dd-4de3-b6f3-91ca63c37e26'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:37:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-20a695db-d8fc-4058-85b4-6fa17fb19590 tempest-ProjectMemberTests-117232865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-20a695db-d8fc-4058-85b4-6fa17fb19590 tempest-ProjectMemberTests-117232865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-20a695db-d8fc-4058-85b4-6fa17fb19590 tempest-ProjectMemberTests-117232865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:37:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-20a695db-d8fc-4058-85b4-6fa17fb19590 tempest-ProjectMemberTests-117232865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:37:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-20a695db-d8fc-4058-85b4-6fa17fb19590 tempest-ProjectMemberTests-117232865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-20a695db-d8fc-4058-85b4-6fa17fb19590 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:03 devstack sudo[106069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:37:03 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:03 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-a42ca398-918e-4a5a-b004-86e76253e1e8 tempest-SnapshotDependencyTests-1050075905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:37:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a42ca398-918e-4a5a-b004-86e76253e1e8 tempest-SnapshotDependencyTests-1050075905 None] Flow 'volume_create_manager' (f6d17cbb-0af5-44be-9223-24fc89165e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:37:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a42ca398-918e-4a5a-b004-86e76253e1e8 tempest-SnapshotDependencyTests-1050075905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb1b0bf5-033b-46a8-ab04-4308716b0e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:03 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-20a695db-d8fc-4058-85b4-6fa17fb19590 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.736s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:03 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-20a695db-d8fc-4058-85b4-6fa17fb19590 tempest-ProjectMemberTests-117232865 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:37:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a42ca398-918e-4a5a-b004-86e76253e1e8 tempest-SnapshotDependencyTests-1050075905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb1b0bf5-033b-46a8-ab04-4308716b0e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2042709823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12682f3b-7ff8-40a7-a091-6907af0323da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fb85f5294f34f30a426852c7daa5ff5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:37:04Z,use_quota=True,user_id='54e77365963e4203a9b88f8378d54d39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a42ca398-918e-4a5a-b004-86e76253e1e8 tempest-SnapshotDependencyTests-1050075905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (365db83e-1f7a-42f0-b19b-abc6d23c661b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a42ca398-918e-4a5a-b004-86e76253e1e8 tempest-SnapshotDependencyTests-1050075905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (365db83e-1f7a-42f0-b19b-abc6d23c661b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a42ca398-918e-4a5a-b004-86e76253e1e8 tempest-SnapshotDependencyTests-1050075905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b9d08f4-f3bb-4091-be8b-e165dbe15c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a42ca398-918e-4a5a-b004-86e76253e1e8 tempest-SnapshotDependencyTests-1050075905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b9d08f4-f3bb-4091-be8b-e165dbe15c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12682f3b-7ff8-40a7-a091-6907af0323da', 'volume_name': 'volume-12682f3b-7ff8-40a7-a091-6907af0323da', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a42ca398-918e-4a5a-b004-86e76253e1e8 tempest-SnapshotDependencyTests-1050075905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a21bd29e-e61d-4a60-a01c-41990e725000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a42ca398-918e-4a5a-b004-86e76253e1e8 tempest-SnapshotDependencyTests-1050075905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a21bd29e-e61d-4a60-a01c-41990e725000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a42ca398-918e-4a5a-b004-86e76253e1e8 tempest-SnapshotDependencyTests-1050075905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (571bf4f0-00c0-4dc9-8953-9feaf3bca297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:03 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-a42ca398-918e-4a5a-b004-86e76253e1e8 tempest-SnapshotDependencyTests-1050075905 None] Volume 12682f3b-7ff8-40a7-a091-6907af0323da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12682f3b-7ff8-40a7-a091-6907af0323da', 'volume_size': 1} Jul 07 08:37:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a42ca398-918e-4a5a-b004-86e76253e1e8 tempest-SnapshotDependencyTests-1050075905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a42ca398-918e-4a5a-b004-86e76253e1e8 tempest-SnapshotDependencyTests-1050075905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a42ca398-918e-4a5a-b004-86e76253e1e8 tempest-SnapshotDependencyTests-1050075905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2042709823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12682f3b-7ff8-40a7-a091-6907af0323da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fb85f5294f34f30a426852c7daa5ff5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:37:04Z,use_quota=True,user_id='54e77365963e4203a9b88f8378d54d39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:37:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-a42ca398-918e-4a5a-b004-86e76253e1e8 tempest-SnapshotDependencyTests-1050075905 None] Creating volume 12682f3b-7ff8-40a7-a091-6907af0323da {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:37:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a42ca398-918e-4a5a-b004-86e76253e1e8 tempest-SnapshotDependencyTests-1050075905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a42ca398-918e-4a5a-b004-86e76253e1e8 tempest-SnapshotDependencyTests-1050075905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a42ca398-918e-4a5a-b004-86e76253e1e8 tempest-SnapshotDependencyTests-1050075905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:37:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a42ca398-918e-4a5a-b004-86e76253e1e8 tempest-SnapshotDependencyTests-1050075905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:37:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a42ca398-918e-4a5a-b004-86e76253e1e8 tempest-SnapshotDependencyTests-1050075905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:03 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a42ca398-918e-4a5a-b004-86e76253e1e8 tempest-SnapshotDependencyTests-1050075905 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:37:03 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-a42ca398-918e-4a5a-b004-86e76253e1e8 tempest-SnapshotDependencyTests-1050075905 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:37:03 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a42ca398-918e-4a5a-b004-86e76253e1e8 tempest-SnapshotDependencyTests-1050075905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12682f3b-7ff8-40a7-a091-6907af0323da 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:03 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-20a695db-d8fc-4058-85b4-6fa17fb19590 tempest-ProjectMemberTests-117232865 None] Deleted volume successfully. Jul 07 08:37:03 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12682f3b-7ff8-40a7-a091-6907af0323da 1073741824 Jul 07 08:37:03 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:03 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-20a695db-d8fc-4058-85b4-6fa17fb19590 tempest-ProjectMemberTests-117232865 None] Lock "cinder-cb8895f0-7cbc-4eb2-83cd-cc4bdf30dd76-delete_volume" released by "delete_volume" :: held 2.679s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:37:03 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-78dc1b8e-a113-494d-830b-cf9024c88a24 tempest-ProjectMemberTests-117232865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:37:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-78dc1b8e-a113-494d-830b-cf9024c88a24 tempest-ProjectMemberTests-117232865 None] Flow 'volume_create_manager' (bae8e761-4158-4e01-a50c-3f52848b555d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:37:03 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-78dc1b8e-a113-494d-830b-cf9024c88a24 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa352a82-1d32-4cb1-a741-a128232ee61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-78dc1b8e-a113-494d-830b-cf9024c88a24 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa352a82-1d32-4cb1-a741-a128232ee61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:37:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1096556681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe7fb200-85f0-4bcb-be09-cfef6692f8f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac2688c9df5545018de78c47a9e5a401',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:37:04Z,use_quota=True,user_id='11de70d1cfa0463dbad27ce8dcab2b39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-78dc1b8e-a113-494d-830b-cf9024c88a24 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1b91f2e-a470-48ef-871a-a9d41780184f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-78dc1b8e-a113-494d-830b-cf9024c88a24 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1b91f2e-a470-48ef-871a-a9d41780184f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-78dc1b8e-a113-494d-830b-cf9024c88a24 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6600ddc5-d01c-4358-ae30-837bbf3a8833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-78dc1b8e-a113-494d-830b-cf9024c88a24 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6600ddc5-d01c-4358-ae30-837bbf3a8833) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe7fb200-85f0-4bcb-be09-cfef6692f8f0', 'volume_name': 'volume-fe7fb200-85f0-4bcb-be09-cfef6692f8f0', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-78dc1b8e-a113-494d-830b-cf9024c88a24 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f9c500f-ca41-45e7-83f8-0b6f38b0a067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-78dc1b8e-a113-494d-830b-cf9024c88a24 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f9c500f-ca41-45e7-83f8-0b6f38b0a067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:04 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-78dc1b8e-a113-494d-830b-cf9024c88a24 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72e36523-6b4b-4f49-a740-a227df1e1227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:04 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-78dc1b8e-a113-494d-830b-cf9024c88a24 tempest-ProjectMemberTests-117232865 None] Volume fe7fb200-85f0-4bcb-be09-cfef6692f8f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe7fb200-85f0-4bcb-be09-cfef6692f8f0', 'volume_size': 1} Jul 07 08:37:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-78dc1b8e-a113-494d-830b-cf9024c88a24 tempest-ProjectMemberTests-117232865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:04 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a42ca398-918e-4a5a-b004-86e76253e1e8 tempest-SnapshotDependencyTests-1050075905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12682f3b-7ff8-40a7-a091-6907af0323da 1073741824" returned: 0 in 0.813s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a42ca398-918e-4a5a-b004-86e76253e1e8 tempest-SnapshotDependencyTests-1050075905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12682f3b-7ff8-40a7-a091-6907af0323da {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:04 devstack sudo[106078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12682f3b-7ff8-40a7-a091-6907af0323da Jul 07 08:37:04 devstack sudo[106078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:05 devstack sudo[106078]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-a42ca398-918e-4a5a-b004-86e76253e1e8 tempest-SnapshotDependencyTests-1050075905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12682f3b-7ff8-40a7-a091-6907af0323da" returned: 0 in 0.667s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-a42ca398-918e-4a5a-b004-86e76253e1e8 tempest-SnapshotDependencyTests-1050075905 None] <== create_volume: return (1521ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:37:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-a42ca398-918e-4a5a-b004-86e76253e1e8 tempest-SnapshotDependencyTests-1050075905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-78dc1b8e-a113-494d-830b-cf9024c88a24 tempest-ProjectMemberTests-117232865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.341s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-78dc1b8e-a113-494d-830b-cf9024c88a24 tempest-ProjectMemberTests-117232865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:37:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1096556681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe7fb200-85f0-4bcb-be09-cfef6692f8f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac2688c9df5545018de78c47a9e5a401',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:37:04Z,use_quota=True,user_id='11de70d1cfa0463dbad27ce8dcab2b39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:37:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-78dc1b8e-a113-494d-830b-cf9024c88a24 tempest-ProjectMemberTests-117232865 None] Creating volume fe7fb200-85f0-4bcb-be09-cfef6692f8f0 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:37:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-78dc1b8e-a113-494d-830b-cf9024c88a24 tempest-ProjectMemberTests-117232865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-78dc1b8e-a113-494d-830b-cf9024c88a24 tempest-ProjectMemberTests-117232865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-78dc1b8e-a113-494d-830b-cf9024c88a24 tempest-ProjectMemberTests-117232865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:37:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-78dc1b8e-a113-494d-830b-cf9024c88a24 tempest-ProjectMemberTests-117232865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:37:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-78dc1b8e-a113-494d-830b-cf9024c88a24 tempest-ProjectMemberTests-117232865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-78dc1b8e-a113-494d-830b-cf9024c88a24 tempest-ProjectMemberTests-117232865 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:37:05 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-78dc1b8e-a113-494d-830b-cf9024c88a24 tempest-ProjectMemberTests-117232865 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:37:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-78dc1b8e-a113-494d-830b-cf9024c88a24 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fe7fb200-85f0-4bcb-be09-cfef6692f8f0 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:05 devstack sudo[106081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fe7fb200-85f0-4bcb-be09-cfef6692f8f0 1073741824 Jul 07 08:37:05 devstack sudo[106081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a42ca398-918e-4a5a-b004-86e76253e1e8 tempest-SnapshotDependencyTests-1050075905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (571bf4f0-00c0-4dc9-8953-9feaf3bca297) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12682f3b-7ff8-40a7-a091-6907af0323da', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a42ca398-918e-4a5a-b004-86e76253e1e8 tempest-SnapshotDependencyTests-1050075905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e337b64-a2e3-4e98-aa5f-414af7202e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:05 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-a42ca398-918e-4a5a-b004-86e76253e1e8 tempest-SnapshotDependencyTests-1050075905 None] Volume volume-12682f3b-7ff8-40a7-a091-6907af0323da (12682f3b-7ff8-40a7-a091-6907af0323da): created successfully Jul 07 08:37:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a42ca398-918e-4a5a-b004-86e76253e1e8 tempest-SnapshotDependencyTests-1050075905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e337b64-a2e3-4e98-aa5f-414af7202e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:05 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-a42ca398-918e-4a5a-b004-86e76253e1e8 tempest-SnapshotDependencyTests-1050075905 None] Flow 'volume_create_manager' (f6d17cbb-0af5-44be-9223-24fc89165e83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:37:05 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-a42ca398-918e-4a5a-b004-86e76253e1e8 tempest-SnapshotDependencyTests-1050075905 None] Created volume successfully. Jul 07 08:37:05 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:UPDATE=114,cinder:SELECT=77,cinder:INSERT=25,cinder:DELETE=11 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:37:05 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:37:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:37:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:37:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:05 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:37:05 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:06 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=85,cinder:INSERT=33,cinder:UPDATE=103,cinder:DELETE=6 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:37:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-01a1021c-7c4b-4c56-8b83-1dc1bd824377 tempest-SnapshotDependencyTests-1050075905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:06 devstack sudo[106081]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-78dc1b8e-a113-494d-830b-cf9024c88a24 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fe7fb200-85f0-4bcb-be09-cfef6692f8f0 1073741824" returned: 0 in 0.894s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-78dc1b8e-a113-494d-830b-cf9024c88a24 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fe7fb200-85f0-4bcb-be09-cfef6692f8f0 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:06 devstack sudo[106089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fe7fb200-85f0-4bcb-be09-cfef6692f8f0 Jul 07 08:37:06 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:06 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.717s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:06 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:37:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running periodic task VolumeManager._thread_info {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:37:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] thread count: 29 {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 08:37:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] thread info: [<_MainThread(MainThread, started 133056092332160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 08:37:06 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-78dc1b8e-a113-494d-830b-cf9024c88a24 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fe7fb200-85f0-4bcb-be09-cfef6692f8f0" returned: 0 in 0.661s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-78dc1b8e-a113-494d-830b-cf9024c88a24 tempest-ProjectMemberTests-117232865 None] <== create_volume: return (1593ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:37:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-78dc1b8e-a113-494d-830b-cf9024c88a24 tempest-ProjectMemberTests-117232865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.596s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-01a1021c-7c4b-4c56-8b83-1dc1bd824377 tempest-SnapshotDependencyTests-1050075905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.897s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-01a1021c-7c4b-4c56-8b83-1dc1bd824377 tempest-SnapshotDependencyTests-1050075905 None] Creating offline snapshot f51d4090-0e35-42c5-baaf-a8b0afec7207 of volume 12682f3b-7ff8-40a7-a091-6907af0323da {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:37:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-78dc1b8e-a113-494d-830b-cf9024c88a24 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72e36523-6b4b-4f49-a740-a227df1e1227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe7fb200-85f0-4bcb-be09-cfef6692f8f0', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-78dc1b8e-a113-494d-830b-cf9024c88a24 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3fb1d72-bea2-4462-8524-94827eb4e7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:07 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ffd0ff8-d524-4418-ad63-a300a8afd642]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:37:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-01a1021c-7c4b-4c56-8b83-1dc1bd824377 tempest-SnapshotDependencyTests-1050075905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12682f3b-7ff8-40a7-a091-6907af0323da {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:07 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-78dc1b8e-a113-494d-830b-cf9024c88a24 tempest-ProjectMemberTests-117232865 None] Volume volume-fe7fb200-85f0-4bcb-be09-cfef6692f8f0 (fe7fb200-85f0-4bcb-be09-cfef6692f8f0): created successfully Jul 07 08:37:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-78dc1b8e-a113-494d-830b-cf9024c88a24 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3fb1d72-bea2-4462-8524-94827eb4e7a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:07 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-78dc1b8e-a113-494d-830b-cf9024c88a24 tempest-ProjectMemberTests-117232865 None] Flow 'volume_create_manager' (bae8e761-4158-4e01-a50c-3f52848b555d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:37:07 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-78dc1b8e-a113-494d-830b-cf9024c88a24 tempest-ProjectMemberTests-117232865 None] Created volume successfully. Jul 07 08:37:07 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12682f3b-7ff8-40a7-a091-6907af0323da Jul 07 08:37:07 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:07 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-01a1021c-7c4b-4c56-8b83-1dc1bd824377 tempest-SnapshotDependencyTests-1050075905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12682f3b-7ff8-40a7-a091-6907af0323da" returned: 0 in 0.742s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-01a1021c-7c4b-4c56-8b83-1dc1bd824377 tempest-SnapshotDependencyTests-1050075905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12682f3b-7ff8-40a7-a091-6907af0323da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12682f3b-7ff8-40a7-a091-6907af0323da.f51d4090-0e35-42c5-baaf-a8b0afec7207 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:07 devstack sudo[106098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12682f3b-7ff8-40a7-a091-6907af0323da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12682f3b-7ff8-40a7-a091-6907af0323da.f51d4090-0e35-42c5-baaf-a8b0afec7207 1G Jul 07 08:37:07 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-64cc2b8b-a264-4da5-bcce-9f8d5fa3b5f3 tempest-ProjectMemberTests-117232865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:08 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-01a1021c-7c4b-4c56-8b83-1dc1bd824377 tempest-SnapshotDependencyTests-1050075905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12682f3b-7ff8-40a7-a091-6907af0323da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12682f3b-7ff8-40a7-a091-6907af0323da.f51d4090-0e35-42c5-baaf-a8b0afec7207 1G" returned: 0 in 0.819s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:08 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-01a1021c-7c4b-4c56-8b83-1dc1bd824377 tempest-SnapshotDependencyTests-1050075905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12682f3b-7ff8-40a7-a091-6907af0323da -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12682f3b-7ff8-40a7-a091-6907af0323da.f51d4090-0e35-42c5-baaf-a8b0afec7207 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:08 devstack sudo[106103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12682f3b-7ff8-40a7-a091-6907af0323da -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12682f3b-7ff8-40a7-a091-6907af0323da.f51d4090-0e35-42c5-baaf-a8b0afec7207 Jul 07 08:37:08 devstack sudo[106103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:09 devstack sudo[106103]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-01a1021c-7c4b-4c56-8b83-1dc1bd824377 tempest-SnapshotDependencyTests-1050075905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12682f3b-7ff8-40a7-a091-6907af0323da -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12682f3b-7ff8-40a7-a091-6907af0323da.f51d4090-0e35-42c5-baaf-a8b0afec7207" returned: 0 in 0.652s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:09 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-01a1021c-7c4b-4c56-8b83-1dc1bd824377 tempest-SnapshotDependencyTests-1050075905 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12682f3b-7ff8-40a7-a091-6907af0323da.f51d4090-0e35-42c5-baaf-a8b0afec7207 is being set with open permissions: ugo+rw Jul 07 08:37:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-01a1021c-7c4b-4c56-8b83-1dc1bd824377 tempest-SnapshotDependencyTests-1050075905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12682f3b-7ff8-40a7-a091-6907af0323da.f51d4090-0e35-42c5-baaf-a8b0afec7207 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:09 devstack sudo[106108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12682f3b-7ff8-40a7-a091-6907af0323da.f51d4090-0e35-42c5-baaf-a8b0afec7207 Jul 07 08:37:09 devstack sudo[106108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:09 devstack sudo[106108]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-01a1021c-7c4b-4c56-8b83-1dc1bd824377 tempest-SnapshotDependencyTests-1050075905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12682f3b-7ff8-40a7-a091-6907af0323da.f51d4090-0e35-42c5-baaf-a8b0afec7207" returned: 0 in 0.615s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:09 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-01a1021c-7c4b-4c56-8b83-1dc1bd824377 tempest-SnapshotDependencyTests-1050075905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12682f3b-7ff8-40a7-a091-6907af0323da.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:09 devstack sudo[106111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12682f3b-7ff8-40a7-a091-6907af0323da.info Jul 07 08:37:09 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:10 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-01a1021c-7c4b-4c56-8b83-1dc1bd824377 tempest-SnapshotDependencyTests-1050075905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12682f3b-7ff8-40a7-a091-6907af0323da.info" returned: 0 in 0.621s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:10 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-01a1021c-7c4b-4c56-8b83-1dc1bd824377 tempest-SnapshotDependencyTests-1050075905 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12682f3b-7ff8-40a7-a091-6907af0323da.info is being set with open permissions: ugo+rw Jul 07 08:37:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-01a1021c-7c4b-4c56-8b83-1dc1bd824377 tempest-SnapshotDependencyTests-1050075905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12682f3b-7ff8-40a7-a091-6907af0323da.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:10 devstack sudo[106114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12682f3b-7ff8-40a7-a091-6907af0323da.info Jul 07 08:37:10 devstack sudo[106114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:11 devstack sudo[106114]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-01a1021c-7c4b-4c56-8b83-1dc1bd824377 tempest-SnapshotDependencyTests-1050075905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12682f3b-7ff8-40a7-a091-6907af0323da.info" returned: 0 in 0.606s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-01a1021c-7c4b-4c56-8b83-1dc1bd824377 tempest-SnapshotDependencyTests-1050075905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.148s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-64cc2b8b-a264-4da5-bcce-9f8d5fa3b5f3 tempest-ProjectMemberTests-117232865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.756s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:11 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-64cc2b8b-a264-4da5-bcce-9f8d5fa3b5f3 tempest-ProjectMemberTests-117232865 None] Creating offline snapshot 76a76e12-14cf-41ee-a119-84eb5a152099 of volume fe7fb200-85f0-4bcb-be09-cfef6692f8f0 {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:37:11 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-01a1021c-7c4b-4c56-8b83-1dc1bd824377 tempest-SnapshotDependencyTests-1050075905 None] Create snapshot completed successfully Jul 07 08:37:11 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27f0acd-2bea-46e7-b743-feccd34bb741]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:37:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-64cc2b8b-a264-4da5-bcce-9f8d5fa3b5f3 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fe7fb200-85f0-4bcb-be09-cfef6692f8f0 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:11 devstack sudo[106117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fe7fb200-85f0-4bcb-be09-cfef6692f8f0 Jul 07 08:37:11 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:11 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-41d99a60-a4b9-40eb-aa0c-9d69d83f75c6 tempest-SnapshotDependencyTests-1050075905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:37:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-41d99a60-a4b9-40eb-aa0c-9d69d83f75c6 tempest-SnapshotDependencyTests-1050075905 None] Flow 'volume_create_manager' (ac9633dc-1578-4df9-88cc-fa5f4178f493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:37:11 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-41d99a60-a4b9-40eb-aa0c-9d69d83f75c6 tempest-SnapshotDependencyTests-1050075905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13a03c69-58a6-41d3-b1ae-2346a47d805b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-64cc2b8b-a264-4da5-bcce-9f8d5fa3b5f3 tempest-ProjectMemberTests-117232865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fe7fb200-85f0-4bcb-be09-cfef6692f8f0" returned: 0 in 0.775s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-64cc2b8b-a264-4da5-bcce-9f8d5fa3b5f3 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fe7fb200-85f0-4bcb-be09-cfef6692f8f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fe7fb200-85f0-4bcb-be09-cfef6692f8f0.76a76e12-14cf-41ee-a119-84eb5a152099 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:11 devstack sudo[106123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fe7fb200-85f0-4bcb-be09-cfef6692f8f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fe7fb200-85f0-4bcb-be09-cfef6692f8f0.76a76e12-14cf-41ee-a119-84eb5a152099 1G Jul 07 08:37:11 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-41d99a60-a4b9-40eb-aa0c-9d69d83f75c6 tempest-SnapshotDependencyTests-1050075905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13a03c69-58a6-41d3-b1ae-2346a47d805b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:37:12Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdd1c9fe-5de6-4528-a70c-434f177a2eda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fb85f5294f34f30a426852c7daa5ff5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:37:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f51d4090-0e35-42c5-baaf-a8b0afec7207,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:37:12Z,use_quota=True,user_id='54e77365963e4203a9b88f8378d54d39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-41d99a60-a4b9-40eb-aa0c-9d69d83f75c6 tempest-SnapshotDependencyTests-1050075905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d30e3a7a-3824-46f8-9394-c1c5cd356062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-41d99a60-a4b9-40eb-aa0c-9d69d83f75c6 tempest-SnapshotDependencyTests-1050075905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d30e3a7a-3824-46f8-9394-c1c5cd356062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-41d99a60-a4b9-40eb-aa0c-9d69d83f75c6 tempest-SnapshotDependencyTests-1050075905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31b1f929-b468-4ae6-90c3-ab2c5c6bdfcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-41d99a60-a4b9-40eb-aa0c-9d69d83f75c6 tempest-SnapshotDependencyTests-1050075905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31b1f929-b468-4ae6-90c3-ab2c5c6bdfcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bdd1c9fe-5de6-4528-a70c-434f177a2eda', 'volume_name': 'volume-bdd1c9fe-5de6-4528-a70c-434f177a2eda', 'volume_size': 1, 'snapshot_id': 'f51d4090-0e35-42c5-baaf-a8b0afec7207'}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-41d99a60-a4b9-40eb-aa0c-9d69d83f75c6 tempest-SnapshotDependencyTests-1050075905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (859663cc-c606-42be-8c88-97377aeb506e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-41d99a60-a4b9-40eb-aa0c-9d69d83f75c6 tempest-SnapshotDependencyTests-1050075905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (859663cc-c606-42be-8c88-97377aeb506e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:12 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-41d99a60-a4b9-40eb-aa0c-9d69d83f75c6 tempest-SnapshotDependencyTests-1050075905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7817046b-7717-44f9-aa9b-16c4406491d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:12 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-41d99a60-a4b9-40eb-aa0c-9d69d83f75c6 tempest-SnapshotDependencyTests-1050075905 None] Volume bdd1c9fe-5de6-4528-a70c-434f177a2eda: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bdd1c9fe-5de6-4528-a70c-434f177a2eda', 'volume_size': 1, 'snapshot_id': 'f51d4090-0e35-42c5-baaf-a8b0afec7207'} Jul 07 08:37:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-41d99a60-a4b9-40eb-aa0c-9d69d83f75c6 tempest-SnapshotDependencyTests-1050075905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:12 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-64cc2b8b-a264-4da5-bcce-9f8d5fa3b5f3 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fe7fb200-85f0-4bcb-be09-cfef6692f8f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fe7fb200-85f0-4bcb-be09-cfef6692f8f0.76a76e12-14cf-41ee-a119-84eb5a152099 1G" returned: 0 in 0.804s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-64cc2b8b-a264-4da5-bcce-9f8d5fa3b5f3 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe7fb200-85f0-4bcb-be09-cfef6692f8f0 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fe7fb200-85f0-4bcb-be09-cfef6692f8f0.76a76e12-14cf-41ee-a119-84eb5a152099 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:12 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe7fb200-85f0-4bcb-be09-cfef6692f8f0 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fe7fb200-85f0-4bcb-be09-cfef6692f8f0.76a76e12-14cf-41ee-a119-84eb5a152099 Jul 07 08:37:12 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:13 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-64cc2b8b-a264-4da5-bcce-9f8d5fa3b5f3 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe7fb200-85f0-4bcb-be09-cfef6692f8f0 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fe7fb200-85f0-4bcb-be09-cfef6692f8f0.76a76e12-14cf-41ee-a119-84eb5a152099" returned: 0 in 0.713s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:13 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-64cc2b8b-a264-4da5-bcce-9f8d5fa3b5f3 tempest-ProjectMemberTests-117232865 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fe7fb200-85f0-4bcb-be09-cfef6692f8f0.76a76e12-14cf-41ee-a119-84eb5a152099 is being set with open permissions: ugo+rw Jul 07 08:37:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-64cc2b8b-a264-4da5-bcce-9f8d5fa3b5f3 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fe7fb200-85f0-4bcb-be09-cfef6692f8f0.76a76e12-14cf-41ee-a119-84eb5a152099 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:13 devstack sudo[106133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fe7fb200-85f0-4bcb-be09-cfef6692f8f0.76a76e12-14cf-41ee-a119-84eb5a152099 Jul 07 08:37:13 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:14 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-64cc2b8b-a264-4da5-bcce-9f8d5fa3b5f3 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fe7fb200-85f0-4bcb-be09-cfef6692f8f0.76a76e12-14cf-41ee-a119-84eb5a152099" returned: 0 in 0.646s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-64cc2b8b-a264-4da5-bcce-9f8d5fa3b5f3 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fe7fb200-85f0-4bcb-be09-cfef6692f8f0.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:14 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fe7fb200-85f0-4bcb-be09-cfef6692f8f0.info Jul 07 08:37:14 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:14 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-64cc2b8b-a264-4da5-bcce-9f8d5fa3b5f3 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fe7fb200-85f0-4bcb-be09-cfef6692f8f0.info" returned: 0 in 0.667s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:14 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-64cc2b8b-a264-4da5-bcce-9f8d5fa3b5f3 tempest-ProjectMemberTests-117232865 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fe7fb200-85f0-4bcb-be09-cfef6692f8f0.info is being set with open permissions: ugo+rw Jul 07 08:37:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-64cc2b8b-a264-4da5-bcce-9f8d5fa3b5f3 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fe7fb200-85f0-4bcb-be09-cfef6692f8f0.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:14 devstack sudo[106139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fe7fb200-85f0-4bcb-be09-cfef6692f8f0.info Jul 07 08:37:14 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:15 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-64cc2b8b-a264-4da5-bcce-9f8d5fa3b5f3 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fe7fb200-85f0-4bcb-be09-cfef6692f8f0.info" returned: 0 in 0.621s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-64cc2b8b-a264-4da5-bcce-9f8d5fa3b5f3 tempest-ProjectMemberTests-117232865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.310s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-41d99a60-a4b9-40eb-aa0c-9d69d83f75c6 tempest-SnapshotDependencyTests-1050075905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.389s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-41d99a60-a4b9-40eb-aa0c-9d69d83f75c6 tempest-SnapshotDependencyTests-1050075905 None] Acquiring lock "cinder-quobyte-f51d4090-0e35-42c5-baaf-a8b0afec7207-bdd1c9fe-5de6-4528-a70c-434f177a2eda" by "_create_volume_from_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:37:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-41d99a60-a4b9-40eb-aa0c-9d69d83f75c6 tempest-SnapshotDependencyTests-1050075905 None] Lock "cinder-quobyte-f51d4090-0e35-42c5-baaf-a8b0afec7207-bdd1c9fe-5de6-4528-a70c-434f177a2eda" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:37:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-41d99a60-a4b9-40eb-aa0c-9d69d83f75c6 tempest-SnapshotDependencyTests-1050075905 None] Creating volume bdd1c9fe-5de6-4528-a70c-434f177a2eda from snapshot f51d4090-0e35-42c5-baaf-a8b0afec7207 {{(pid=87199) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 08:37:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-41d99a60-a4b9-40eb-aa0c-9d69d83f75c6 tempest-SnapshotDependencyTests-1050075905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-41d99a60-a4b9-40eb-aa0c-9d69d83f75c6 tempest-SnapshotDependencyTests-1050075905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-41d99a60-a4b9-40eb-aa0c-9d69d83f75c6 tempest-SnapshotDependencyTests-1050075905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:37:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-41d99a60-a4b9-40eb-aa0c-9d69d83f75c6 tempest-SnapshotDependencyTests-1050075905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:37:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-41d99a60-a4b9-40eb-aa0c-9d69d83f75c6 tempest-SnapshotDependencyTests-1050075905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-41d99a60-a4b9-40eb-aa0c-9d69d83f75c6 tempest-SnapshotDependencyTests-1050075905 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:37:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-41d99a60-a4b9-40eb-aa0c-9d69d83f75c6 tempest-SnapshotDependencyTests-1050075905 None] Acquiring lock "cinder-quobyte-bdd1c9fe-5de6-4528-a70c-434f177a2eda" by "_copy_volume_from_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:37:15 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-64cc2b8b-a264-4da5-bcce-9f8d5fa3b5f3 tempest-ProjectMemberTests-117232865 None] Create snapshot completed successfully Jul 07 08:37:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-41d99a60-a4b9-40eb-aa0c-9d69d83f75c6 tempest-SnapshotDependencyTests-1050075905 None] Lock "cinder-quobyte-bdd1c9fe-5de6-4528-a70c-434f177a2eda" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:37:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-41d99a60-a4b9-40eb-aa0c-9d69d83f75c6 tempest-SnapshotDependencyTests-1050075905 None] snapshot: f51d4090-0e35-42c5-baaf-a8b0afec7207, volume: bdd1c9fe-5de6-4528-a70c-434f177a2eda, {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 08:37:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-41d99a60-a4b9-40eb-aa0c-9d69d83f75c6 tempest-SnapshotDependencyTests-1050075905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-41d99a60-a4b9-40eb-aa0c-9d69d83f75c6 tempest-SnapshotDependencyTests-1050075905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-41d99a60-a4b9-40eb-aa0c-9d69d83f75c6 tempest-SnapshotDependencyTests-1050075905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:37:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-41d99a60-a4b9-40eb-aa0c-9d69d83f75c6 tempest-SnapshotDependencyTests-1050075905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:37:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-41d99a60-a4b9-40eb-aa0c-9d69d83f75c6 tempest-SnapshotDependencyTests-1050075905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:15 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94bf2eb-abac-4cbc-b3d8-fc9356450971]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:37:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-41d99a60-a4b9-40eb-aa0c-9d69d83f75c6 tempest-SnapshotDependencyTests-1050075905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12682f3b-7ff8-40a7-a091-6907af0323da.f51d4090-0e35-42c5-baaf-a8b0afec7207 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-41806c0c-945e-4e32-9814-79e01b554353 tempest-ProjectMemberTests-117232865 None] Acquiring lock "cinder-76a76e12-14cf-41ee-a119-84eb5a152099-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:37:15 devstack sudo[106142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12682f3b-7ff8-40a7-a091-6907af0323da.f51d4090-0e35-42c5-baaf-a8b0afec7207 Jul 07 08:37:15 devstack sudo[106142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-41806c0c-945e-4e32-9814-79e01b554353 tempest-ProjectMemberTests-117232865 None] Lock "cinder-76a76e12-14cf-41ee-a119-84eb5a152099-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:37:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-41806c0c-945e-4e32-9814-79e01b554353 tempest-ProjectMemberTests-117232865 None] Acquiring lock "cinder-quobyte-fe7fb200-85f0-4bcb-be09-cfef6692f8f0" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:37:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-41806c0c-945e-4e32-9814-79e01b554353 tempest-ProjectMemberTests-117232865 None] Lock "cinder-quobyte-fe7fb200-85f0-4bcb-be09-cfef6692f8f0" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:37:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-41806c0c-945e-4e32-9814-79e01b554353 tempest-ProjectMemberTests-117232865 None] Acquiring lock "cinder-quobyte-76a76e12-14cf-41ee-a119-84eb5a152099" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:37:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-41806c0c-945e-4e32-9814-79e01b554353 tempest-ProjectMemberTests-117232865 None] Lock "cinder-quobyte-76a76e12-14cf-41ee-a119-84eb5a152099" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:37:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-41806c0c-945e-4e32-9814-79e01b554353 tempest-ProjectMemberTests-117232865 None] Deleting offline snapshot 76a76e12-14cf-41ee-a119-84eb5a152099 of volume fe7fb200-85f0-4bcb-be09-cfef6692f8f0 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:37:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-41806c0c-945e-4e32-9814-79e01b554353 tempest-ProjectMemberTests-117232865 None] snapshot_file for this snap is: volume-fe7fb200-85f0-4bcb-be09-cfef6692f8f0.76a76e12-14cf-41ee-a119-84eb5a152099 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:37:15 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b2f957-ca96-4fec-8090-91d6667d4ddf]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:37:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-41806c0c-945e-4e32-9814-79e01b554353 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fe7fb200-85f0-4bcb-be09-cfef6692f8f0.76a76e12-14cf-41ee-a119-84eb5a152099 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:15 devstack sudo[106144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fe7fb200-85f0-4bcb-be09-cfef6692f8f0.76a76e12-14cf-41ee-a119-84eb5a152099 Jul 07 08:37:15 devstack sudo[106144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:16 devstack sudo[106142]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-41d99a60-a4b9-40eb-aa0c-9d69d83f75c6 tempest-SnapshotDependencyTests-1050075905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12682f3b-7ff8-40a7-a091-6907af0323da.f51d4090-0e35-42c5-baaf-a8b0afec7207" returned: 0 in 0.806s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:16 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-41d99a60-a4b9-40eb-aa0c-9d69d83f75c6 tempest-SnapshotDependencyTests-1050075905 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12682f3b-7ff8-40a7-a091-6907af0323da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:37:16 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-41d99a60-a4b9-40eb-aa0c-9d69d83f75c6 tempest-SnapshotDependencyTests-1050075905 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12682f3b-7ff8-40a7-a091-6907af0323da {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 08:37:16 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-41d99a60-a4b9-40eb-aa0c-9d69d83f75c6 tempest-SnapshotDependencyTests-1050075905 None] Creating direct copy from snapshot {{(pid=87199) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 08:37:16 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee6e360-3e13-4de7-aaaf-6d8b67fb98d2]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:37:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-41d99a60-a4b9-40eb-aa0c-9d69d83f75c6 tempest-SnapshotDependencyTests-1050075905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12682f3b-7ff8-40a7-a091-6907af0323da {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:16 devstack sudo[106149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12682f3b-7ff8-40a7-a091-6907af0323da Jul 07 08:37:16 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:16 devstack sudo[106144]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-41806c0c-945e-4e32-9814-79e01b554353 tempest-ProjectMemberTests-117232865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fe7fb200-85f0-4bcb-be09-cfef6692f8f0.76a76e12-14cf-41ee-a119-84eb5a152099" returned: 0 in 0.778s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:16 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-41806c0c-945e-4e32-9814-79e01b554353 tempest-ProjectMemberTests-117232865 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe7fb200-85f0-4bcb-be09-cfef6692f8f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:37:16 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[786086b2-1c63-4ff7-827d-c11b43337510]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:37:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-41806c0c-945e-4e32-9814-79e01b554353 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fe7fb200-85f0-4bcb-be09-cfef6692f8f0 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:16 devstack sudo[106155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fe7fb200-85f0-4bcb-be09-cfef6692f8f0 Jul 07 08:37:16 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:17 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-41d99a60-a4b9-40eb-aa0c-9d69d83f75c6 tempest-SnapshotDependencyTests-1050075905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12682f3b-7ff8-40a7-a091-6907af0323da" returned: 0 in 0.781s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:17 devstack cinder-volume[87199]: DEBUG cinder.utils [None req-41d99a60-a4b9-40eb-aa0c-9d69d83f75c6 tempest-SnapshotDependencyTests-1050075905 None] Path /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-bdd1c9fe-5de6-4528-a70c-434f177a2eda not found in is_blk_device check {{(pid=87199) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 08:37:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-41d99a60-a4b9-40eb-aa0c-9d69d83f75c6 tempest-SnapshotDependencyTests-1050075905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12682f3b-7ff8-40a7-a091-6907af0323da /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-bdd1c9fe-5de6-4528-a70c-434f177a2eda {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:17 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12682f3b-7ff8-40a7-a091-6907af0323da /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-bdd1c9fe-5de6-4528-a70c-434f177a2eda Jul 07 08:37:17 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:17 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-41806c0c-945e-4e32-9814-79e01b554353 tempest-ProjectMemberTests-117232865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fe7fb200-85f0-4bcb-be09-cfef6692f8f0" returned: 0 in 0.760s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-41806c0c-945e-4e32-9814-79e01b554353 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fe7fb200-85f0-4bcb-be09-cfef6692f8f0.76a76e12-14cf-41ee-a119-84eb5a152099 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:17 devstack sudo[106165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fe7fb200-85f0-4bcb-be09-cfef6692f8f0.76a76e12-14cf-41ee-a119-84eb5a152099 Jul 07 08:37:17 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:18 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-41806c0c-945e-4e32-9814-79e01b554353 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fe7fb200-85f0-4bcb-be09-cfef6692f8f0.76a76e12-14cf-41ee-a119-84eb5a152099" returned: 0 in 0.946s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-41806c0c-945e-4e32-9814-79e01b554353 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fe7fb200-85f0-4bcb-be09-cfef6692f8f0.76a76e12-14cf-41ee-a119-84eb5a152099 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:18 devstack sudo[106180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fe7fb200-85f0-4bcb-be09-cfef6692f8f0.76a76e12-14cf-41ee-a119-84eb5a152099 Jul 07 08:37:18 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:19 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-41806c0c-945e-4e32-9814-79e01b554353 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fe7fb200-85f0-4bcb-be09-cfef6692f8f0.76a76e12-14cf-41ee-a119-84eb5a152099" returned: 0 in 1.351s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:19 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-41806c0c-945e-4e32-9814-79e01b554353 tempest-ProjectMemberTests-117232865 None] Lock "cinder-quobyte-76a76e12-14cf-41ee-a119-84eb5a152099" released by "_delete_snapshot" :: held 3.966s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:37:19 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-41806c0c-945e-4e32-9814-79e01b554353 tempest-ProjectMemberTests-117232865 None] Lock "cinder-quobyte-fe7fb200-85f0-4bcb-be09-cfef6692f8f0" released by "delete_snapshot" :: held 4.000s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:37:19 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-41806c0c-945e-4e32-9814-79e01b554353 tempest-ProjectMemberTests-117232865 None] Created reservations ['af8bbaa8-fcf9-4d37-903e-a4703c1cd7b7', 'f72cf086-4fe1-46c0-87b5-9cc9bfae8969', '172fa5ee-5239-4eb2-8016-b9318e06bd95', 'bdaa2d2c-713d-437e-95b3-7e6d25bd9bac'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:37:19 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-41806c0c-945e-4e32-9814-79e01b554353 tempest-ProjectMemberTests-117232865 None] Delete snapshot completed successfully. Jul 07 08:37:20 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-41806c0c-945e-4e32-9814-79e01b554353 tempest-ProjectMemberTests-117232865 None] Lock "cinder-76a76e12-14cf-41ee-a119-84eb5a152099-delete_snapshot" released by "delete_snapshot" :: held 4.326s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:37:20 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9e3e6612-bc26-4b4f-b086-784b46db8143 tempest-ProjectMemberTests-117232865 None] Acquiring lock "cinder-fe7fb200-85f0-4bcb-be09-cfef6692f8f0-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:37:20 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9e3e6612-bc26-4b4f-b086-784b46db8143 tempest-ProjectMemberTests-117232865 None] Lock "cinder-fe7fb200-85f0-4bcb-be09-cfef6692f8f0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:37:20 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9e3e6612-bc26-4b4f-b086-784b46db8143 tempest-ProjectMemberTests-117232865 None] Acquiring lock "cinder-quobyte-fe7fb200-85f0-4bcb-be09-cfef6692f8f0" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:37:20 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9e3e6612-bc26-4b4f-b086-784b46db8143 tempest-ProjectMemberTests-117232865 None] Lock "cinder-quobyte-fe7fb200-85f0-4bcb-be09-cfef6692f8f0" acquired by "delete_volume" :: waited 0.039s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:37:20 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[46673952-f6f0-473f-81cf-9a78c3a1632b]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:37:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9e3e6612-bc26-4b4f-b086-784b46db8143 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fe7fb200-85f0-4bcb-be09-cfef6692f8f0 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:20 devstack sudo[106184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fe7fb200-85f0-4bcb-be09-cfef6692f8f0 Jul 07 08:37:20 devstack sudo[106184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:21 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-41d99a60-a4b9-40eb-aa0c-9d69d83f75c6 tempest-SnapshotDependencyTests-1050075905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12682f3b-7ff8-40a7-a091-6907af0323da /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-bdd1c9fe-5de6-4528-a70c-434f177a2eda" returned: 0 in 4.791s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:21 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef08322b-a848-4555-9814-6caa70c70212]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:37:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-41d99a60-a4b9-40eb-aa0c-9d69d83f75c6 tempest-SnapshotDependencyTests-1050075905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12682f3b-7ff8-40a7-a091-6907af0323da {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:22 devstack sudo[106187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12682f3b-7ff8-40a7-a091-6907af0323da Jul 07 08:37:22 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:22 devstack sudo[106184]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9e3e6612-bc26-4b4f-b086-784b46db8143 tempest-ProjectMemberTests-117232865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fe7fb200-85f0-4bcb-be09-cfef6692f8f0" returned: 0 in 1.845s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9e3e6612-bc26-4b4f-b086-784b46db8143 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fe7fb200-85f0-4bcb-be09-cfef6692f8f0 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:22 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fe7fb200-85f0-4bcb-be09-cfef6692f8f0 Jul 07 08:37:22 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:22 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:22 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9e3e6612-bc26-4b4f-b086-784b46db8143 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-fe7fb200-85f0-4bcb-be09-cfef6692f8f0" returned: 0 in 0.647s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-41d99a60-a4b9-40eb-aa0c-9d69d83f75c6 tempest-SnapshotDependencyTests-1050075905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12682f3b-7ff8-40a7-a091-6907af0323da" returned: 0 in 0.917s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:22 devstack cinder-volume[87199]: DEBUG cinder.image.image_utils [None req-41d99a60-a4b9-40eb-aa0c-9d69d83f75c6 tempest-SnapshotDependencyTests-1050075905 None] Image conversion details: src /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12682f3b-7ff8-40a7-a091-6907af0323da, size 1024.00 MB, duration 4.79 sec, destination /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-bdd1c9fe-5de6-4528-a70c-434f177a2eda {{(pid=87199) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 08:37:22 devstack cinder-volume[87199]: INFO cinder.image.image_utils [None req-41d99a60-a4b9-40eb-aa0c-9d69d83f75c6 tempest-SnapshotDependencyTests-1050075905 None] Converted 1024.00 MB image at 213.69 MB/s Jul 07 08:37:22 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-41d99a60-a4b9-40eb-aa0c-9d69d83f75c6 tempest-SnapshotDependencyTests-1050075905 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-bdd1c9fe-5de6-4528-a70c-434f177a2eda is being set with open permissions: ugo+rw Jul 07 08:37:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-41d99a60-a4b9-40eb-aa0c-9d69d83f75c6 tempest-SnapshotDependencyTests-1050075905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-bdd1c9fe-5de6-4528-a70c-434f177a2eda {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:22 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9e3e6612-bc26-4b4f-b086-784b46db8143 tempest-ProjectMemberTests-117232865 None] Lock "cinder-quobyte-fe7fb200-85f0-4bcb-be09-cfef6692f8f0" released by "delete_volume" :: held 2.629s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:37:22 devstack sudo[106198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-bdd1c9fe-5de6-4528-a70c-434f177a2eda Jul 07 08:37:22 devstack sudo[106198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:22 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-9e3e6612-bc26-4b4f-b086-784b46db8143 tempest-ProjectMemberTests-117232865 None] Created reservations ['75bbc6b9-1883-4697-806b-0095363a461c', '40384ec4-4103-4a44-8cbc-36081da333f7', '6ea746d7-25ca-47a8-b896-1cfcac731001', 'f92744b8-ec50-43f3-a212-2d84383bdb3a'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:37:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9e3e6612-bc26-4b4f-b086-784b46db8143 tempest-ProjectMemberTests-117232865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9e3e6612-bc26-4b4f-b086-784b46db8143 tempest-ProjectMemberTests-117232865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-9e3e6612-bc26-4b4f-b086-784b46db8143 tempest-ProjectMemberTests-117232865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:37:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-9e3e6612-bc26-4b4f-b086-784b46db8143 tempest-ProjectMemberTests-117232865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:37:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9e3e6612-bc26-4b4f-b086-784b46db8143 tempest-ProjectMemberTests-117232865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9e3e6612-bc26-4b4f-b086-784b46db8143 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:23 devstack sudo[106200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:37:23 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:23 devstack sudo[106198]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-41d99a60-a4b9-40eb-aa0c-9d69d83f75c6 tempest-SnapshotDependencyTests-1050075905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-bdd1c9fe-5de6-4528-a70c-434f177a2eda" returned: 0 in 0.619s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:23 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-41d99a60-a4b9-40eb-aa0c-9d69d83f75c6 tempest-SnapshotDependencyTests-1050075905 None] Lock "cinder-quobyte-bdd1c9fe-5de6-4528-a70c-434f177a2eda" released by "_copy_volume_from_snapshot" :: held 8.027s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:37:23 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-41d99a60-a4b9-40eb-aa0c-9d69d83f75c6 tempest-SnapshotDependencyTests-1050075905 None] Lock "cinder-quobyte-f51d4090-0e35-42c5-baaf-a8b0afec7207-bdd1c9fe-5de6-4528-a70c-434f177a2eda" released by "_create_volume_from_snapshot" :: held 8.061s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:37:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-41d99a60-a4b9-40eb-aa0c-9d69d83f75c6 tempest-SnapshotDependencyTests-1050075905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.087s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-41d99a60-a4b9-40eb-aa0c-9d69d83f75c6 tempest-SnapshotDependencyTests-1050075905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7817046b-7717-44f9-aa9b-16c4406491d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdd1c9fe-5de6-4528-a70c-434f177a2eda', 'volume_size': 1, 'snapshot_id': 'f51d4090-0e35-42c5-baaf-a8b0afec7207'}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-41d99a60-a4b9-40eb-aa0c-9d69d83f75c6 tempest-SnapshotDependencyTests-1050075905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9867240-aa34-4918-b107-01dcfe044381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:23 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-41d99a60-a4b9-40eb-aa0c-9d69d83f75c6 tempest-SnapshotDependencyTests-1050075905 None] Volume volume-bdd1c9fe-5de6-4528-a70c-434f177a2eda (bdd1c9fe-5de6-4528-a70c-434f177a2eda): created successfully Jul 07 08:37:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-41d99a60-a4b9-40eb-aa0c-9d69d83f75c6 tempest-SnapshotDependencyTests-1050075905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9867240-aa34-4918-b107-01dcfe044381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:23 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-41d99a60-a4b9-40eb-aa0c-9d69d83f75c6 tempest-SnapshotDependencyTests-1050075905 None] Flow 'volume_create_manager' (ac9633dc-1578-4df9-88cc-fa5f4178f493) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:37:23 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-41d99a60-a4b9-40eb-aa0c-9d69d83f75c6 tempest-SnapshotDependencyTests-1050075905 None] Created volume successfully. Jul 07 08:37:23 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9e3e6612-bc26-4b4f-b086-784b46db8143 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.668s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:23 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-9e3e6612-bc26-4b4f-b086-784b46db8143 tempest-ProjectMemberTests-117232865 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:37:23 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-9e3e6612-bc26-4b4f-b086-784b46db8143 tempest-ProjectMemberTests-117232865 None] Deleted volume successfully. Jul 07 08:37:23 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9e3e6612-bc26-4b4f-b086-784b46db8143 tempest-ProjectMemberTests-117232865 None] Lock "cinder-fe7fb200-85f0-4bcb-be09-cfef6692f8f0-delete_volume" released by "delete_volume" :: held 3.614s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:37:23 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5dae2322-aad3-4646-9a92-7dcdf899355f tempest-SnapshotDependencyTests-1050075905 None] Acquiring lock "cinder-f51d4090-0e35-42c5-baaf-a8b0afec7207-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:37:23 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5dae2322-aad3-4646-9a92-7dcdf899355f tempest-SnapshotDependencyTests-1050075905 None] Lock "cinder-f51d4090-0e35-42c5-baaf-a8b0afec7207-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:37:23 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5dae2322-aad3-4646-9a92-7dcdf899355f tempest-SnapshotDependencyTests-1050075905 None] Acquiring lock "cinder-quobyte-12682f3b-7ff8-40a7-a091-6907af0323da" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:37:23 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5dae2322-aad3-4646-9a92-7dcdf899355f tempest-SnapshotDependencyTests-1050075905 None] Lock "cinder-quobyte-12682f3b-7ff8-40a7-a091-6907af0323da" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:37:23 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5dae2322-aad3-4646-9a92-7dcdf899355f tempest-SnapshotDependencyTests-1050075905 None] Acquiring lock "cinder-quobyte-f51d4090-0e35-42c5-baaf-a8b0afec7207" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:37:23 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5dae2322-aad3-4646-9a92-7dcdf899355f tempest-SnapshotDependencyTests-1050075905 None] Lock "cinder-quobyte-f51d4090-0e35-42c5-baaf-a8b0afec7207" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:37:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-5dae2322-aad3-4646-9a92-7dcdf899355f tempest-SnapshotDependencyTests-1050075905 None] Deleting offline snapshot f51d4090-0e35-42c5-baaf-a8b0afec7207 of volume 12682f3b-7ff8-40a7-a091-6907af0323da {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:37:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-5dae2322-aad3-4646-9a92-7dcdf899355f tempest-SnapshotDependencyTests-1050075905 None] snapshot_file for this snap is: volume-12682f3b-7ff8-40a7-a091-6907af0323da.f51d4090-0e35-42c5-baaf-a8b0afec7207 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:37:23 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[c849a484-0548-4c2c-9934-c244e9d190a7]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:37:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5dae2322-aad3-4646-9a92-7dcdf899355f tempest-SnapshotDependencyTests-1050075905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12682f3b-7ff8-40a7-a091-6907af0323da.f51d4090-0e35-42c5-baaf-a8b0afec7207 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:24 devstack sudo[106204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12682f3b-7ff8-40a7-a091-6907af0323da.f51d4090-0e35-42c5-baaf-a8b0afec7207 Jul 07 08:37:24 devstack sudo[106204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:24 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-e338d583-153f-4e95-afa8-8646ec20bc05 tempest-ProjectMemberTests-117232865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:37:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e338d583-153f-4e95-afa8-8646ec20bc05 tempest-ProjectMemberTests-117232865 None] Flow 'volume_create_manager' (c52ce3ba-005a-4947-9220-ba6e856609e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:37:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e338d583-153f-4e95-afa8-8646ec20bc05 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27a9167d-955c-489d-a8ec-fee28e984dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e338d583-153f-4e95-afa8-8646ec20bc05 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27a9167d-955c-489d-a8ec-fee28e984dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1498867921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d44cfd9f-2757-462e-a994-3dc1e56f1af1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac2688c9df5545018de78c47a9e5a401',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:37:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:37:24Z,use_quota=True,user_id='11de70d1cfa0463dbad27ce8dcab2b39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e338d583-153f-4e95-afa8-8646ec20bc05 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2964b60e-9dfb-434b-b52e-8199f4ec7475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e338d583-153f-4e95-afa8-8646ec20bc05 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2964b60e-9dfb-434b-b52e-8199f4ec7475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e338d583-153f-4e95-afa8-8646ec20bc05 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83c8c103-bee2-4f80-b24d-9e4b0ace7224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e338d583-153f-4e95-afa8-8646ec20bc05 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83c8c103-bee2-4f80-b24d-9e4b0ace7224) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd44cfd9f-2757-462e-a994-3dc1e56f1af1', 'volume_name': 'volume-d44cfd9f-2757-462e-a994-3dc1e56f1af1', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e338d583-153f-4e95-afa8-8646ec20bc05 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6b1bd19-3b1b-4709-9093-13aaac8447c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e338d583-153f-4e95-afa8-8646ec20bc05 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6b1bd19-3b1b-4709-9093-13aaac8447c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e338d583-153f-4e95-afa8-8646ec20bc05 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b115e98-1f2c-4126-9999-2b9b7fef3114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:24 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-e338d583-153f-4e95-afa8-8646ec20bc05 tempest-ProjectMemberTests-117232865 None] Volume d44cfd9f-2757-462e-a994-3dc1e56f1af1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d44cfd9f-2757-462e-a994-3dc1e56f1af1', 'volume_size': 1} Jul 07 08:37:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e338d583-153f-4e95-afa8-8646ec20bc05 tempest-ProjectMemberTests-117232865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e338d583-153f-4e95-afa8-8646ec20bc05 tempest-ProjectMemberTests-117232865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:24 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e338d583-153f-4e95-afa8-8646ec20bc05 tempest-ProjectMemberTests-117232865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1498867921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d44cfd9f-2757-462e-a994-3dc1e56f1af1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac2688c9df5545018de78c47a9e5a401',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:37:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:37:24Z,use_quota=True,user_id='11de70d1cfa0463dbad27ce8dcab2b39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:37:24 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-e338d583-153f-4e95-afa8-8646ec20bc05 tempest-ProjectMemberTests-117232865 None] Creating volume d44cfd9f-2757-462e-a994-3dc1e56f1af1 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:37:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e338d583-153f-4e95-afa8-8646ec20bc05 tempest-ProjectMemberTests-117232865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e338d583-153f-4e95-afa8-8646ec20bc05 tempest-ProjectMemberTests-117232865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:24 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e338d583-153f-4e95-afa8-8646ec20bc05 tempest-ProjectMemberTests-117232865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:37:24 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e338d583-153f-4e95-afa8-8646ec20bc05 tempest-ProjectMemberTests-117232865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:37:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e338d583-153f-4e95-afa8-8646ec20bc05 tempest-ProjectMemberTests-117232865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:24 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e338d583-153f-4e95-afa8-8646ec20bc05 tempest-ProjectMemberTests-117232865 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:37:24 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-e338d583-153f-4e95-afa8-8646ec20bc05 tempest-ProjectMemberTests-117232865 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:37:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e338d583-153f-4e95-afa8-8646ec20bc05 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d44cfd9f-2757-462e-a994-3dc1e56f1af1 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:24 devstack sudo[106206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d44cfd9f-2757-462e-a994-3dc1e56f1af1 1073741824 Jul 07 08:37:24 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:24 devstack sudo[106204]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5dae2322-aad3-4646-9a92-7dcdf899355f tempest-SnapshotDependencyTests-1050075905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12682f3b-7ff8-40a7-a091-6907af0323da.f51d4090-0e35-42c5-baaf-a8b0afec7207" returned: 0 in 0.749s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:24 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-5dae2322-aad3-4646-9a92-7dcdf899355f tempest-SnapshotDependencyTests-1050075905 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12682f3b-7ff8-40a7-a091-6907af0323da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:37:24 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3c4f4c-790b-4642-9dd3-1241fea009e6]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:37:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5dae2322-aad3-4646-9a92-7dcdf899355f tempest-SnapshotDependencyTests-1050075905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12682f3b-7ff8-40a7-a091-6907af0323da {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:24 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12682f3b-7ff8-40a7-a091-6907af0323da Jul 07 08:37:24 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:24 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e338d583-153f-4e95-afa8-8646ec20bc05 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d44cfd9f-2757-462e-a994-3dc1e56f1af1 1073741824" returned: 0 in 0.795s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e338d583-153f-4e95-afa8-8646ec20bc05 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d44cfd9f-2757-462e-a994-3dc1e56f1af1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:25 devstack sudo[106216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d44cfd9f-2757-462e-a994-3dc1e56f1af1 Jul 07 08:37:25 devstack sudo[106216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:25 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5dae2322-aad3-4646-9a92-7dcdf899355f tempest-SnapshotDependencyTests-1050075905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12682f3b-7ff8-40a7-a091-6907af0323da" returned: 0 in 0.729s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5dae2322-aad3-4646-9a92-7dcdf899355f tempest-SnapshotDependencyTests-1050075905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12682f3b-7ff8-40a7-a091-6907af0323da.f51d4090-0e35-42c5-baaf-a8b0afec7207 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:25 devstack sudo[106221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12682f3b-7ff8-40a7-a091-6907af0323da.f51d4090-0e35-42c5-baaf-a8b0afec7207 Jul 07 08:37:25 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:25 devstack sudo[106216]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e338d583-153f-4e95-afa8-8646ec20bc05 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d44cfd9f-2757-462e-a994-3dc1e56f1af1" returned: 0 in 0.620s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:25 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e338d583-153f-4e95-afa8-8646ec20bc05 tempest-ProjectMemberTests-117232865 None] <== create_volume: return (1467ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:37:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e338d583-153f-4e95-afa8-8646ec20bc05 tempest-ProjectMemberTests-117232865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.470s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:25 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e338d583-153f-4e95-afa8-8646ec20bc05 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b115e98-1f2c-4126-9999-2b9b7fef3114) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d44cfd9f-2757-462e-a994-3dc1e56f1af1', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:25 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e338d583-153f-4e95-afa8-8646ec20bc05 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec673624-0e9e-453f-94c6-f683dfbc2750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:25 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-e338d583-153f-4e95-afa8-8646ec20bc05 tempest-ProjectMemberTests-117232865 None] Volume volume-d44cfd9f-2757-462e-a994-3dc1e56f1af1 (d44cfd9f-2757-462e-a994-3dc1e56f1af1): created successfully Jul 07 08:37:25 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e338d583-153f-4e95-afa8-8646ec20bc05 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec673624-0e9e-453f-94c6-f683dfbc2750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:25 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-e338d583-153f-4e95-afa8-8646ec20bc05 tempest-ProjectMemberTests-117232865 None] Flow 'volume_create_manager' (c52ce3ba-005a-4947-9220-ba6e856609e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:37:25 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-e338d583-153f-4e95-afa8-8646ec20bc05 tempest-ProjectMemberTests-117232865 None] Created volume successfully. Jul 07 08:37:26 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5dae2322-aad3-4646-9a92-7dcdf899355f tempest-SnapshotDependencyTests-1050075905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12682f3b-7ff8-40a7-a091-6907af0323da.f51d4090-0e35-42c5-baaf-a8b0afec7207" returned: 0 in 0.758s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5dae2322-aad3-4646-9a92-7dcdf899355f tempest-SnapshotDependencyTests-1050075905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12682f3b-7ff8-40a7-a091-6907af0323da.f51d4090-0e35-42c5-baaf-a8b0afec7207 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:26 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12682f3b-7ff8-40a7-a091-6907af0323da.f51d4090-0e35-42c5-baaf-a8b0afec7207 Jul 07 08:37:26 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4a7a6f42-703d-4b27-a997-8014c3d578dd tempest-ProjectMemberTests-117232865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4a7a6f42-703d-4b27-a997-8014c3d578dd tempest-ProjectMemberTests-117232865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:26 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-4a7a6f42-703d-4b27-a997-8014c3d578dd tempest-ProjectMemberTests-117232865 None] Creating offline snapshot a4d883c4-c48c-47f6-8159-1c88804cd447 of volume d44cfd9f-2757-462e-a994-3dc1e56f1af1 {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:37:26 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4655f50-e68e-4de8-ba9d-abbdc8cb9f28]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:37:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4a7a6f42-703d-4b27-a997-8014c3d578dd tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d44cfd9f-2757-462e-a994-3dc1e56f1af1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:26 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d44cfd9f-2757-462e-a994-3dc1e56f1af1 Jul 07 08:37:26 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:26 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-5dae2322-aad3-4646-9a92-7dcdf899355f tempest-SnapshotDependencyTests-1050075905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12682f3b-7ff8-40a7-a091-6907af0323da.f51d4090-0e35-42c5-baaf-a8b0afec7207" returned: 0 in 0.664s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:26 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5dae2322-aad3-4646-9a92-7dcdf899355f tempest-SnapshotDependencyTests-1050075905 None] Lock "cinder-quobyte-f51d4090-0e35-42c5-baaf-a8b0afec7207" released by "_delete_snapshot" :: held 3.001s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:37:26 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5dae2322-aad3-4646-9a92-7dcdf899355f tempest-SnapshotDependencyTests-1050075905 None] Lock "cinder-quobyte-12682f3b-7ff8-40a7-a091-6907af0323da" released by "delete_snapshot" :: held 3.027s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:37:27 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-5dae2322-aad3-4646-9a92-7dcdf899355f tempest-SnapshotDependencyTests-1050075905 None] Created reservations ['8dfdf5ca-abdc-4c3a-9018-d0a08a84ddb6', '0f31492d-f4fc-4605-a631-f9354cb548e6', '6b9e2900-e039-42b1-8160-f4f5b2f4f74f', '68266cab-6572-4581-80ee-c8044b0438fc'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:37:27 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-5dae2322-aad3-4646-9a92-7dcdf899355f tempest-SnapshotDependencyTests-1050075905 None] Delete snapshot completed successfully. Jul 07 08:37:27 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-5dae2322-aad3-4646-9a92-7dcdf899355f tempest-SnapshotDependencyTests-1050075905 None] Lock "cinder-f51d4090-0e35-42c5-baaf-a8b0afec7207-delete_snapshot" released by "delete_snapshot" :: held 3.173s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:37:27 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4a7a6f42-703d-4b27-a997-8014c3d578dd tempest-ProjectMemberTests-117232865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d44cfd9f-2757-462e-a994-3dc1e56f1af1" returned: 0 in 0.778s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4a7a6f42-703d-4b27-a997-8014c3d578dd tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d44cfd9f-2757-462e-a994-3dc1e56f1af1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d44cfd9f-2757-462e-a994-3dc1e56f1af1.a4d883c4-c48c-47f6-8159-1c88804cd447 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:27 devstack sudo[106238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d44cfd9f-2757-462e-a994-3dc1e56f1af1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d44cfd9f-2757-462e-a994-3dc1e56f1af1.a4d883c4-c48c-47f6-8159-1c88804cd447 1G Jul 07 08:37:27 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:27 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4a7a6f42-703d-4b27-a997-8014c3d578dd tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d44cfd9f-2757-462e-a994-3dc1e56f1af1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d44cfd9f-2757-462e-a994-3dc1e56f1af1.a4d883c4-c48c-47f6-8159-1c88804cd447 1G" returned: 0 in 0.787s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4a7a6f42-703d-4b27-a997-8014c3d578dd tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d44cfd9f-2757-462e-a994-3dc1e56f1af1 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d44cfd9f-2757-462e-a994-3dc1e56f1af1.a4d883c4-c48c-47f6-8159-1c88804cd447 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:27 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d44cfd9f-2757-462e-a994-3dc1e56f1af1 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d44cfd9f-2757-462e-a994-3dc1e56f1af1.a4d883c4-c48c-47f6-8159-1c88804cd447 Jul 07 08:37:27 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:28 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b6c4f981-2300-4690-9f99-21b7aa915243 tempest-SnapshotDependencyTests-1050075905 None] Acquiring lock "cinder-12682f3b-7ff8-40a7-a091-6907af0323da-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:37:28 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b6c4f981-2300-4690-9f99-21b7aa915243 tempest-SnapshotDependencyTests-1050075905 None] Lock "cinder-12682f3b-7ff8-40a7-a091-6907af0323da-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:37:28 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b6c4f981-2300-4690-9f99-21b7aa915243 tempest-SnapshotDependencyTests-1050075905 None] Acquiring lock "cinder-quobyte-12682f3b-7ff8-40a7-a091-6907af0323da" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:37:28 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b6c4f981-2300-4690-9f99-21b7aa915243 tempest-SnapshotDependencyTests-1050075905 None] Lock "cinder-quobyte-12682f3b-7ff8-40a7-a091-6907af0323da" acquired by "delete_volume" :: waited 0.014s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:37:28 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac69647-bc3c-4ef6-8a60-791c1fef8782]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:37:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b6c4f981-2300-4690-9f99-21b7aa915243 tempest-SnapshotDependencyTests-1050075905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12682f3b-7ff8-40a7-a091-6907af0323da {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:28 devstack sudo[106245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12682f3b-7ff8-40a7-a091-6907af0323da Jul 07 08:37:28 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:28 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4a7a6f42-703d-4b27-a997-8014c3d578dd tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d44cfd9f-2757-462e-a994-3dc1e56f1af1 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d44cfd9f-2757-462e-a994-3dc1e56f1af1.a4d883c4-c48c-47f6-8159-1c88804cd447" returned: 0 in 0.673s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:28 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-4a7a6f42-703d-4b27-a997-8014c3d578dd tempest-ProjectMemberTests-117232865 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d44cfd9f-2757-462e-a994-3dc1e56f1af1.a4d883c4-c48c-47f6-8159-1c88804cd447 is being set with open permissions: ugo+rw Jul 07 08:37:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4a7a6f42-703d-4b27-a997-8014c3d578dd tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d44cfd9f-2757-462e-a994-3dc1e56f1af1.a4d883c4-c48c-47f6-8159-1c88804cd447 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:28 devstack sudo[106250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d44cfd9f-2757-462e-a994-3dc1e56f1af1.a4d883c4-c48c-47f6-8159-1c88804cd447 Jul 07 08:37:28 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:28 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b6c4f981-2300-4690-9f99-21b7aa915243 tempest-SnapshotDependencyTests-1050075905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12682f3b-7ff8-40a7-a091-6907af0323da" returned: 0 in 0.777s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b6c4f981-2300-4690-9f99-21b7aa915243 tempest-SnapshotDependencyTests-1050075905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12682f3b-7ff8-40a7-a091-6907af0323da {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:29 devstack sudo[106255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12682f3b-7ff8-40a7-a091-6907af0323da Jul 07 08:37:29 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:29 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4a7a6f42-703d-4b27-a997-8014c3d578dd tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d44cfd9f-2757-462e-a994-3dc1e56f1af1.a4d883c4-c48c-47f6-8159-1c88804cd447" returned: 0 in 0.625s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4a7a6f42-703d-4b27-a997-8014c3d578dd tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d44cfd9f-2757-462e-a994-3dc1e56f1af1.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:29 devstack sudo[106258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d44cfd9f-2757-462e-a994-3dc1e56f1af1.info Jul 07 08:37:29 devstack sudo[106258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:29 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b6c4f981-2300-4690-9f99-21b7aa915243 tempest-SnapshotDependencyTests-1050075905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-12682f3b-7ff8-40a7-a091-6907af0323da" returned: 0 in 0.660s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:29 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b6c4f981-2300-4690-9f99-21b7aa915243 tempest-SnapshotDependencyTests-1050075905 None] Lock "cinder-quobyte-12682f3b-7ff8-40a7-a091-6907af0323da" released by "delete_volume" :: held 1.492s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:37:29 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-b6c4f981-2300-4690-9f99-21b7aa915243 tempest-SnapshotDependencyTests-1050075905 None] Created reservations ['34358b07-3311-43bb-bc22-6f201cf8d51a', '2dc416ea-3eae-4ffb-bfd6-bae99d037fff', '629713b7-fcd7-48f9-9ccd-c6e928921c4b', '94a9d8de-7492-42e4-87d9-3d399cdc5eec'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:37:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b6c4f981-2300-4690-9f99-21b7aa915243 tempest-SnapshotDependencyTests-1050075905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b6c4f981-2300-4690-9f99-21b7aa915243 tempest-SnapshotDependencyTests-1050075905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:29 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b6c4f981-2300-4690-9f99-21b7aa915243 tempest-SnapshotDependencyTests-1050075905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:37:29 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b6c4f981-2300-4690-9f99-21b7aa915243 tempest-SnapshotDependencyTests-1050075905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:37:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b6c4f981-2300-4690-9f99-21b7aa915243 tempest-SnapshotDependencyTests-1050075905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b6c4f981-2300-4690-9f99-21b7aa915243 tempest-SnapshotDependencyTests-1050075905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:29 devstack sudo[106262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:37:29 devstack sudo[106262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:29 devstack sudo[106258]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4a7a6f42-703d-4b27-a997-8014c3d578dd tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d44cfd9f-2757-462e-a994-3dc1e56f1af1.info" returned: 0 in 0.642s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:29 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-4a7a6f42-703d-4b27-a997-8014c3d578dd tempest-ProjectMemberTests-117232865 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d44cfd9f-2757-462e-a994-3dc1e56f1af1.info is being set with open permissions: ugo+rw Jul 07 08:37:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4a7a6f42-703d-4b27-a997-8014c3d578dd tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d44cfd9f-2757-462e-a994-3dc1e56f1af1.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:29 devstack sudo[106264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d44cfd9f-2757-462e-a994-3dc1e56f1af1.info Jul 07 08:37:29 devstack sudo[106264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:30 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9de76681-c26b-49b6-b571-3cb44e2b5e04 tempest-SnapshotDependencyTests-1050075905 None] Acquiring lock "cinder-bdd1c9fe-5de6-4528-a70c-434f177a2eda-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:37:30 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9de76681-c26b-49b6-b571-3cb44e2b5e04 tempest-SnapshotDependencyTests-1050075905 None] Lock "cinder-bdd1c9fe-5de6-4528-a70c-434f177a2eda-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:37:30 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9de76681-c26b-49b6-b571-3cb44e2b5e04 tempest-SnapshotDependencyTests-1050075905 None] Acquiring lock "cinder-quobyte-bdd1c9fe-5de6-4528-a70c-434f177a2eda" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:37:30 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9de76681-c26b-49b6-b571-3cb44e2b5e04 tempest-SnapshotDependencyTests-1050075905 None] Lock "cinder-quobyte-bdd1c9fe-5de6-4528-a70c-434f177a2eda" acquired by "delete_volume" :: waited 0.015s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:37:30 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[348614e3-b309-4ae7-8ad8-c35ffb16f930]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:37:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9de76681-c26b-49b6-b571-3cb44e2b5e04 tempest-SnapshotDependencyTests-1050075905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-bdd1c9fe-5de6-4528-a70c-434f177a2eda {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:30 devstack sudo[106262]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b6c4f981-2300-4690-9f99-21b7aa915243 tempest-SnapshotDependencyTests-1050075905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.696s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:30 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-b6c4f981-2300-4690-9f99-21b7aa915243 tempest-SnapshotDependencyTests-1050075905 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:37:30 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-b6c4f981-2300-4690-9f99-21b7aa915243 tempest-SnapshotDependencyTests-1050075905 None] Deleted volume successfully. Jul 07 08:37:30 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b6c4f981-2300-4690-9f99-21b7aa915243 tempest-SnapshotDependencyTests-1050075905 None] Lock "cinder-12682f3b-7ff8-40a7-a091-6907af0323da-delete_volume" released by "delete_volume" :: held 2.396s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:37:30 devstack sudo[106264]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-4a7a6f42-703d-4b27-a997-8014c3d578dd tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d44cfd9f-2757-462e-a994-3dc1e56f1af1.info" returned: 0 in 0.644s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:30 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-4a7a6f42-703d-4b27-a997-8014c3d578dd tempest-ProjectMemberTests-117232865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.230s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:30 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-4a7a6f42-703d-4b27-a997-8014c3d578dd tempest-ProjectMemberTests-117232865 None] Create snapshot completed successfully Jul 07 08:37:30 devstack sudo[106268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-bdd1c9fe-5de6-4528-a70c-434f177a2eda Jul 07 08:37:30 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:31 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9de76681-c26b-49b6-b571-3cb44e2b5e04 tempest-SnapshotDependencyTests-1050075905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-bdd1c9fe-5de6-4528-a70c-434f177a2eda" returned: 0 in 0.747s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9de76681-c26b-49b6-b571-3cb44e2b5e04 tempest-SnapshotDependencyTests-1050075905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-bdd1c9fe-5de6-4528-a70c-434f177a2eda {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:31 devstack sudo[106273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-bdd1c9fe-5de6-4528-a70c-434f177a2eda Jul 07 08:37:31 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:31 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-dbd8e42d-ad6a-497e-b456-118093b7cf18 tempest-ProjectMemberTests-117232865 None] Acquiring lock "cinder-a4d883c4-c48c-47f6-8159-1c88804cd447-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:37:31 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-dbd8e42d-ad6a-497e-b456-118093b7cf18 tempest-ProjectMemberTests-117232865 None] Lock "cinder-a4d883c4-c48c-47f6-8159-1c88804cd447-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:37:31 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-dbd8e42d-ad6a-497e-b456-118093b7cf18 tempest-ProjectMemberTests-117232865 None] Acquiring lock "cinder-quobyte-d44cfd9f-2757-462e-a994-3dc1e56f1af1" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:37:31 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-dbd8e42d-ad6a-497e-b456-118093b7cf18 tempest-ProjectMemberTests-117232865 None] Lock "cinder-quobyte-d44cfd9f-2757-462e-a994-3dc1e56f1af1" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:37:31 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-dbd8e42d-ad6a-497e-b456-118093b7cf18 tempest-ProjectMemberTests-117232865 None] Acquiring lock "cinder-quobyte-a4d883c4-c48c-47f6-8159-1c88804cd447" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:37:31 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-dbd8e42d-ad6a-497e-b456-118093b7cf18 tempest-ProjectMemberTests-117232865 None] Lock "cinder-quobyte-a4d883c4-c48c-47f6-8159-1c88804cd447" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:37:31 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-dbd8e42d-ad6a-497e-b456-118093b7cf18 tempest-ProjectMemberTests-117232865 None] Deleting offline snapshot a4d883c4-c48c-47f6-8159-1c88804cd447 of volume d44cfd9f-2757-462e-a994-3dc1e56f1af1 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:37:31 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-dbd8e42d-ad6a-497e-b456-118093b7cf18 tempest-ProjectMemberTests-117232865 None] snapshot_file for this snap is: volume-d44cfd9f-2757-462e-a994-3dc1e56f1af1.a4d883c4-c48c-47f6-8159-1c88804cd447 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:37:31 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d84832-256f-4436-a9b3-e05f9bf16d90]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:37:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-dbd8e42d-ad6a-497e-b456-118093b7cf18 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d44cfd9f-2757-462e-a994-3dc1e56f1af1.a4d883c4-c48c-47f6-8159-1c88804cd447 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:31 devstack sudo[106276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d44cfd9f-2757-462e-a994-3dc1e56f1af1.a4d883c4-c48c-47f6-8159-1c88804cd447 Jul 07 08:37:31 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:31 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9de76681-c26b-49b6-b571-3cb44e2b5e04 tempest-SnapshotDependencyTests-1050075905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-bdd1c9fe-5de6-4528-a70c-434f177a2eda" returned: 0 in 0.655s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:31 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9de76681-c26b-49b6-b571-3cb44e2b5e04 tempest-SnapshotDependencyTests-1050075905 None] Lock "cinder-quobyte-bdd1c9fe-5de6-4528-a70c-434f177a2eda" released by "delete_volume" :: held 1.446s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:37:31 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-9de76681-c26b-49b6-b571-3cb44e2b5e04 tempest-SnapshotDependencyTests-1050075905 None] Created reservations ['7e34a277-dcdc-4ec7-af97-6947c00b08a6', 'ea7920f9-f7c1-4336-aa9c-2b2530b09abb', '683f2121-86c5-4c41-904d-e61d16caffe1', '138e3320-354e-437a-8b99-7f3ee1cde957'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:37:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9de76681-c26b-49b6-b571-3cb44e2b5e04 tempest-SnapshotDependencyTests-1050075905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9de76681-c26b-49b6-b571-3cb44e2b5e04 tempest-SnapshotDependencyTests-1050075905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:31 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-9de76681-c26b-49b6-b571-3cb44e2b5e04 tempest-SnapshotDependencyTests-1050075905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:37:31 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-9de76681-c26b-49b6-b571-3cb44e2b5e04 tempest-SnapshotDependencyTests-1050075905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:37:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-9de76681-c26b-49b6-b571-3cb44e2b5e04 tempest-SnapshotDependencyTests-1050075905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:31 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9de76681-c26b-49b6-b571-3cb44e2b5e04 tempest-SnapshotDependencyTests-1050075905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:32 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:37:32 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:32 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-dbd8e42d-ad6a-497e-b456-118093b7cf18 tempest-ProjectMemberTests-117232865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d44cfd9f-2757-462e-a994-3dc1e56f1af1.a4d883c4-c48c-47f6-8159-1c88804cd447" returned: 0 in 0.753s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:32 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-dbd8e42d-ad6a-497e-b456-118093b7cf18 tempest-ProjectMemberTests-117232865 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d44cfd9f-2757-462e-a994-3dc1e56f1af1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:37:32 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[13cc8571-93f8-41ad-b157-c108687bf005]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:37:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-dbd8e42d-ad6a-497e-b456-118093b7cf18 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d44cfd9f-2757-462e-a994-3dc1e56f1af1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:32 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d44cfd9f-2757-462e-a994-3dc1e56f1af1 Jul 07 08:37:32 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:32 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:32 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-9de76681-c26b-49b6-b571-3cb44e2b5e04 tempest-SnapshotDependencyTests-1050075905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.663s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:32 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-9de76681-c26b-49b6-b571-3cb44e2b5e04 tempest-SnapshotDependencyTests-1050075905 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:37:32 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-9de76681-c26b-49b6-b571-3cb44e2b5e04 tempest-SnapshotDependencyTests-1050075905 None] Deleted volume successfully. Jul 07 08:37:32 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-9de76681-c26b-49b6-b571-3cb44e2b5e04 tempest-SnapshotDependencyTests-1050075905 None] Lock "cinder-bdd1c9fe-5de6-4528-a70c-434f177a2eda-delete_volume" released by "delete_volume" :: held 2.339s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:37:33 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-dbd8e42d-ad6a-497e-b456-118093b7cf18 tempest-ProjectMemberTests-117232865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d44cfd9f-2757-462e-a994-3dc1e56f1af1" returned: 0 in 0.799s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:33 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-dbd8e42d-ad6a-497e-b456-118093b7cf18 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d44cfd9f-2757-462e-a994-3dc1e56f1af1.a4d883c4-c48c-47f6-8159-1c88804cd447 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:33 devstack sudo[106290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d44cfd9f-2757-462e-a994-3dc1e56f1af1.a4d883c4-c48c-47f6-8159-1c88804cd447 Jul 07 08:37:33 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:34 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-dbd8e42d-ad6a-497e-b456-118093b7cf18 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d44cfd9f-2757-462e-a994-3dc1e56f1af1.a4d883c4-c48c-47f6-8159-1c88804cd447" returned: 0 in 0.756s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-dbd8e42d-ad6a-497e-b456-118093b7cf18 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d44cfd9f-2757-462e-a994-3dc1e56f1af1.a4d883c4-c48c-47f6-8159-1c88804cd447 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:34 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d44cfd9f-2757-462e-a994-3dc1e56f1af1.a4d883c4-c48c-47f6-8159-1c88804cd447 Jul 07 08:37:34 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:34 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:34 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-dbd8e42d-ad6a-497e-b456-118093b7cf18 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d44cfd9f-2757-462e-a994-3dc1e56f1af1.a4d883c4-c48c-47f6-8159-1c88804cd447" returned: 0 in 0.661s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:34 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-dbd8e42d-ad6a-497e-b456-118093b7cf18 tempest-ProjectMemberTests-117232865 None] Lock "cinder-quobyte-a4d883c4-c48c-47f6-8159-1c88804cd447" released by "_delete_snapshot" :: held 3.076s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:37:34 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-dbd8e42d-ad6a-497e-b456-118093b7cf18 tempest-ProjectMemberTests-117232865 None] Lock "cinder-quobyte-d44cfd9f-2757-462e-a994-3dc1e56f1af1" released by "delete_snapshot" :: held 3.105s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:37:34 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-dbd8e42d-ad6a-497e-b456-118093b7cf18 tempest-ProjectMemberTests-117232865 None] Created reservations ['86e62932-559c-4b5d-8424-54d3fa7dedf2', '68a64dc6-3b15-463b-8291-04fcce65215a', 'ffa4c467-f4ec-46c3-a05e-aecef5a9ab16', '55236b62-9430-48b4-8411-03bcc9c988af'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:37:34 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-dbd8e42d-ad6a-497e-b456-118093b7cf18 tempest-ProjectMemberTests-117232865 None] Delete snapshot completed successfully. Jul 07 08:37:34 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-dbd8e42d-ad6a-497e-b456-118093b7cf18 tempest-ProjectMemberTests-117232865 None] Lock "cinder-a4d883c4-c48c-47f6-8159-1c88804cd447-delete_snapshot" released by "delete_snapshot" :: held 3.266s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:37:35 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b04139cb-7fa5-4a97-826e-5a469c200ea1 tempest-ProjectMemberTests-117232865 None] Acquiring lock "cinder-d44cfd9f-2757-462e-a994-3dc1e56f1af1-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:37:35 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b04139cb-7fa5-4a97-826e-5a469c200ea1 tempest-ProjectMemberTests-117232865 None] Lock "cinder-d44cfd9f-2757-462e-a994-3dc1e56f1af1-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:37:35 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b04139cb-7fa5-4a97-826e-5a469c200ea1 tempest-ProjectMemberTests-117232865 None] Acquiring lock "cinder-quobyte-d44cfd9f-2757-462e-a994-3dc1e56f1af1" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:37:35 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b04139cb-7fa5-4a97-826e-5a469c200ea1 tempest-ProjectMemberTests-117232865 None] Lock "cinder-quobyte-d44cfd9f-2757-462e-a994-3dc1e56f1af1" acquired by "delete_volume" :: waited 0.019s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:37:35 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1e3a38-e5dd-41c5-8140-cc71f507ca9d]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:37:35 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b04139cb-7fa5-4a97-826e-5a469c200ea1 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d44cfd9f-2757-462e-a994-3dc1e56f1af1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:36 devstack sudo[106299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d44cfd9f-2757-462e-a994-3dc1e56f1af1 Jul 07 08:37:36 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:36 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b04139cb-7fa5-4a97-826e-5a469c200ea1 tempest-ProjectMemberTests-117232865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d44cfd9f-2757-462e-a994-3dc1e56f1af1" returned: 0 in 0.860s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:36 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b04139cb-7fa5-4a97-826e-5a469c200ea1 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d44cfd9f-2757-462e-a994-3dc1e56f1af1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:36 devstack sudo[106305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d44cfd9f-2757-462e-a994-3dc1e56f1af1 Jul 07 08:37:36 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:37 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b04139cb-7fa5-4a97-826e-5a469c200ea1 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-d44cfd9f-2757-462e-a994-3dc1e56f1af1" returned: 0 in 0.737s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:37 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b04139cb-7fa5-4a97-826e-5a469c200ea1 tempest-ProjectMemberTests-117232865 None] Lock "cinder-quobyte-d44cfd9f-2757-462e-a994-3dc1e56f1af1" released by "delete_volume" :: held 1.665s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:37:37 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-b04139cb-7fa5-4a97-826e-5a469c200ea1 tempest-ProjectMemberTests-117232865 None] Created reservations ['7118313f-dda7-4206-8b7e-af59b8db7095', '540e40f2-7185-4628-912e-9f1768882061', '6ef9eac1-06c1-4491-aa00-b04e13d685fa', '41f4543f-01bc-4044-a20f-2e205dab6b65'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:37:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b04139cb-7fa5-4a97-826e-5a469c200ea1 tempest-ProjectMemberTests-117232865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b04139cb-7fa5-4a97-826e-5a469c200ea1 tempest-ProjectMemberTests-117232865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:37 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b04139cb-7fa5-4a97-826e-5a469c200ea1 tempest-ProjectMemberTests-117232865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:37:37 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-b04139cb-7fa5-4a97-826e-5a469c200ea1 tempest-ProjectMemberTests-117232865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:37:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-b04139cb-7fa5-4a97-826e-5a469c200ea1 tempest-ProjectMemberTests-117232865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:37 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b04139cb-7fa5-4a97-826e-5a469c200ea1 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:37 devstack sudo[106309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:37:37 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:38 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-b04139cb-7fa5-4a97-826e-5a469c200ea1 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.682s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:38 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-b04139cb-7fa5-4a97-826e-5a469c200ea1 tempest-ProjectMemberTests-117232865 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:37:38 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-b04139cb-7fa5-4a97-826e-5a469c200ea1 tempest-ProjectMemberTests-117232865 None] Deleted volume successfully. Jul 07 08:37:38 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-b04139cb-7fa5-4a97-826e-5a469c200ea1 tempest-ProjectMemberTests-117232865 None] Lock "cinder-d44cfd9f-2757-462e-a994-3dc1e56f1af1-delete_volume" released by "delete_volume" :: held 2.596s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:37:38 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-083d981d-5f38-4f04-9c98-1d457e483e9a tempest-ProjectMemberTests-117232865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:37:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-083d981d-5f38-4f04-9c98-1d457e483e9a tempest-ProjectMemberTests-117232865 None] Flow 'volume_create_manager' (74568f7a-0795-4433-af66-81f4b186f649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:37:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-083d981d-5f38-4f04-9c98-1d457e483e9a tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2e38572-3586-440b-991e-cb1b7d5f2f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-083d981d-5f38-4f04-9c98-1d457e483e9a tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2e38572-3586-440b-991e-cb1b7d5f2f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1069125474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8191b8d9-afe4-4029-9f17-e57f58185519,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac2688c9df5545018de78c47a9e5a401',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:37:39Z,use_quota=True,user_id='11de70d1cfa0463dbad27ce8dcab2b39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-083d981d-5f38-4f04-9c98-1d457e483e9a tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72705d40-c412-4603-a281-de4876c494c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-083d981d-5f38-4f04-9c98-1d457e483e9a tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72705d40-c412-4603-a281-de4876c494c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-083d981d-5f38-4f04-9c98-1d457e483e9a tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (413cfd66-fc7b-4c61-bf47-7cf03870cd8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-083d981d-5f38-4f04-9c98-1d457e483e9a tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (413cfd66-fc7b-4c61-bf47-7cf03870cd8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8191b8d9-afe4-4029-9f17-e57f58185519', 'volume_name': 'volume-8191b8d9-afe4-4029-9f17-e57f58185519', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-083d981d-5f38-4f04-9c98-1d457e483e9a tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5acaf42b-d00d-418e-b531-a61847e5c5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-083d981d-5f38-4f04-9c98-1d457e483e9a tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5acaf42b-d00d-418e-b531-a61847e5c5d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:38 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-083d981d-5f38-4f04-9c98-1d457e483e9a tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bada471-aa68-4aee-b70b-a5c5982a3791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:38 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-083d981d-5f38-4f04-9c98-1d457e483e9a tempest-ProjectMemberTests-117232865 None] Volume 8191b8d9-afe4-4029-9f17-e57f58185519: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8191b8d9-afe4-4029-9f17-e57f58185519', 'volume_size': 1} Jul 07 08:37:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-083d981d-5f38-4f04-9c98-1d457e483e9a tempest-ProjectMemberTests-117232865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-083d981d-5f38-4f04-9c98-1d457e483e9a tempest-ProjectMemberTests-117232865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:38 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-083d981d-5f38-4f04-9c98-1d457e483e9a tempest-ProjectMemberTests-117232865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1069125474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8191b8d9-afe4-4029-9f17-e57f58185519,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac2688c9df5545018de78c47a9e5a401',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:37:39Z,use_quota=True,user_id='11de70d1cfa0463dbad27ce8dcab2b39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:37:38 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-083d981d-5f38-4f04-9c98-1d457e483e9a tempest-ProjectMemberTests-117232865 None] Creating volume 8191b8d9-afe4-4029-9f17-e57f58185519 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:37:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-083d981d-5f38-4f04-9c98-1d457e483e9a tempest-ProjectMemberTests-117232865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-083d981d-5f38-4f04-9c98-1d457e483e9a tempest-ProjectMemberTests-117232865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:38 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-083d981d-5f38-4f04-9c98-1d457e483e9a tempest-ProjectMemberTests-117232865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:37:38 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-083d981d-5f38-4f04-9c98-1d457e483e9a tempest-ProjectMemberTests-117232865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:37:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-083d981d-5f38-4f04-9c98-1d457e483e9a tempest-ProjectMemberTests-117232865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:38 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-083d981d-5f38-4f04-9c98-1d457e483e9a tempest-ProjectMemberTests-117232865 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:37:38 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-083d981d-5f38-4f04-9c98-1d457e483e9a tempest-ProjectMemberTests-117232865 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:37:38 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-083d981d-5f38-4f04-9c98-1d457e483e9a tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8191b8d9-afe4-4029-9f17-e57f58185519 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:38 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8191b8d9-afe4-4029-9f17-e57f58185519 1073741824 Jul 07 08:37:38 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:39 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-083d981d-5f38-4f04-9c98-1d457e483e9a tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8191b8d9-afe4-4029-9f17-e57f58185519 1073741824" returned: 0 in 0.925s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:39 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-083d981d-5f38-4f04-9c98-1d457e483e9a tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8191b8d9-afe4-4029-9f17-e57f58185519 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:39 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8191b8d9-afe4-4029-9f17-e57f58185519 Jul 07 08:37:39 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:40 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-083d981d-5f38-4f04-9c98-1d457e483e9a tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8191b8d9-afe4-4029-9f17-e57f58185519" returned: 0 in 0.694s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:40 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-083d981d-5f38-4f04-9c98-1d457e483e9a tempest-ProjectMemberTests-117232865 None] <== create_volume: return (1670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:37:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-083d981d-5f38-4f04-9c98-1d457e483e9a tempest-ProjectMemberTests-117232865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.674s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-083d981d-5f38-4f04-9c98-1d457e483e9a tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bada471-aa68-4aee-b70b-a5c5982a3791) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8191b8d9-afe4-4029-9f17-e57f58185519', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-083d981d-5f38-4f04-9c98-1d457e483e9a tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c686b9ab-a84e-4a39-9722-776ac1d23792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:40 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-083d981d-5f38-4f04-9c98-1d457e483e9a tempest-ProjectMemberTests-117232865 None] Volume volume-8191b8d9-afe4-4029-9f17-e57f58185519 (8191b8d9-afe4-4029-9f17-e57f58185519): created successfully Jul 07 08:37:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-083d981d-5f38-4f04-9c98-1d457e483e9a tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c686b9ab-a84e-4a39-9722-776ac1d23792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:40 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-083d981d-5f38-4f04-9c98-1d457e483e9a tempest-ProjectMemberTests-117232865 None] Flow 'volume_create_manager' (74568f7a-0795-4433-af66-81f4b186f649) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:37:40 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-083d981d-5f38-4f04-9c98-1d457e483e9a tempest-ProjectMemberTests-117232865 None] Created volume successfully. Jul 07 08:37:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-de7571b1-0931-4d05-81f3-dbbe0be436d5 tempest-ProjectMemberTests-117232865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-de7571b1-0931-4d05-81f3-dbbe0be436d5 tempest-ProjectMemberTests-117232865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:40 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-de7571b1-0931-4d05-81f3-dbbe0be436d5 tempest-ProjectMemberTests-117232865 None] Creating offline snapshot 0597cc8c-b602-439f-95b8-c05dc8aa5b84 of volume 8191b8d9-afe4-4029-9f17-e57f58185519 {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:37:40 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[52845d9a-071f-4083-8b95-9edced0a4875]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:37:40 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-de7571b1-0931-4d05-81f3-dbbe0be436d5 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8191b8d9-afe4-4029-9f17-e57f58185519 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:40 devstack sudo[106358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8191b8d9-afe4-4029-9f17-e57f58185519 Jul 07 08:37:40 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:41 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-de7571b1-0931-4d05-81f3-dbbe0be436d5 tempest-ProjectMemberTests-117232865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8191b8d9-afe4-4029-9f17-e57f58185519" returned: 0 in 0.827s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:41 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-de7571b1-0931-4d05-81f3-dbbe0be436d5 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8191b8d9-afe4-4029-9f17-e57f58185519,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8191b8d9-afe4-4029-9f17-e57f58185519.0597cc8c-b602-439f-95b8-c05dc8aa5b84 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:41 devstack sudo[106364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8191b8d9-afe4-4029-9f17-e57f58185519,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8191b8d9-afe4-4029-9f17-e57f58185519.0597cc8c-b602-439f-95b8-c05dc8aa5b84 1G Jul 07 08:37:41 devstack sudo[106364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:42 devstack sudo[106364]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-de7571b1-0931-4d05-81f3-dbbe0be436d5 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8191b8d9-afe4-4029-9f17-e57f58185519,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8191b8d9-afe4-4029-9f17-e57f58185519.0597cc8c-b602-439f-95b8-c05dc8aa5b84 1G" returned: 0 in 0.779s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:42 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-de7571b1-0931-4d05-81f3-dbbe0be436d5 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8191b8d9-afe4-4029-9f17-e57f58185519 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8191b8d9-afe4-4029-9f17-e57f58185519.0597cc8c-b602-439f-95b8-c05dc8aa5b84 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:42 devstack sudo[106371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8191b8d9-afe4-4029-9f17-e57f58185519 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8191b8d9-afe4-4029-9f17-e57f58185519.0597cc8c-b602-439f-95b8-c05dc8aa5b84 Jul 07 08:37:42 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:43 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-de7571b1-0931-4d05-81f3-dbbe0be436d5 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8191b8d9-afe4-4029-9f17-e57f58185519 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8191b8d9-afe4-4029-9f17-e57f58185519.0597cc8c-b602-439f-95b8-c05dc8aa5b84" returned: 0 in 0.682s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:43 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-de7571b1-0931-4d05-81f3-dbbe0be436d5 tempest-ProjectMemberTests-117232865 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8191b8d9-afe4-4029-9f17-e57f58185519.0597cc8c-b602-439f-95b8-c05dc8aa5b84 is being set with open permissions: ugo+rw Jul 07 08:37:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-de7571b1-0931-4d05-81f3-dbbe0be436d5 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8191b8d9-afe4-4029-9f17-e57f58185519.0597cc8c-b602-439f-95b8-c05dc8aa5b84 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:43 devstack sudo[106376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8191b8d9-afe4-4029-9f17-e57f58185519.0597cc8c-b602-439f-95b8-c05dc8aa5b84 Jul 07 08:37:43 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:43 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-de7571b1-0931-4d05-81f3-dbbe0be436d5 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8191b8d9-afe4-4029-9f17-e57f58185519.0597cc8c-b602-439f-95b8-c05dc8aa5b84" returned: 0 in 0.645s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:43 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-de7571b1-0931-4d05-81f3-dbbe0be436d5 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8191b8d9-afe4-4029-9f17-e57f58185519.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:43 devstack sudo[106379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8191b8d9-afe4-4029-9f17-e57f58185519.info Jul 07 08:37:43 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:44 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-de7571b1-0931-4d05-81f3-dbbe0be436d5 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8191b8d9-afe4-4029-9f17-e57f58185519.info" returned: 0 in 0.659s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:44 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-de7571b1-0931-4d05-81f3-dbbe0be436d5 tempest-ProjectMemberTests-117232865 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8191b8d9-afe4-4029-9f17-e57f58185519.info is being set with open permissions: ugo+rw Jul 07 08:37:44 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-de7571b1-0931-4d05-81f3-dbbe0be436d5 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8191b8d9-afe4-4029-9f17-e57f58185519.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:44 devstack sudo[106382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8191b8d9-afe4-4029-9f17-e57f58185519.info Jul 07 08:37:44 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:45 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-de7571b1-0931-4d05-81f3-dbbe0be436d5 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8191b8d9-afe4-4029-9f17-e57f58185519.info" returned: 0 in 0.637s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:45 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-de7571b1-0931-4d05-81f3-dbbe0be436d5 tempest-ProjectMemberTests-117232865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.312s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:45 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-de7571b1-0931-4d05-81f3-dbbe0be436d5 tempest-ProjectMemberTests-117232865 None] Create snapshot completed successfully Jul 07 08:37:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-965cbaf0-ecf8-4f2d-90ac-5e806031baa6 tempest-ProjectMemberTests-117232865 None] Acquiring lock "cinder-0597cc8c-b602-439f-95b8-c05dc8aa5b84-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:37:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-965cbaf0-ecf8-4f2d-90ac-5e806031baa6 tempest-ProjectMemberTests-117232865 None] Lock "cinder-0597cc8c-b602-439f-95b8-c05dc8aa5b84-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:37:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-965cbaf0-ecf8-4f2d-90ac-5e806031baa6 tempest-ProjectMemberTests-117232865 None] Acquiring lock "cinder-quobyte-8191b8d9-afe4-4029-9f17-e57f58185519" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:37:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-965cbaf0-ecf8-4f2d-90ac-5e806031baa6 tempest-ProjectMemberTests-117232865 None] Lock "cinder-quobyte-8191b8d9-afe4-4029-9f17-e57f58185519" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:37:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-965cbaf0-ecf8-4f2d-90ac-5e806031baa6 tempest-ProjectMemberTests-117232865 None] Acquiring lock "cinder-quobyte-0597cc8c-b602-439f-95b8-c05dc8aa5b84" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:37:46 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-965cbaf0-ecf8-4f2d-90ac-5e806031baa6 tempest-ProjectMemberTests-117232865 None] Lock "cinder-quobyte-0597cc8c-b602-439f-95b8-c05dc8aa5b84" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:37:46 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-965cbaf0-ecf8-4f2d-90ac-5e806031baa6 tempest-ProjectMemberTests-117232865 None] Deleting offline snapshot 0597cc8c-b602-439f-95b8-c05dc8aa5b84 of volume 8191b8d9-afe4-4029-9f17-e57f58185519 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:37:46 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-965cbaf0-ecf8-4f2d-90ac-5e806031baa6 tempest-ProjectMemberTests-117232865 None] snapshot_file for this snap is: volume-8191b8d9-afe4-4029-9f17-e57f58185519.0597cc8c-b602-439f-95b8-c05dc8aa5b84 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:37:46 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42e2794-103c-4301-8f6c-8a2893918784]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:37:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-965cbaf0-ecf8-4f2d-90ac-5e806031baa6 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8191b8d9-afe4-4029-9f17-e57f58185519.0597cc8c-b602-439f-95b8-c05dc8aa5b84 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:46 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8191b8d9-afe4-4029-9f17-e57f58185519.0597cc8c-b602-439f-95b8-c05dc8aa5b84 Jul 07 08:37:46 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:46 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-965cbaf0-ecf8-4f2d-90ac-5e806031baa6 tempest-ProjectMemberTests-117232865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8191b8d9-afe4-4029-9f17-e57f58185519.0597cc8c-b602-439f-95b8-c05dc8aa5b84" returned: 0 in 0.724s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:46 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-965cbaf0-ecf8-4f2d-90ac-5e806031baa6 tempest-ProjectMemberTests-117232865 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8191b8d9-afe4-4029-9f17-e57f58185519(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:37:46 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2650e86-cb05-4d57-887c-1fd9beed6248]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:37:46 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-965cbaf0-ecf8-4f2d-90ac-5e806031baa6 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8191b8d9-afe4-4029-9f17-e57f58185519 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:46 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8191b8d9-afe4-4029-9f17-e57f58185519 Jul 07 08:37:46 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:47 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-965cbaf0-ecf8-4f2d-90ac-5e806031baa6 tempest-ProjectMemberTests-117232865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8191b8d9-afe4-4029-9f17-e57f58185519" returned: 0 in 0.709s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:47 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-965cbaf0-ecf8-4f2d-90ac-5e806031baa6 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8191b8d9-afe4-4029-9f17-e57f58185519.0597cc8c-b602-439f-95b8-c05dc8aa5b84 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:47 devstack sudo[106395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8191b8d9-afe4-4029-9f17-e57f58185519.0597cc8c-b602-439f-95b8-c05dc8aa5b84 Jul 07 08:37:47 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:48 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-965cbaf0-ecf8-4f2d-90ac-5e806031baa6 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8191b8d9-afe4-4029-9f17-e57f58185519.0597cc8c-b602-439f-95b8-c05dc8aa5b84" returned: 0 in 0.700s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-965cbaf0-ecf8-4f2d-90ac-5e806031baa6 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8191b8d9-afe4-4029-9f17-e57f58185519.0597cc8c-b602-439f-95b8-c05dc8aa5b84 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:48 devstack sudo[106406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8191b8d9-afe4-4029-9f17-e57f58185519.0597cc8c-b602-439f-95b8-c05dc8aa5b84 Jul 07 08:37:48 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:48 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:48 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-965cbaf0-ecf8-4f2d-90ac-5e806031baa6 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8191b8d9-afe4-4029-9f17-e57f58185519.0597cc8c-b602-439f-95b8-c05dc8aa5b84" returned: 0 in 0.605s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-965cbaf0-ecf8-4f2d-90ac-5e806031baa6 tempest-ProjectMemberTests-117232865 None] Lock "cinder-quobyte-0597cc8c-b602-439f-95b8-c05dc8aa5b84" released by "_delete_snapshot" :: held 2.820s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:37:48 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-965cbaf0-ecf8-4f2d-90ac-5e806031baa6 tempest-ProjectMemberTests-117232865 None] Lock "cinder-quobyte-8191b8d9-afe4-4029-9f17-e57f58185519" released by "delete_snapshot" :: held 2.844s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:37:48 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-965cbaf0-ecf8-4f2d-90ac-5e806031baa6 tempest-ProjectMemberTests-117232865 None] Created reservations ['bfc30e3d-3b5e-4edd-93ef-541554d03d81', '93257bca-3270-4160-bd45-9e1336f04430', 'c9968ed2-4e3a-493b-86f2-cbab845c8104', 'd3bf29ab-8a50-4f32-a5bd-47a55a55b3be'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:37:48 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-965cbaf0-ecf8-4f2d-90ac-5e806031baa6 tempest-ProjectMemberTests-117232865 None] Delete snapshot completed successfully. Jul 07 08:37:49 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-965cbaf0-ecf8-4f2d-90ac-5e806031baa6 tempest-ProjectMemberTests-117232865 None] Lock "cinder-0597cc8c-b602-439f-95b8-c05dc8aa5b84-delete_snapshot" released by "delete_snapshot" :: held 2.967s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:37:49 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-1dff8804-234c-4632-a6a0-705410de440b tempest-ProjectMemberTests-117232865 None] Acquiring lock "cinder-8191b8d9-afe4-4029-9f17-e57f58185519-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:37:49 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-1dff8804-234c-4632-a6a0-705410de440b tempest-ProjectMemberTests-117232865 None] Lock "cinder-8191b8d9-afe4-4029-9f17-e57f58185519-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:37:49 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-1dff8804-234c-4632-a6a0-705410de440b tempest-ProjectMemberTests-117232865 None] Acquiring lock "cinder-quobyte-8191b8d9-afe4-4029-9f17-e57f58185519" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:37:49 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-1dff8804-234c-4632-a6a0-705410de440b tempest-ProjectMemberTests-117232865 None] Lock "cinder-quobyte-8191b8d9-afe4-4029-9f17-e57f58185519" acquired by "delete_volume" :: waited 0.013s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:37:49 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a514bf7-21c6-4395-8432-0cf10b7e5d96]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:37:49 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1dff8804-234c-4632-a6a0-705410de440b tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8191b8d9-afe4-4029-9f17-e57f58185519 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:49 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8191b8d9-afe4-4029-9f17-e57f58185519 Jul 07 08:37:49 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:50 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1dff8804-234c-4632-a6a0-705410de440b tempest-ProjectMemberTests-117232865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8191b8d9-afe4-4029-9f17-e57f58185519" returned: 0 in 0.712s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1dff8804-234c-4632-a6a0-705410de440b tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8191b8d9-afe4-4029-9f17-e57f58185519 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:50 devstack sudo[106414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8191b8d9-afe4-4029-9f17-e57f58185519 Jul 07 08:37:50 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:50 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1dff8804-234c-4632-a6a0-705410de440b tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8191b8d9-afe4-4029-9f17-e57f58185519" returned: 0 in 0.636s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:50 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-1dff8804-234c-4632-a6a0-705410de440b tempest-ProjectMemberTests-117232865 None] Lock "cinder-quobyte-8191b8d9-afe4-4029-9f17-e57f58185519" released by "delete_volume" :: held 1.398s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:37:50 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-1dff8804-234c-4632-a6a0-705410de440b tempest-ProjectMemberTests-117232865 None] Created reservations ['72d9da26-a6b2-4b58-87e7-11efaf2fe8c0', '8e7d00b2-10b4-41e1-a96e-9a03d3bbff9f', '90bc5d44-0bdf-4c29-9f8b-f80be4fd6bb9', 'ebba2b7a-1e05-4c63-a986-421aa2f1581e'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:37:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1dff8804-234c-4632-a6a0-705410de440b tempest-ProjectMemberTests-117232865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1dff8804-234c-4632-a6a0-705410de440b tempest-ProjectMemberTests-117232865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:50 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1dff8804-234c-4632-a6a0-705410de440b tempest-ProjectMemberTests-117232865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:37:50 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-1dff8804-234c-4632-a6a0-705410de440b tempest-ProjectMemberTests-117232865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:37:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-1dff8804-234c-4632-a6a0-705410de440b tempest-ProjectMemberTests-117232865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:50 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1dff8804-234c-4632-a6a0-705410de440b tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:50 devstack sudo[106417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:37:50 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:51 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-1dff8804-234c-4632-a6a0-705410de440b tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.599s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:51 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-1dff8804-234c-4632-a6a0-705410de440b tempest-ProjectMemberTests-117232865 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:37:51 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-1dff8804-234c-4632-a6a0-705410de440b tempest-ProjectMemberTests-117232865 None] Deleted volume successfully. Jul 07 08:37:51 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-1dff8804-234c-4632-a6a0-705410de440b tempest-ProjectMemberTests-117232865 None] Lock "cinder-8191b8d9-afe4-4029-9f17-e57f58185519-delete_volume" released by "delete_volume" :: held 2.176s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:37:51 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-34954d17-8ea2-4050-b819-6b6adbe93a43 tempest-ProjectMemberTests-117232865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:37:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-34954d17-8ea2-4050-b819-6b6adbe93a43 tempest-ProjectMemberTests-117232865 None] Flow 'volume_create_manager' (28efa592-be22-4087-bc96-14de1f523e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:37:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-34954d17-8ea2-4050-b819-6b6adbe93a43 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac79305a-5667-4048-820c-a0060405d77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-34954d17-8ea2-4050-b819-6b6adbe93a43 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac79305a-5667-4048-820c-a0060405d77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:37:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-172103832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80fb7ca8-142b-4544-aaf0-ef221ab2cbf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac2688c9df5545018de78c47a9e5a401',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:37:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:37:52Z,use_quota=True,user_id='11de70d1cfa0463dbad27ce8dcab2b39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-34954d17-8ea2-4050-b819-6b6adbe93a43 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7ab6bd8-c59d-4d12-89c2-c4f2237e4204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-34954d17-8ea2-4050-b819-6b6adbe93a43 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7ab6bd8-c59d-4d12-89c2-c4f2237e4204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-34954d17-8ea2-4050-b819-6b6adbe93a43 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db45eff5-e20e-490b-b5a1-dc3a16e6093d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-34954d17-8ea2-4050-b819-6b6adbe93a43 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db45eff5-e20e-490b-b5a1-dc3a16e6093d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80fb7ca8-142b-4544-aaf0-ef221ab2cbf9', 'volume_name': 'volume-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-34954d17-8ea2-4050-b819-6b6adbe93a43 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2134b193-84d3-47f6-9854-22071d79407d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-34954d17-8ea2-4050-b819-6b6adbe93a43 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2134b193-84d3-47f6-9854-22071d79407d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:51 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-34954d17-8ea2-4050-b819-6b6adbe93a43 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af4e0900-6bdb-4043-89db-39619974d319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:51 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-34954d17-8ea2-4050-b819-6b6adbe93a43 tempest-ProjectMemberTests-117232865 None] Volume 80fb7ca8-142b-4544-aaf0-ef221ab2cbf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9', 'volume_size': 1} Jul 07 08:37:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-34954d17-8ea2-4050-b819-6b6adbe93a43 tempest-ProjectMemberTests-117232865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-34954d17-8ea2-4050-b819-6b6adbe93a43 tempest-ProjectMemberTests-117232865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:51 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-34954d17-8ea2-4050-b819-6b6adbe93a43 tempest-ProjectMemberTests-117232865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:37:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-172103832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80fb7ca8-142b-4544-aaf0-ef221ab2cbf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac2688c9df5545018de78c47a9e5a401',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:37:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:37:52Z,use_quota=True,user_id='11de70d1cfa0463dbad27ce8dcab2b39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:37:51 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-34954d17-8ea2-4050-b819-6b6adbe93a43 tempest-ProjectMemberTests-117232865 None] Creating volume 80fb7ca8-142b-4544-aaf0-ef221ab2cbf9 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:37:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-34954d17-8ea2-4050-b819-6b6adbe93a43 tempest-ProjectMemberTests-117232865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-34954d17-8ea2-4050-b819-6b6adbe93a43 tempest-ProjectMemberTests-117232865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:51 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-34954d17-8ea2-4050-b819-6b6adbe93a43 tempest-ProjectMemberTests-117232865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:37:51 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-34954d17-8ea2-4050-b819-6b6adbe93a43 tempest-ProjectMemberTests-117232865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:37:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-34954d17-8ea2-4050-b819-6b6adbe93a43 tempest-ProjectMemberTests-117232865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:51 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-34954d17-8ea2-4050-b819-6b6adbe93a43 tempest-ProjectMemberTests-117232865 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:37:51 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-34954d17-8ea2-4050-b819-6b6adbe93a43 tempest-ProjectMemberTests-117232865 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:37:51 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-34954d17-8ea2-4050-b819-6b6adbe93a43 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:51 devstack sudo[106421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9 1073741824 Jul 07 08:37:51 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:52 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-34954d17-8ea2-4050-b819-6b6adbe93a43 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9 1073741824" returned: 0 in 0.840s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:52 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-34954d17-8ea2-4050-b819-6b6adbe93a43 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:52 devstack sudo[106427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9 Jul 07 08:37:52 devstack sudo[106427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:53 devstack sudo[106427]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-34954d17-8ea2-4050-b819-6b6adbe93a43 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9" returned: 0 in 0.628s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:53 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-34954d17-8ea2-4050-b819-6b6adbe93a43 tempest-ProjectMemberTests-117232865 None] <== create_volume: return (1511ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:37:53 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-34954d17-8ea2-4050-b819-6b6adbe93a43 tempest-ProjectMemberTests-117232865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.514s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:53 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-34954d17-8ea2-4050-b819-6b6adbe93a43 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af4e0900-6bdb-4043-89db-39619974d319) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:53 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-34954d17-8ea2-4050-b819-6b6adbe93a43 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afa414be-f5bb-4dce-b70f-2626f60e9eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:53 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-34954d17-8ea2-4050-b819-6b6adbe93a43 tempest-ProjectMemberTests-117232865 None] Volume volume-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9 (80fb7ca8-142b-4544-aaf0-ef221ab2cbf9): created successfully Jul 07 08:37:53 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-34954d17-8ea2-4050-b819-6b6adbe93a43 tempest-ProjectMemberTests-117232865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afa414be-f5bb-4dce-b70f-2626f60e9eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:53 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-34954d17-8ea2-4050-b819-6b6adbe93a43 tempest-ProjectMemberTests-117232865 None] Flow 'volume_create_manager' (28efa592-be22-4087-bc96-14de1f523e59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:37:53 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-34954d17-8ea2-4050-b819-6b6adbe93a43 tempest-ProjectMemberTests-117232865 None] Created volume successfully. Jul 07 08:37:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-551c3d5d-e2be-4ad3-9059-d3ed743c5a5b tempest-ProjectMemberTests-117232865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-551c3d5d-e2be-4ad3-9059-d3ed743c5a5b tempest-ProjectMemberTests-117232865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:54 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-551c3d5d-e2be-4ad3-9059-d3ed743c5a5b tempest-ProjectMemberTests-117232865 None] Creating offline snapshot 626b7e1c-acd2-4cc4-af91-0d53de6b6c45 of volume 80fb7ca8-142b-4544-aaf0-ef221ab2cbf9 {{(pid=87199) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:37:54 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[7835e4ff-d22d-4112-a4a8-dce1cf0ebb76]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:37:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-551c3d5d-e2be-4ad3-9059-d3ed743c5a5b tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:54 devstack sudo[106430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9 Jul 07 08:37:54 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:54 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-551c3d5d-e2be-4ad3-9059-d3ed743c5a5b tempest-ProjectMemberTests-117232865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9" returned: 0 in 0.769s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:54 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-551c3d5d-e2be-4ad3-9059-d3ed743c5a5b tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9.626b7e1c-acd2-4cc4-af91-0d53de6b6c45 1G {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:54 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9.626b7e1c-acd2-4cc4-af91-0d53de6b6c45 1G Jul 07 08:37:54 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:55 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-551c3d5d-e2be-4ad3-9059-d3ed743c5a5b tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9.626b7e1c-acd2-4cc4-af91-0d53de6b6c45 1G" returned: 0 in 0.778s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:55 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-551c3d5d-e2be-4ad3-9059-d3ed743c5a5b tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9.626b7e1c-acd2-4cc4-af91-0d53de6b6c45 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:55 devstack sudo[106441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9.626b7e1c-acd2-4cc4-af91-0d53de6b6c45 Jul 07 08:37:55 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:56 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-551c3d5d-e2be-4ad3-9059-d3ed743c5a5b tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9 -F qcow2 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9.626b7e1c-acd2-4cc4-af91-0d53de6b6c45" returned: 0 in 0.699s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:56 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-551c3d5d-e2be-4ad3-9059-d3ed743c5a5b tempest-ProjectMemberTests-117232865 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9.626b7e1c-acd2-4cc4-af91-0d53de6b6c45 is being set with open permissions: ugo+rw Jul 07 08:37:56 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-551c3d5d-e2be-4ad3-9059-d3ed743c5a5b tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9.626b7e1c-acd2-4cc4-af91-0d53de6b6c45 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:56 devstack sudo[106447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9.626b7e1c-acd2-4cc4-af91-0d53de6b6c45 Jul 07 08:37:56 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:57 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-551c3d5d-e2be-4ad3-9059-d3ed743c5a5b tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9.626b7e1c-acd2-4cc4-af91-0d53de6b6c45" returned: 0 in 0.673s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-551c3d5d-e2be-4ad3-9059-d3ed743c5a5b tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:57 devstack sudo[106451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9.info Jul 07 08:37:57 devstack sudo[106451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:57 devstack sudo[106451]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-551c3d5d-e2be-4ad3-9059-d3ed743c5a5b tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9.info" returned: 0 in 0.667s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:57 devstack cinder-volume[87199]: WARNING cinder.volume.drivers.remotefs [None req-551c3d5d-e2be-4ad3-9059-d3ed743c5a5b tempest-ProjectMemberTests-117232865 None] /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9.info is being set with open permissions: ugo+rw Jul 07 08:37:57 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-551c3d5d-e2be-4ad3-9059-d3ed743c5a5b tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9.info {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:57 devstack sudo[106454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9.info Jul 07 08:37:57 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:58 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-551c3d5d-e2be-4ad3-9059-d3ed743c5a5b tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9.info" returned: 0 in 0.672s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:58 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-551c3d5d-e2be-4ad3-9059-d3ed743c5a5b tempest-ProjectMemberTests-117232865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.338s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:58 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-551c3d5d-e2be-4ad3-9059-d3ed743c5a5b tempest-ProjectMemberTests-117232865 None] Create snapshot completed successfully Jul 07 08:37:59 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6941b502-2c6b-48f2-a72f-5ec8e951d846 tempest-ProjectMemberTests-117232865 None] Acquiring lock "cinder-626b7e1c-acd2-4cc4-af91-0d53de6b6c45-delete_snapshot" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:37:59 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6941b502-2c6b-48f2-a72f-5ec8e951d846 tempest-ProjectMemberTests-117232865 None] Lock "cinder-626b7e1c-acd2-4cc4-af91-0d53de6b6c45-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:37:59 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6941b502-2c6b-48f2-a72f-5ec8e951d846 tempest-ProjectMemberTests-117232865 None] Acquiring lock "cinder-quobyte-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9" by "delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:37:59 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6941b502-2c6b-48f2-a72f-5ec8e951d846 tempest-ProjectMemberTests-117232865 None] Lock "cinder-quobyte-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:37:59 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6941b502-2c6b-48f2-a72f-5ec8e951d846 tempest-ProjectMemberTests-117232865 None] Acquiring lock "cinder-quobyte-626b7e1c-acd2-4cc4-af91-0d53de6b6c45" by "_delete_snapshot" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:37:59 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6941b502-2c6b-48f2-a72f-5ec8e951d846 tempest-ProjectMemberTests-117232865 None] Lock "cinder-quobyte-626b7e1c-acd2-4cc4-af91-0d53de6b6c45" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:37:59 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-6941b502-2c6b-48f2-a72f-5ec8e951d846 tempest-ProjectMemberTests-117232865 None] Deleting offline snapshot 626b7e1c-acd2-4cc4-af91-0d53de6b6c45 of volume 80fb7ca8-142b-4544-aaf0-ef221ab2cbf9 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:37:59 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-6941b502-2c6b-48f2-a72f-5ec8e951d846 tempest-ProjectMemberTests-117232865 None] snapshot_file for this snap is: volume-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9.626b7e1c-acd2-4cc4-af91-0d53de6b6c45 {{(pid=87199) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:37:59 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ebdfea-082f-45f0-90f2-7eea2968cd8f]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:37:59 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6941b502-2c6b-48f2-a72f-5ec8e951d846 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9.626b7e1c-acd2-4cc4-af91-0d53de6b6c45 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:59 devstack sudo[106458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9.626b7e1c-acd2-4cc4-af91-0d53de6b6c45 Jul 07 08:37:59 devstack sudo[106458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:00 devstack sudo[106458]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6941b502-2c6b-48f2-a72f-5ec8e951d846 tempest-ProjectMemberTests-117232865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9.626b7e1c-acd2-4cc4-af91-0d53de6b6c45" returned: 0 in 0.756s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:00 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-6941b502-2c6b-48f2-a72f-5ec8e951d846 tempest-ProjectMemberTests-117232865 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87199) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:38:00 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f012e9-d2ec-48c6-aab8-99efc2813f9f]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:38:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6941b502-2c6b-48f2-a72f-5ec8e951d846 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:00 devstack sudo[106463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9 Jul 07 08:38:00 devstack sudo[106463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:00 devstack sudo[106463]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6941b502-2c6b-48f2-a72f-5ec8e951d846 tempest-ProjectMemberTests-117232865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9" returned: 0 in 0.746s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:00 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6941b502-2c6b-48f2-a72f-5ec8e951d846 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9.626b7e1c-acd2-4cc4-af91-0d53de6b6c45 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:01 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9.626b7e1c-acd2-4cc4-af91-0d53de6b6c45 Jul 07 08:38:01 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:01 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6941b502-2c6b-48f2-a72f-5ec8e951d846 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9.626b7e1c-acd2-4cc4-af91-0d53de6b6c45" returned: 0 in 0.721s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:01 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6941b502-2c6b-48f2-a72f-5ec8e951d846 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9.626b7e1c-acd2-4cc4-af91-0d53de6b6c45 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:01 devstack sudo[106476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9.626b7e1c-acd2-4cc4-af91-0d53de6b6c45 Jul 07 08:38:01 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:02 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:02 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-6941b502-2c6b-48f2-a72f-5ec8e951d846 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9.626b7e1c-acd2-4cc4-af91-0d53de6b6c45" returned: 0 in 0.697s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:02 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6941b502-2c6b-48f2-a72f-5ec8e951d846 tempest-ProjectMemberTests-117232865 None] Lock "cinder-quobyte-626b7e1c-acd2-4cc4-af91-0d53de6b6c45" released by "_delete_snapshot" :: held 3.012s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:02 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6941b502-2c6b-48f2-a72f-5ec8e951d846 tempest-ProjectMemberTests-117232865 None] Lock "cinder-quobyte-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9" released by "delete_snapshot" :: held 3.037s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:02 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-6941b502-2c6b-48f2-a72f-5ec8e951d846 tempest-ProjectMemberTests-117232865 None] Created reservations ['e564aee0-75f0-4f92-a8ed-d6abe2d974ec', '51102058-80ea-4b01-87b9-780c4f2baa39', '04c65b8d-0acf-48f5-9111-5787157e0314', 'a5ba0fad-3f33-452c-b1ee-7aec348b3493'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:38:02 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-6941b502-2c6b-48f2-a72f-5ec8e951d846 tempest-ProjectMemberTests-117232865 None] Delete snapshot completed successfully. Jul 07 08:38:02 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-6941b502-2c6b-48f2-a72f-5ec8e951d846 tempest-ProjectMemberTests-117232865 None] Lock "cinder-626b7e1c-acd2-4cc4-af91-0d53de6b6c45-delete_snapshot" released by "delete_snapshot" :: held 3.395s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:04 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-74f141d9-6cd4-4e13-a3d3-df77f3985eb9 tempest-ProjectMemberTests-117232865 None] Acquiring lock "cinder-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:04 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-74f141d9-6cd4-4e13-a3d3-df77f3985eb9 tempest-ProjectMemberTests-117232865 None] Lock "cinder-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:04 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-74f141d9-6cd4-4e13-a3d3-df77f3985eb9 tempest-ProjectMemberTests-117232865 None] Acquiring lock "cinder-quobyte-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:04 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-74f141d9-6cd4-4e13-a3d3-df77f3985eb9 tempest-ProjectMemberTests-117232865 None] Lock "cinder-quobyte-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9" acquired by "delete_volume" :: waited 0.017s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:04 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e62f525-e442-41d8-b940-13dae3cdc588]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:38:04 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-74f141d9-6cd4-4e13-a3d3-df77f3985eb9 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:04 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9 Jul 07 08:38:04 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:05 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-74f141d9-6cd4-4e13-a3d3-df77f3985eb9 tempest-ProjectMemberTests-117232865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9" returned: 0 in 0.853s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-74f141d9-6cd4-4e13-a3d3-df77f3985eb9 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:05 devstack sudo[106485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9 Jul 07 08:38:05 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:05 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:38:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:38:05 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:38:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:05 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:05 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-74f141d9-6cd4-4e13-a3d3-df77f3985eb9 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9" returned: 0 in 0.686s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:05 devstack sudo[106488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:38:05 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:05 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-74f141d9-6cd4-4e13-a3d3-df77f3985eb9 tempest-ProjectMemberTests-117232865 None] Lock "cinder-quobyte-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9" released by "delete_volume" :: held 1.602s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:05 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=66,cinder:UPDATE=86,cinder:DELETE=10,cinder:INSERT=22 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:38:06 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-74f141d9-6cd4-4e13-a3d3-df77f3985eb9 tempest-ProjectMemberTests-117232865 None] Created reservations ['7625ea7d-5656-4beb-8d5d-a385d2cd0fb0', 'cc992098-1159-4fce-8e59-b9e8cdf22466', '30e9b98b-9253-43f6-9ce8-3b709048e7cc', 'ce5bc93b-370f-4e68-a763-be9b411430b6'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:38:06 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:SELECT=85,cinder:INSERT=31,cinder:UPDATE=96,cinder:DELETE=5 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:38:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-74f141d9-6cd4-4e13-a3d3-df77f3985eb9 tempest-ProjectMemberTests-117232865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-74f141d9-6cd4-4e13-a3d3-df77f3985eb9 tempest-ProjectMemberTests-117232865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-74f141d9-6cd4-4e13-a3d3-df77f3985eb9 tempest-ProjectMemberTests-117232865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:38:06 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-74f141d9-6cd4-4e13-a3d3-df77f3985eb9 tempest-ProjectMemberTests-117232865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:38:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-74f141d9-6cd4-4e13-a3d3-df77f3985eb9 tempest-ProjectMemberTests-117232865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-74f141d9-6cd4-4e13-a3d3-df77f3985eb9 tempest-ProjectMemberTests-117232865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:06 devstack sudo[106490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:38:06 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:06 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:06 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.751s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:06 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:38:06 devstack cinder-volume[87199]: DEBUG oslo_service.periodic_task [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] Running periodic task VolumeManager._thread_info {{(pid=87199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:38:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] thread count: 29 {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 08:38:06 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-ad9ec9b8-2fe1-4f11-858c-9761832b93fb None None] thread info: [<_MainThread(MainThread, started 133056092332160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 08:38:07 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:07 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-74f141d9-6cd4-4e13-a3d3-df77f3985eb9 tempest-ProjectMemberTests-117232865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.731s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:07 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-74f141d9-6cd4-4e13-a3d3-df77f3985eb9 tempest-ProjectMemberTests-117232865 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:38:07 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-74f141d9-6cd4-4e13-a3d3-df77f3985eb9 tempest-ProjectMemberTests-117232865 None] Deleted volume successfully. Jul 07 08:38:07 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-74f141d9-6cd4-4e13-a3d3-df77f3985eb9 tempest-ProjectMemberTests-117232865 None] Lock "cinder-80fb7ca8-142b-4544-aaf0-ef221ab2cbf9-delete_volume" released by "delete_volume" :: held 2.978s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:10 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-c00e8dcf-10f7-4dbf-829c-5ebf77e73993 tempest-ProjectReaderTests-1536509139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:38:10 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c00e8dcf-10f7-4dbf-829c-5ebf77e73993 tempest-ProjectReaderTests-1536509139 None] Flow 'volume_create_manager' (f3e0a202-2401-490c-a377-ebd34674ceff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:38:10 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c00e8dcf-10f7-4dbf-829c-5ebf77e73993 tempest-ProjectReaderTests-1536509139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (753e3279-4400-4c6b-a635-63cbd74d74cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:10 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c00e8dcf-10f7-4dbf-829c-5ebf77e73993 tempest-ProjectReaderTests-1536509139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (753e3279-4400-4c6b-a635-63cbd74d74cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:38:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-19012055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c72e4c4-67ac-4127-95b4-1e59dacc2bd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d07b3cb378e4cc2a5d0a45f11a8531b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:38:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:38:10Z,use_quota=True,user_id='67e5db4184424ffa814022ce93fa19a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:10 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c00e8dcf-10f7-4dbf-829c-5ebf77e73993 tempest-ProjectReaderTests-1536509139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51a9ecbc-9480-48df-9b70-06858a9984d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:10 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c00e8dcf-10f7-4dbf-829c-5ebf77e73993 tempest-ProjectReaderTests-1536509139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51a9ecbc-9480-48df-9b70-06858a9984d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:10 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c00e8dcf-10f7-4dbf-829c-5ebf77e73993 tempest-ProjectReaderTests-1536509139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6569009b-cad5-412e-a8ec-8b5b4193384a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:10 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c00e8dcf-10f7-4dbf-829c-5ebf77e73993 tempest-ProjectReaderTests-1536509139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6569009b-cad5-412e-a8ec-8b5b4193384a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c72e4c4-67ac-4127-95b4-1e59dacc2bd1', 'volume_name': 'volume-3c72e4c4-67ac-4127-95b4-1e59dacc2bd1', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:10 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c00e8dcf-10f7-4dbf-829c-5ebf77e73993 tempest-ProjectReaderTests-1536509139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed491700-b132-4284-b10f-18f6f2ddc00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:10 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c00e8dcf-10f7-4dbf-829c-5ebf77e73993 tempest-ProjectReaderTests-1536509139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed491700-b132-4284-b10f-18f6f2ddc00e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:10 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c00e8dcf-10f7-4dbf-829c-5ebf77e73993 tempest-ProjectReaderTests-1536509139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e1db3e9-3560-4dcc-ab9d-0d9b70f080f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:10 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-c00e8dcf-10f7-4dbf-829c-5ebf77e73993 tempest-ProjectReaderTests-1536509139 None] Volume 3c72e4c4-67ac-4127-95b4-1e59dacc2bd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c72e4c4-67ac-4127-95b4-1e59dacc2bd1', 'volume_size': 1} Jul 07 08:38:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c00e8dcf-10f7-4dbf-829c-5ebf77e73993 tempest-ProjectReaderTests-1536509139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c00e8dcf-10f7-4dbf-829c-5ebf77e73993 tempest-ProjectReaderTests-1536509139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:10 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c00e8dcf-10f7-4dbf-829c-5ebf77e73993 tempest-ProjectReaderTests-1536509139 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:38:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-19012055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c72e4c4-67ac-4127-95b4-1e59dacc2bd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d07b3cb378e4cc2a5d0a45f11a8531b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:38:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:38:10Z,use_quota=True,user_id='67e5db4184424ffa814022ce93fa19a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:38:10 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-c00e8dcf-10f7-4dbf-829c-5ebf77e73993 tempest-ProjectReaderTests-1536509139 None] Creating volume 3c72e4c4-67ac-4127-95b4-1e59dacc2bd1 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:38:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c00e8dcf-10f7-4dbf-829c-5ebf77e73993 tempest-ProjectReaderTests-1536509139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c00e8dcf-10f7-4dbf-829c-5ebf77e73993 tempest-ProjectReaderTests-1536509139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:10 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c00e8dcf-10f7-4dbf-829c-5ebf77e73993 tempest-ProjectReaderTests-1536509139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:38:10 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c00e8dcf-10f7-4dbf-829c-5ebf77e73993 tempest-ProjectReaderTests-1536509139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:38:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c00e8dcf-10f7-4dbf-829c-5ebf77e73993 tempest-ProjectReaderTests-1536509139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:10 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c00e8dcf-10f7-4dbf-829c-5ebf77e73993 tempest-ProjectReaderTests-1536509139 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:38:10 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-c00e8dcf-10f7-4dbf-829c-5ebf77e73993 tempest-ProjectReaderTests-1536509139 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:38:10 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c00e8dcf-10f7-4dbf-829c-5ebf77e73993 tempest-ProjectReaderTests-1536509139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3c72e4c4-67ac-4127-95b4-1e59dacc2bd1 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:10 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3c72e4c4-67ac-4127-95b4-1e59dacc2bd1 1073741824 Jul 07 08:38:10 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:11 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c00e8dcf-10f7-4dbf-829c-5ebf77e73993 tempest-ProjectReaderTests-1536509139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3c72e4c4-67ac-4127-95b4-1e59dacc2bd1 1073741824" returned: 0 in 0.776s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c00e8dcf-10f7-4dbf-829c-5ebf77e73993 tempest-ProjectReaderTests-1536509139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3c72e4c4-67ac-4127-95b4-1e59dacc2bd1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:11 devstack sudo[106500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3c72e4c4-67ac-4127-95b4-1e59dacc2bd1 Jul 07 08:38:11 devstack sudo[106500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:11 devstack sudo[106500]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-c00e8dcf-10f7-4dbf-829c-5ebf77e73993 tempest-ProjectReaderTests-1536509139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3c72e4c4-67ac-4127-95b4-1e59dacc2bd1" returned: 0 in 0.646s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:11 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-c00e8dcf-10f7-4dbf-829c-5ebf77e73993 tempest-ProjectReaderTests-1536509139 None] <== create_volume: return (1459ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:38:11 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-c00e8dcf-10f7-4dbf-829c-5ebf77e73993 tempest-ProjectReaderTests-1536509139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.462s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c00e8dcf-10f7-4dbf-829c-5ebf77e73993 tempest-ProjectReaderTests-1536509139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e1db3e9-3560-4dcc-ab9d-0d9b70f080f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c72e4c4-67ac-4127-95b4-1e59dacc2bd1', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c00e8dcf-10f7-4dbf-829c-5ebf77e73993 tempest-ProjectReaderTests-1536509139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aeb1728-f7ca-40a9-a184-4a8b53a48846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:11 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-c00e8dcf-10f7-4dbf-829c-5ebf77e73993 tempest-ProjectReaderTests-1536509139 None] Volume volume-3c72e4c4-67ac-4127-95b4-1e59dacc2bd1 (3c72e4c4-67ac-4127-95b4-1e59dacc2bd1): created successfully Jul 07 08:38:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c00e8dcf-10f7-4dbf-829c-5ebf77e73993 tempest-ProjectReaderTests-1536509139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aeb1728-f7ca-40a9-a184-4a8b53a48846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:11 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-c00e8dcf-10f7-4dbf-829c-5ebf77e73993 tempest-ProjectReaderTests-1536509139 None] Flow 'volume_create_manager' (f3e0a202-2401-490c-a377-ebd34674ceff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:38:11 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-c00e8dcf-10f7-4dbf-829c-5ebf77e73993 tempest-ProjectReaderTests-1536509139 None] Created volume successfully. Jul 07 08:38:12 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7ebb84dc-ce9b-4156-99db-4cbd011a5324 tempest-ProjectReaderTests-1536509139 None] Acquiring lock "cinder-3c72e4c4-67ac-4127-95b4-1e59dacc2bd1-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:12 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7ebb84dc-ce9b-4156-99db-4cbd011a5324 tempest-ProjectReaderTests-1536509139 None] Lock "cinder-3c72e4c4-67ac-4127-95b4-1e59dacc2bd1-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:12 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7ebb84dc-ce9b-4156-99db-4cbd011a5324 tempest-ProjectReaderTests-1536509139 None] Acquiring lock "cinder-quobyte-3c72e4c4-67ac-4127-95b4-1e59dacc2bd1" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:12 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7ebb84dc-ce9b-4156-99db-4cbd011a5324 tempest-ProjectReaderTests-1536509139 None] Lock "cinder-quobyte-3c72e4c4-67ac-4127-95b4-1e59dacc2bd1" acquired by "delete_volume" :: waited 0.014s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:12 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[b983d3b4-c6da-4e53-9b55-53d3fe9bba4e]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:38:12 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7ebb84dc-ce9b-4156-99db-4cbd011a5324 tempest-ProjectReaderTests-1536509139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3c72e4c4-67ac-4127-95b4-1e59dacc2bd1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:12 devstack sudo[106504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3c72e4c4-67ac-4127-95b4-1e59dacc2bd1 Jul 07 08:38:12 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:13 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7ebb84dc-ce9b-4156-99db-4cbd011a5324 tempest-ProjectReaderTests-1536509139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3c72e4c4-67ac-4127-95b4-1e59dacc2bd1" returned: 0 in 0.786s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:13 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7ebb84dc-ce9b-4156-99db-4cbd011a5324 tempest-ProjectReaderTests-1536509139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3c72e4c4-67ac-4127-95b4-1e59dacc2bd1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:13 devstack sudo[106509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3c72e4c4-67ac-4127-95b4-1e59dacc2bd1 Jul 07 08:38:13 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:14 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7ebb84dc-ce9b-4156-99db-4cbd011a5324 tempest-ProjectReaderTests-1536509139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-3c72e4c4-67ac-4127-95b4-1e59dacc2bd1" returned: 0 in 0.662s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:14 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7ebb84dc-ce9b-4156-99db-4cbd011a5324 tempest-ProjectReaderTests-1536509139 None] Lock "cinder-quobyte-3c72e4c4-67ac-4127-95b4-1e59dacc2bd1" released by "delete_volume" :: held 1.492s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:14 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-7ebb84dc-ce9b-4156-99db-4cbd011a5324 tempest-ProjectReaderTests-1536509139 None] Created reservations ['e85d0a7f-f595-47e9-98bf-64ee128a82e8', '24aa29ae-91dd-4612-a17d-c8c4378e496a', '5df1f7ca-9a26-491a-9449-90870aee9856', '9ac62ee4-cad6-4b24-bfc6-c02543039da2'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:38:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7ebb84dc-ce9b-4156-99db-4cbd011a5324 tempest-ProjectReaderTests-1536509139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7ebb84dc-ce9b-4156-99db-4cbd011a5324 tempest-ProjectReaderTests-1536509139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:14 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-7ebb84dc-ce9b-4156-99db-4cbd011a5324 tempest-ProjectReaderTests-1536509139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:38:14 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-7ebb84dc-ce9b-4156-99db-4cbd011a5324 tempest-ProjectReaderTests-1536509139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:38:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-7ebb84dc-ce9b-4156-99db-4cbd011a5324 tempest-ProjectReaderTests-1536509139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:14 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7ebb84dc-ce9b-4156-99db-4cbd011a5324 tempest-ProjectReaderTests-1536509139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:14 devstack sudo[106512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:38:14 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:15 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-7ebb84dc-ce9b-4156-99db-4cbd011a5324 tempest-ProjectReaderTests-1536509139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.702s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:15 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-7ebb84dc-ce9b-4156-99db-4cbd011a5324 tempest-ProjectReaderTests-1536509139 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:38:15 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-7ebb84dc-ce9b-4156-99db-4cbd011a5324 tempest-ProjectReaderTests-1536509139 None] Deleted volume successfully. Jul 07 08:38:15 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-7ebb84dc-ce9b-4156-99db-4cbd011a5324 tempest-ProjectReaderTests-1536509139 None] Lock "cinder-3c72e4c4-67ac-4127-95b4-1e59dacc2bd1-delete_volume" released by "delete_volume" :: held 2.390s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:15 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f8d07fc-03c0-45cf-ab17-36a9695433b9 tempest-ProjectReaderTests-1536509139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:38:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8f8d07fc-03c0-45cf-ab17-36a9695433b9 tempest-ProjectReaderTests-1536509139 None] Flow 'volume_create_manager' (d68da783-4e94-435c-909d-bf63e86de3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:38:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8f8d07fc-03c0-45cf-ab17-36a9695433b9 tempest-ProjectReaderTests-1536509139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (238b7287-9e6e-4f6f-9c33-81faf0355463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8f8d07fc-03c0-45cf-ab17-36a9695433b9 tempest-ProjectReaderTests-1536509139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (238b7287-9e6e-4f6f-9c33-81faf0355463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:38:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2024556121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8097b0f8-bf9b-4393-80cf-8ae11826bdd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d07b3cb378e4cc2a5d0a45f11a8531b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:38:15Z,use_quota=True,user_id='67e5db4184424ffa814022ce93fa19a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8f8d07fc-03c0-45cf-ab17-36a9695433b9 tempest-ProjectReaderTests-1536509139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63f87b93-44ff-4e03-8b74-28df97abaedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8f8d07fc-03c0-45cf-ab17-36a9695433b9 tempest-ProjectReaderTests-1536509139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63f87b93-44ff-4e03-8b74-28df97abaedf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8f8d07fc-03c0-45cf-ab17-36a9695433b9 tempest-ProjectReaderTests-1536509139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3384427-8b3f-486d-99dd-107979c3ed07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8f8d07fc-03c0-45cf-ab17-36a9695433b9 tempest-ProjectReaderTests-1536509139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3384427-8b3f-486d-99dd-107979c3ed07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8097b0f8-bf9b-4393-80cf-8ae11826bdd3', 'volume_name': 'volume-8097b0f8-bf9b-4393-80cf-8ae11826bdd3', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8f8d07fc-03c0-45cf-ab17-36a9695433b9 tempest-ProjectReaderTests-1536509139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e7c647e-b77c-4ffa-a801-6afa3c459a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8f8d07fc-03c0-45cf-ab17-36a9695433b9 tempest-ProjectReaderTests-1536509139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e7c647e-b77c-4ffa-a801-6afa3c459a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:15 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8f8d07fc-03c0-45cf-ab17-36a9695433b9 tempest-ProjectReaderTests-1536509139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a4c84d0-fbf1-4531-82dc-a98cfd0dbffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:15 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-8f8d07fc-03c0-45cf-ab17-36a9695433b9 tempest-ProjectReaderTests-1536509139 None] Volume 8097b0f8-bf9b-4393-80cf-8ae11826bdd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8097b0f8-bf9b-4393-80cf-8ae11826bdd3', 'volume_size': 1} Jul 07 08:38:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8f8d07fc-03c0-45cf-ab17-36a9695433b9 tempest-ProjectReaderTests-1536509139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8f8d07fc-03c0-45cf-ab17-36a9695433b9 tempest-ProjectReaderTests-1536509139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8f8d07fc-03c0-45cf-ab17-36a9695433b9 tempest-ProjectReaderTests-1536509139 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:38:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2024556121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8097b0f8-bf9b-4393-80cf-8ae11826bdd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d07b3cb378e4cc2a5d0a45f11a8531b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:38:15Z,use_quota=True,user_id='67e5db4184424ffa814022ce93fa19a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:38:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-8f8d07fc-03c0-45cf-ab17-36a9695433b9 tempest-ProjectReaderTests-1536509139 None] Creating volume 8097b0f8-bf9b-4393-80cf-8ae11826bdd3 {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:38:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8f8d07fc-03c0-45cf-ab17-36a9695433b9 tempest-ProjectReaderTests-1536509139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8f8d07fc-03c0-45cf-ab17-36a9695433b9 tempest-ProjectReaderTests-1536509139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8f8d07fc-03c0-45cf-ab17-36a9695433b9 tempest-ProjectReaderTests-1536509139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:38:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8f8d07fc-03c0-45cf-ab17-36a9695433b9 tempest-ProjectReaderTests-1536509139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:38:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8f8d07fc-03c0-45cf-ab17-36a9695433b9 tempest-ProjectReaderTests-1536509139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:15 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8f8d07fc-03c0-45cf-ab17-36a9695433b9 tempest-ProjectReaderTests-1536509139 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:38:15 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-8f8d07fc-03c0-45cf-ab17-36a9695433b9 tempest-ProjectReaderTests-1536509139 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:38:15 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8f8d07fc-03c0-45cf-ab17-36a9695433b9 tempest-ProjectReaderTests-1536509139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8097b0f8-bf9b-4393-80cf-8ae11826bdd3 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:15 devstack sudo[106515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8097b0f8-bf9b-4393-80cf-8ae11826bdd3 1073741824 Jul 07 08:38:15 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:16 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8f8d07fc-03c0-45cf-ab17-36a9695433b9 tempest-ProjectReaderTests-1536509139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8097b0f8-bf9b-4393-80cf-8ae11826bdd3 1073741824" returned: 0 in 0.772s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8f8d07fc-03c0-45cf-ab17-36a9695433b9 tempest-ProjectReaderTests-1536509139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8097b0f8-bf9b-4393-80cf-8ae11826bdd3 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:16 devstack sudo[106520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8097b0f8-bf9b-4393-80cf-8ae11826bdd3 Jul 07 08:38:16 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:16 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-8f8d07fc-03c0-45cf-ab17-36a9695433b9 tempest-ProjectReaderTests-1536509139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8097b0f8-bf9b-4393-80cf-8ae11826bdd3" returned: 0 in 0.662s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:16 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-8f8d07fc-03c0-45cf-ab17-36a9695433b9 tempest-ProjectReaderTests-1536509139 None] <== create_volume: return (1499ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:38:16 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-8f8d07fc-03c0-45cf-ab17-36a9695433b9 tempest-ProjectReaderTests-1536509139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8f8d07fc-03c0-45cf-ab17-36a9695433b9 tempest-ProjectReaderTests-1536509139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a4c84d0-fbf1-4531-82dc-a98cfd0dbffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8097b0f8-bf9b-4393-80cf-8ae11826bdd3', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8f8d07fc-03c0-45cf-ab17-36a9695433b9 tempest-ProjectReaderTests-1536509139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d432a1f2-1346-4b76-bc71-dba697e00927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:16 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-8f8d07fc-03c0-45cf-ab17-36a9695433b9 tempest-ProjectReaderTests-1536509139 None] Volume volume-8097b0f8-bf9b-4393-80cf-8ae11826bdd3 (8097b0f8-bf9b-4393-80cf-8ae11826bdd3): created successfully Jul 07 08:38:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8f8d07fc-03c0-45cf-ab17-36a9695433b9 tempest-ProjectReaderTests-1536509139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d432a1f2-1346-4b76-bc71-dba697e00927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:16 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-8f8d07fc-03c0-45cf-ab17-36a9695433b9 tempest-ProjectReaderTests-1536509139 None] Flow 'volume_create_manager' (d68da783-4e94-435c-909d-bf63e86de3c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:38:16 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-8f8d07fc-03c0-45cf-ab17-36a9695433b9 tempest-ProjectReaderTests-1536509139 None] Created volume successfully. Jul 07 08:38:17 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-730e7cde-e384-472d-8445-6a205d3dbf50 tempest-ProjectReaderTests-1536509139 None] Acquiring lock "cinder-8097b0f8-bf9b-4393-80cf-8ae11826bdd3-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:17 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-730e7cde-e384-472d-8445-6a205d3dbf50 tempest-ProjectReaderTests-1536509139 None] Lock "cinder-8097b0f8-bf9b-4393-80cf-8ae11826bdd3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:17 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-730e7cde-e384-472d-8445-6a205d3dbf50 tempest-ProjectReaderTests-1536509139 None] Acquiring lock "cinder-quobyte-8097b0f8-bf9b-4393-80cf-8ae11826bdd3" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:17 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-730e7cde-e384-472d-8445-6a205d3dbf50 tempest-ProjectReaderTests-1536509139 None] Lock "cinder-quobyte-8097b0f8-bf9b-4393-80cf-8ae11826bdd3" acquired by "delete_volume" :: waited 0.016s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:17 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b9b1ed-8f20-4eb9-8d83-73ddd22e1c57]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:38:17 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-730e7cde-e384-472d-8445-6a205d3dbf50 tempest-ProjectReaderTests-1536509139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8097b0f8-bf9b-4393-80cf-8ae11826bdd3 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:17 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8097b0f8-bf9b-4393-80cf-8ae11826bdd3 Jul 07 08:38:17 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:18 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-730e7cde-e384-472d-8445-6a205d3dbf50 tempest-ProjectReaderTests-1536509139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8097b0f8-bf9b-4393-80cf-8ae11826bdd3" returned: 0 in 0.731s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-730e7cde-e384-472d-8445-6a205d3dbf50 tempest-ProjectReaderTests-1536509139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8097b0f8-bf9b-4393-80cf-8ae11826bdd3 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:18 devstack sudo[106528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8097b0f8-bf9b-4393-80cf-8ae11826bdd3 Jul 07 08:38:18 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:18 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:18 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-730e7cde-e384-472d-8445-6a205d3dbf50 tempest-ProjectReaderTests-1536509139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-8097b0f8-bf9b-4393-80cf-8ae11826bdd3" returned: 0 in 0.644s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:18 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-730e7cde-e384-472d-8445-6a205d3dbf50 tempest-ProjectReaderTests-1536509139 None] Lock "cinder-quobyte-8097b0f8-bf9b-4393-80cf-8ae11826bdd3" released by "delete_volume" :: held 1.410s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:18 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-730e7cde-e384-472d-8445-6a205d3dbf50 tempest-ProjectReaderTests-1536509139 None] Created reservations ['40326d04-3741-4597-ac36-994536c7fac3', 'a43156c0-5fcc-46b2-a769-7db444005745', '0bf478a9-e14e-4869-9141-1ef83a6a8a11', 'd5ba5876-3d7a-471d-b99c-067f67d89e70'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:38:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-730e7cde-e384-472d-8445-6a205d3dbf50 tempest-ProjectReaderTests-1536509139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-730e7cde-e384-472d-8445-6a205d3dbf50 tempest-ProjectReaderTests-1536509139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:19 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-730e7cde-e384-472d-8445-6a205d3dbf50 tempest-ProjectReaderTests-1536509139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:38:19 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-730e7cde-e384-472d-8445-6a205d3dbf50 tempest-ProjectReaderTests-1536509139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:38:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-730e7cde-e384-472d-8445-6a205d3dbf50 tempest-ProjectReaderTests-1536509139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-730e7cde-e384-472d-8445-6a205d3dbf50 tempest-ProjectReaderTests-1536509139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:19 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:38:19 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:19 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:19 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-730e7cde-e384-472d-8445-6a205d3dbf50 tempest-ProjectReaderTests-1536509139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.630s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:19 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-730e7cde-e384-472d-8445-6a205d3dbf50 tempest-ProjectReaderTests-1536509139 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:38:19 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-730e7cde-e384-472d-8445-6a205d3dbf50 tempest-ProjectReaderTests-1536509139 None] Deleted volume successfully. Jul 07 08:38:19 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-730e7cde-e384-472d-8445-6a205d3dbf50 tempest-ProjectReaderTests-1536509139 None] Lock "cinder-8097b0f8-bf9b-4393-80cf-8ae11826bdd3-delete_volume" released by "delete_volume" :: held 2.228s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:20 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8b0077d-ad00-4a29-b9d4-7a65ec92598d tempest-ProjectReaderTests-1536509139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:38:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d8b0077d-ad00-4a29-b9d4-7a65ec92598d tempest-ProjectReaderTests-1536509139 None] Flow 'volume_create_manager' (b8f5e3c2-9c72-4312-9cc2-fa1882370383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:38:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d8b0077d-ad00-4a29-b9d4-7a65ec92598d tempest-ProjectReaderTests-1536509139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fe58497-0437-41b7-be28-64be516c1b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d8b0077d-ad00-4a29-b9d4-7a65ec92598d tempest-ProjectReaderTests-1536509139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fe58497-0437-41b7-be28-64be516c1b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:38:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-505747921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecaef15b-b426-4b7f-9bbe-cd91799c0e2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d07b3cb378e4cc2a5d0a45f11a8531b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:38:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:38:20Z,use_quota=True,user_id='67e5db4184424ffa814022ce93fa19a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d8b0077d-ad00-4a29-b9d4-7a65ec92598d tempest-ProjectReaderTests-1536509139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27f4e487-862b-4f85-9133-91c15dfd4f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d8b0077d-ad00-4a29-b9d4-7a65ec92598d tempest-ProjectReaderTests-1536509139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27f4e487-862b-4f85-9133-91c15dfd4f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d8b0077d-ad00-4a29-b9d4-7a65ec92598d tempest-ProjectReaderTests-1536509139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (361c8fb4-feda-4c66-8764-1d14b5a6e97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d8b0077d-ad00-4a29-b9d4-7a65ec92598d tempest-ProjectReaderTests-1536509139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (361c8fb4-feda-4c66-8764-1d14b5a6e97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecaef15b-b426-4b7f-9bbe-cd91799c0e2a', 'volume_name': 'volume-ecaef15b-b426-4b7f-9bbe-cd91799c0e2a', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d8b0077d-ad00-4a29-b9d4-7a65ec92598d tempest-ProjectReaderTests-1536509139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4802f2a-c675-40e4-8a3a-88ac135f9949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d8b0077d-ad00-4a29-b9d4-7a65ec92598d tempest-ProjectReaderTests-1536509139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4802f2a-c675-40e4-8a3a-88ac135f9949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:20 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d8b0077d-ad00-4a29-b9d4-7a65ec92598d tempest-ProjectReaderTests-1536509139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfa5b7f3-9bd2-4992-a360-8cc8442c109b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:20 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-d8b0077d-ad00-4a29-b9d4-7a65ec92598d tempest-ProjectReaderTests-1536509139 None] Volume ecaef15b-b426-4b7f-9bbe-cd91799c0e2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecaef15b-b426-4b7f-9bbe-cd91799c0e2a', 'volume_size': 1} Jul 07 08:38:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d8b0077d-ad00-4a29-b9d4-7a65ec92598d tempest-ProjectReaderTests-1536509139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d8b0077d-ad00-4a29-b9d4-7a65ec92598d tempest-ProjectReaderTests-1536509139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:20 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d8b0077d-ad00-4a29-b9d4-7a65ec92598d tempest-ProjectReaderTests-1536509139 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:38:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-505747921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecaef15b-b426-4b7f-9bbe-cd91799c0e2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d07b3cb378e4cc2a5d0a45f11a8531b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:38:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:38:20Z,use_quota=True,user_id='67e5db4184424ffa814022ce93fa19a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:38:20 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-d8b0077d-ad00-4a29-b9d4-7a65ec92598d tempest-ProjectReaderTests-1536509139 None] Creating volume ecaef15b-b426-4b7f-9bbe-cd91799c0e2a {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:38:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d8b0077d-ad00-4a29-b9d4-7a65ec92598d tempest-ProjectReaderTests-1536509139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d8b0077d-ad00-4a29-b9d4-7a65ec92598d tempest-ProjectReaderTests-1536509139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:20 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d8b0077d-ad00-4a29-b9d4-7a65ec92598d tempest-ProjectReaderTests-1536509139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:38:20 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d8b0077d-ad00-4a29-b9d4-7a65ec92598d tempest-ProjectReaderTests-1536509139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:38:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d8b0077d-ad00-4a29-b9d4-7a65ec92598d tempest-ProjectReaderTests-1536509139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:20 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d8b0077d-ad00-4a29-b9d4-7a65ec92598d tempest-ProjectReaderTests-1536509139 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:38:20 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-d8b0077d-ad00-4a29-b9d4-7a65ec92598d tempest-ProjectReaderTests-1536509139 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:38:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d8b0077d-ad00-4a29-b9d4-7a65ec92598d tempest-ProjectReaderTests-1536509139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecaef15b-b426-4b7f-9bbe-cd91799c0e2a 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:20 devstack sudo[106534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecaef15b-b426-4b7f-9bbe-cd91799c0e2a 1073741824 Jul 07 08:38:20 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:20 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d8b0077d-ad00-4a29-b9d4-7a65ec92598d tempest-ProjectReaderTests-1536509139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecaef15b-b426-4b7f-9bbe-cd91799c0e2a 1073741824" returned: 0 in 0.771s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:20 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d8b0077d-ad00-4a29-b9d4-7a65ec92598d tempest-ProjectReaderTests-1536509139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecaef15b-b426-4b7f-9bbe-cd91799c0e2a {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:20 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecaef15b-b426-4b7f-9bbe-cd91799c0e2a Jul 07 08:38:20 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:21 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d8b0077d-ad00-4a29-b9d4-7a65ec92598d tempest-ProjectReaderTests-1536509139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecaef15b-b426-4b7f-9bbe-cd91799c0e2a" returned: 0 in 0.608s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:21 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d8b0077d-ad00-4a29-b9d4-7a65ec92598d tempest-ProjectReaderTests-1536509139 None] <== create_volume: return (1418ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:38:21 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d8b0077d-ad00-4a29-b9d4-7a65ec92598d tempest-ProjectReaderTests-1536509139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.420s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d8b0077d-ad00-4a29-b9d4-7a65ec92598d tempest-ProjectReaderTests-1536509139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfa5b7f3-9bd2-4992-a360-8cc8442c109b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecaef15b-b426-4b7f-9bbe-cd91799c0e2a', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d8b0077d-ad00-4a29-b9d4-7a65ec92598d tempest-ProjectReaderTests-1536509139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (063ec645-1c18-42ae-b427-7807294ed9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:21 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-d8b0077d-ad00-4a29-b9d4-7a65ec92598d tempest-ProjectReaderTests-1536509139 None] Volume volume-ecaef15b-b426-4b7f-9bbe-cd91799c0e2a (ecaef15b-b426-4b7f-9bbe-cd91799c0e2a): created successfully Jul 07 08:38:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d8b0077d-ad00-4a29-b9d4-7a65ec92598d tempest-ProjectReaderTests-1536509139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (063ec645-1c18-42ae-b427-7807294ed9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:21 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d8b0077d-ad00-4a29-b9d4-7a65ec92598d tempest-ProjectReaderTests-1536509139 None] Flow 'volume_create_manager' (b8f5e3c2-9c72-4312-9cc2-fa1882370383) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:38:21 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-d8b0077d-ad00-4a29-b9d4-7a65ec92598d tempest-ProjectReaderTests-1536509139 None] Created volume successfully. Jul 07 08:38:22 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e405f0f7-d67c-4e7e-8af7-76542e873321 tempest-ProjectReaderTests-1536509139 None] Acquiring lock "cinder-ecaef15b-b426-4b7f-9bbe-cd91799c0e2a-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:22 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e405f0f7-d67c-4e7e-8af7-76542e873321 tempest-ProjectReaderTests-1536509139 None] Lock "cinder-ecaef15b-b426-4b7f-9bbe-cd91799c0e2a-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:22 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e405f0f7-d67c-4e7e-8af7-76542e873321 tempest-ProjectReaderTests-1536509139 None] Acquiring lock "cinder-quobyte-ecaef15b-b426-4b7f-9bbe-cd91799c0e2a" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:22 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e405f0f7-d67c-4e7e-8af7-76542e873321 tempest-ProjectReaderTests-1536509139 None] Lock "cinder-quobyte-ecaef15b-b426-4b7f-9bbe-cd91799c0e2a" acquired by "delete_volume" :: waited 0.014s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:22 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f72499a-feff-4ede-b1d5-2072168a1e91]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:38:22 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e405f0f7-d67c-4e7e-8af7-76542e873321 tempest-ProjectReaderTests-1536509139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecaef15b-b426-4b7f-9bbe-cd91799c0e2a {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:22 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecaef15b-b426-4b7f-9bbe-cd91799c0e2a Jul 07 08:38:22 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:23 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e405f0f7-d67c-4e7e-8af7-76542e873321 tempest-ProjectReaderTests-1536509139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecaef15b-b426-4b7f-9bbe-cd91799c0e2a" returned: 0 in 0.723s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e405f0f7-d67c-4e7e-8af7-76542e873321 tempest-ProjectReaderTests-1536509139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecaef15b-b426-4b7f-9bbe-cd91799c0e2a {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:23 devstack sudo[106549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecaef15b-b426-4b7f-9bbe-cd91799c0e2a Jul 07 08:38:23 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:23 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e405f0f7-d67c-4e7e-8af7-76542e873321 tempest-ProjectReaderTests-1536509139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-ecaef15b-b426-4b7f-9bbe-cd91799c0e2a" returned: 0 in 0.614s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:23 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e405f0f7-d67c-4e7e-8af7-76542e873321 tempest-ProjectReaderTests-1536509139 None] Lock "cinder-quobyte-ecaef15b-b426-4b7f-9bbe-cd91799c0e2a" released by "delete_volume" :: held 1.375s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:23 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-e405f0f7-d67c-4e7e-8af7-76542e873321 tempest-ProjectReaderTests-1536509139 None] Created reservations ['ac27d32e-6212-427b-8476-2386d23a559f', '5d11b85c-423b-49fb-9467-798d9db33296', '804c42da-9870-4e4e-96ef-3c6ca99024d8', '3b45a1d3-8736-45f2-b7bf-50e3fddd7604'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:38:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e405f0f7-d67c-4e7e-8af7-76542e873321 tempest-ProjectReaderTests-1536509139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e405f0f7-d67c-4e7e-8af7-76542e873321 tempest-ProjectReaderTests-1536509139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e405f0f7-d67c-4e7e-8af7-76542e873321 tempest-ProjectReaderTests-1536509139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:38:23 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-e405f0f7-d67c-4e7e-8af7-76542e873321 tempest-ProjectReaderTests-1536509139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:38:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-e405f0f7-d67c-4e7e-8af7-76542e873321 tempest-ProjectReaderTests-1536509139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:23 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e405f0f7-d67c-4e7e-8af7-76542e873321 tempest-ProjectReaderTests-1536509139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:23 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:38:23 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:24 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-e405f0f7-d67c-4e7e-8af7-76542e873321 tempest-ProjectReaderTests-1536509139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.613s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:24 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-e405f0f7-d67c-4e7e-8af7-76542e873321 tempest-ProjectReaderTests-1536509139 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:38:24 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-e405f0f7-d67c-4e7e-8af7-76542e873321 tempest-ProjectReaderTests-1536509139 None] Deleted volume successfully. Jul 07 08:38:24 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-e405f0f7-d67c-4e7e-8af7-76542e873321 tempest-ProjectReaderTests-1536509139 None] Lock "cinder-ecaef15b-b426-4b7f-9bbe-cd91799c0e2a-delete_volume" released by "delete_volume" :: held 2.171s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:24 devstack cinder-volume[87199]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9d55c60-0011-41f2-84d0-854f2f98dff6 tempest-ProjectReaderTests-1536509139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87199) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:38:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d9d55c60-0011-41f2-84d0-854f2f98dff6 tempest-ProjectReaderTests-1536509139 None] Flow 'volume_create_manager' (570f69e1-bf52-4639-aa34-eab92ecd9f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:38:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d9d55c60-0011-41f2-84d0-854f2f98dff6 tempest-ProjectReaderTests-1536509139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad97a0ee-2fd3-437e-90e7-35e7d7e18d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d9d55c60-0011-41f2-84d0-854f2f98dff6 tempest-ProjectReaderTests-1536509139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad97a0ee-2fd3-437e-90e7-35e7d7e18d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:38:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2104921879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70721635-8c39-457e-90db-45275387975b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d07b3cb378e4cc2a5d0a45f11a8531b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:38:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:38:25Z,use_quota=True,user_id='67e5db4184424ffa814022ce93fa19a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d9d55c60-0011-41f2-84d0-854f2f98dff6 tempest-ProjectReaderTests-1536509139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2db5c7ed-7a90-4075-bb41-cad4d11a1fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d9d55c60-0011-41f2-84d0-854f2f98dff6 tempest-ProjectReaderTests-1536509139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2db5c7ed-7a90-4075-bb41-cad4d11a1fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d9d55c60-0011-41f2-84d0-854f2f98dff6 tempest-ProjectReaderTests-1536509139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b8497cd-49fa-4feb-b75b-2e0d51cad708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d9d55c60-0011-41f2-84d0-854f2f98dff6 tempest-ProjectReaderTests-1536509139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b8497cd-49fa-4feb-b75b-2e0d51cad708) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70721635-8c39-457e-90db-45275387975b', 'volume_name': 'volume-70721635-8c39-457e-90db-45275387975b', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d9d55c60-0011-41f2-84d0-854f2f98dff6 tempest-ProjectReaderTests-1536509139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeda97dd-4c08-4169-a3ec-bdf0b043d82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d9d55c60-0011-41f2-84d0-854f2f98dff6 tempest-ProjectReaderTests-1536509139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeda97dd-4c08-4169-a3ec-bdf0b043d82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:24 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d9d55c60-0011-41f2-84d0-854f2f98dff6 tempest-ProjectReaderTests-1536509139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4708c8e-ae95-4af8-8ba5-cc4e1dadb0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:24 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-d9d55c60-0011-41f2-84d0-854f2f98dff6 tempest-ProjectReaderTests-1536509139 None] Volume 70721635-8c39-457e-90db-45275387975b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70721635-8c39-457e-90db-45275387975b', 'volume_size': 1} Jul 07 08:38:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d9d55c60-0011-41f2-84d0-854f2f98dff6 tempest-ProjectReaderTests-1536509139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d9d55c60-0011-41f2-84d0-854f2f98dff6 tempest-ProjectReaderTests-1536509139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:24 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d9d55c60-0011-41f2-84d0-854f2f98dff6 tempest-ProjectReaderTests-1536509139 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:38:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2104921879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70721635-8c39-457e-90db-45275387975b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d07b3cb378e4cc2a5d0a45f11a8531b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:38:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:38:25Z,use_quota=True,user_id='67e5db4184424ffa814022ce93fa19a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be99f3cd-4bf9-4412-8f13-48c4113faa7f),volume_type_id=be99f3cd-4bf9-4412-8f13-48c4113faa7f)}" {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:38:24 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.remotefs [None req-d9d55c60-0011-41f2-84d0-854f2f98dff6 tempest-ProjectReaderTests-1536509139 None] Creating volume 70721635-8c39-457e-90db-45275387975b {{(pid=87199) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:38:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d9d55c60-0011-41f2-84d0-854f2f98dff6 tempest-ProjectReaderTests-1536509139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d9d55c60-0011-41f2-84d0-854f2f98dff6 tempest-ProjectReaderTests-1536509139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:24 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d9d55c60-0011-41f2-84d0-854f2f98dff6 tempest-ProjectReaderTests-1536509139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:38:24 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d9d55c60-0011-41f2-84d0-854f2f98dff6 tempest-ProjectReaderTests-1536509139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:38:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d9d55c60-0011-41f2-84d0-854f2f98dff6 tempest-ProjectReaderTests-1536509139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:24 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d9d55c60-0011-41f2-84d0-854f2f98dff6 tempest-ProjectReaderTests-1536509139 None] Selected osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b as target Quobyte volume. {{(pid=87199) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:38:24 devstack cinder-volume[87199]: INFO cinder.volume.drivers.remotefs [None req-d9d55c60-0011-41f2-84d0-854f2f98dff6 tempest-ProjectReaderTests-1536509139 None] casted to osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b Jul 07 08:38:24 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d9d55c60-0011-41f2-84d0-854f2f98dff6 tempest-ProjectReaderTests-1536509139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-70721635-8c39-457e-90db-45275387975b 1073741824 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:24 devstack sudo[106555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-70721635-8c39-457e-90db-45275387975b 1073741824 Jul 07 08:38:24 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:25 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d9d55c60-0011-41f2-84d0-854f2f98dff6 tempest-ProjectReaderTests-1536509139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-70721635-8c39-457e-90db-45275387975b 1073741824" returned: 0 in 0.757s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:25 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d9d55c60-0011-41f2-84d0-854f2f98dff6 tempest-ProjectReaderTests-1536509139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-70721635-8c39-457e-90db-45275387975b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:25 devstack sudo[106561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-70721635-8c39-457e-90db-45275387975b Jul 07 08:38:25 devstack sudo[106561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:26 devstack sudo[106561]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d9d55c60-0011-41f2-84d0-854f2f98dff6 tempest-ProjectReaderTests-1536509139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-70721635-8c39-457e-90db-45275387975b" returned: 0 in 0.603s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:26 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d9d55c60-0011-41f2-84d0-854f2f98dff6 tempest-ProjectReaderTests-1536509139 None] <== create_volume: return (1397ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'} {{(pid=87199) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:38:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d9d55c60-0011-41f2-84d0-854f2f98dff6 tempest-ProjectReaderTests-1536509139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.400s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d9d55c60-0011-41f2-84d0-854f2f98dff6 tempest-ProjectReaderTests-1536509139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4708c8e-ae95-4af8-8ba5-cc4e1dadb0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70721635-8c39-457e-90db-45275387975b', 'volume_size': 1}' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d9d55c60-0011-41f2-84d0-854f2f98dff6 tempest-ProjectReaderTests-1536509139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d733921-cddd-4c69-a270-3e3e7799a055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:26 devstack cinder-volume[87199]: INFO cinder.volume.flows.manager.create_volume [None req-d9d55c60-0011-41f2-84d0-854f2f98dff6 tempest-ProjectReaderTests-1536509139 None] Volume volume-70721635-8c39-457e-90db-45275387975b (70721635-8c39-457e-90db-45275387975b): created successfully Jul 07 08:38:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d9d55c60-0011-41f2-84d0-854f2f98dff6 tempest-ProjectReaderTests-1536509139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d733921-cddd-4c69-a270-3e3e7799a055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87199) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:26 devstack cinder-volume[87199]: DEBUG cinder.volume.manager [None req-d9d55c60-0011-41f2-84d0-854f2f98dff6 tempest-ProjectReaderTests-1536509139 None] Flow 'volume_create_manager' (570f69e1-bf52-4639-aa34-eab92ecd9f64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87199) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:38:26 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-d9d55c60-0011-41f2-84d0-854f2f98dff6 tempest-ProjectReaderTests-1536509139 None] Created volume successfully. Jul 07 08:38:26 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d6356581-514c-4714-9120-71fffda2aa47 tempest-ProjectReaderTests-1536509139 None] Acquiring lock "cinder-70721635-8c39-457e-90db-45275387975b-delete_volume" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:26 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d6356581-514c-4714-9120-71fffda2aa47 tempest-ProjectReaderTests-1536509139 None] Lock "cinder-70721635-8c39-457e-90db-45275387975b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:26 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d6356581-514c-4714-9120-71fffda2aa47 tempest-ProjectReaderTests-1536509139 None] Acquiring lock "cinder-quobyte-70721635-8c39-457e-90db-45275387975b" by "delete_volume" {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:26 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d6356581-514c-4714-9120-71fffda2aa47 tempest-ProjectReaderTests-1536509139 None] Lock "cinder-quobyte-70721635-8c39-457e-90db-45275387975b" acquired by "delete_volume" :: waited 0.019s {{(pid=87199) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:26 devstack cinder-volume[87199]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa5818c-d2fb-4cca-8bc5-74937ca33ac7]: (4, 'qcow2') {{(pid=88203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:38:26 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d6356581-514c-4714-9120-71fffda2aa47 tempest-ProjectReaderTests-1536509139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-70721635-8c39-457e-90db-45275387975b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:27 devstack sudo[106564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-70721635-8c39-457e-90db-45275387975b Jul 07 08:38:27 devstack sudo[106564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:27 devstack sudo[106564]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d6356581-514c-4714-9120-71fffda2aa47 tempest-ProjectReaderTests-1536509139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-70721635-8c39-457e-90db-45275387975b" returned: 0 in 0.730s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:27 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d6356581-514c-4714-9120-71fffda2aa47 tempest-ProjectReaderTests-1536509139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-70721635-8c39-457e-90db-45275387975b {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:27 devstack sudo[106569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-70721635-8c39-457e-90db-45275387975b Jul 07 08:38:27 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:28 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d6356581-514c-4714-9120-71fffda2aa47 tempest-ProjectReaderTests-1536509139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1/volume-70721635-8c39-457e-90db-45275387975b" returned: 0 in 0.625s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:28 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d6356581-514c-4714-9120-71fffda2aa47 tempest-ProjectReaderTests-1536509139 None] Lock "cinder-quobyte-70721635-8c39-457e-90db-45275387975b" released by "delete_volume" :: held 1.391s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:28 devstack cinder-volume[87199]: DEBUG cinder.quota [None req-d6356581-514c-4714-9120-71fffda2aa47 tempest-ProjectReaderTests-1536509139 None] Created reservations ['80052369-8a58-40c6-8628-26cefe1c82a7', '0147cb57-ed87-4caa-bf37-e8321e6df2cb', 'e84f3136-29d9-4c48-8539-cb047478cec1', '3dca6598-3686-4273-b76d-2eb261a8a488'] {{(pid=87199) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:38:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d6356581-514c-4714-9120-71fffda2aa47 tempest-ProjectReaderTests-1536509139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d6356581-514c-4714-9120-71fffda2aa47 tempest-ProjectReaderTests-1536509139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:28 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d6356581-514c-4714-9120-71fffda2aa47 tempest-ProjectReaderTests-1536509139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b': None} {{(pid=87199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:38:28 devstack cinder-volume[87199]: DEBUG cinder.volume.drivers.quobyte [None req-d6356581-514c-4714-9120-71fffda2aa47 tempest-ProjectReaderTests-1536509139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92bd27e9-4617-48e2-8d6f-a86b25dd362b'] {{(pid=87199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:38:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.lockutils [None req-d6356581-514c-4714-9120-71fffda2aa47 tempest-ProjectReaderTests-1536509139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:28 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d6356581-514c-4714-9120-71fffda2aa47 tempest-ProjectReaderTests-1536509139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:28 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1 Jul 07 08:38:28 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:29 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:29 devstack cinder-volume[87199]: DEBUG oslo_concurrency.processutils [None req-d6356581-514c-4714-9120-71fffda2aa47 tempest-ProjectReaderTests-1536509139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d42c7fa312aa47c9c00771baeba0ea1" returned: 0 in 0.611s {{(pid=87199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:29 devstack cinder-volume[87199]: DEBUG cinder.manager [None req-d6356581-514c-4714-9120-71fffda2aa47 tempest-ProjectReaderTests-1536509139 None] Notifying Schedulers of capabilities ... {{(pid=87199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:38:29 devstack cinder-volume[87199]: INFO cinder.volume.manager [None req-d6356581-514c-4714-9120-71fffda2aa47 tempest-ProjectReaderTests-1536509139 None] Deleted volume successfully. Jul 07 08:38:29 devstack cinder-volume[87199]: DEBUG cinder.coordination [None req-d6356581-514c-4714-9120-71fffda2aa47 tempest-ProjectReaderTests-1536509139 None] Lock "cinder-70721635-8c39-457e-90db-45275387975b-delete_volume" released by "delete_volume" :: held 2.197s {{(pid=87199) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:38 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:UPDATE=45,cinder:SELECT=31,cinder:INSERT=10 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:38:39 devstack cinder-volume[87199]: DEBUG dbcounter [-] [87199] Writing DB stats cinder:UPDATE=54,cinder:SELECT=28,cinder:DELETE=9,cinder:INSERT=10 {{(pid=87199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}